-- Logs begin at Mon 2022-02-21 00:17:29 UTC, end at Mon 2022-02-21 01:54:26 UTC. -- Feb 21 01:00:03.411646 dv-cinder-813227-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 21 01:00:03.421557 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 21 01:00:03.423532 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 21 01:00:03 2022] *** Feb 21 01:00:03.423532 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 21 01:00:03.423532 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 21 01:00:03.423532 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: nodename: dv-cinder-813227-6-iscsi Feb 21 01:00:03.423532 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: machine: x86_64 Feb 21 01:00:03.423532 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: clock source: unix Feb 21 01:00:03.423532 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: pcre jit disabled Feb 21 01:00:03.423532 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: detected number of CPU cores: 4 Feb 21 01:00:03.423532 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: current working directory: / Feb 21 01:00:03.423532 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: detected binary path: /usr/bin/uwsgi-core Feb 21 01:00:03.423532 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: your processes number limit is 47680 Feb 21 01:00:03.424367 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: your memory page size is 4096 bytes Feb 21 01:00:03.424367 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: detected max file descriptor number: 2048 Feb 21 01:00:03.424367 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: lock engine: pthread robust mutexes Feb 21 01:00:03.424367 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: thunder lock: enabled Feb 21 01:00:03.424367 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 21 01:00:03.424367 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 21 01:00:03.469212 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: Python main interpreter initialized at 0x564e518349c0 Feb 21 01:00:03.469212 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: python threads support enabled Feb 21 01:00:03.469212 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: your server socket listen backlog is limited to 100 connections Feb 21 01:00:03.469212 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: your mercy for graceful operations on workers is 90 seconds Feb 21 01:00:03.469614 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: mapped 403077 bytes (393 KB) for 2 cores Feb 21 01:00:03.469614 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: *** Operational MODE: preforking *** Feb 21 01:00:03.469895 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: *** uWSGI is running in multiple interpreter mode *** Feb 21 01:00:03.469895 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: spawned uWSGI master process (pid: 102671) Feb 21 01:00:03.470100 dv-cinder-813227-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 21 01:00:03.475860 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: spawned uWSGI worker 1 (pid: 102672, cores: 1) Feb 21 01:00:03.475860 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: spawned uWSGI worker 2 (pid: 102673, cores: 1) Feb 21 01:00:03.475860 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 21 01:00:05.329289 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:00:05.329289 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: from cryptography.utils import int_from_bytes Feb 21 01:00:05.330055 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:00:05.330055 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: from cryptography.utils import int_from_bytes Feb 21 01:00:05.361633 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:00:05.361633 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: from cryptography.utils import int_from_bytes Feb 21 01:00:05.362755 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:00:05.362755 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: from cryptography.utils import int_from_bytes Feb 21 01:00:07.927378 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 01:00:07.928058 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 01:00:07.928162 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 01:00:07.928531 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 01:00:07.928628 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 01:00:07.928710 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 01:00:07.928787 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 01:00:07.928905 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 01:00:07.929196 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.929318 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 01:00:07.929509 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.929767 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 01:00:07.929888 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.929984 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.930160 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.930374 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.930527 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.930619 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.930856 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.930959 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.931194 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.931299 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.931510 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.931607 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.931856 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.932039 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.932129 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.932215 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.932453 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.932546 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.932760 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.932857 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813227-6-iscsi {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.933081 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.933167 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.933415 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813227-6-iscsi {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.933509 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.933749 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.933854 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.934061 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.934155 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.934385 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.934489 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.935219 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.935358 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.935535 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.935720 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.935875 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.936309 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.936462 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.937828 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.938237 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.938367 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.938498 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.938632 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.938762 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.938894 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.939026 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.939147 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.939274 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.939408 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.939536 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.939659 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.940038 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.940186 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.940314 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.940444 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.940561 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.940683 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.940811 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.940935 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.941081 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813227-6-iscsi {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.941232 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813227-6-iscsi {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.941372 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.941497 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.941619 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.941746 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.941869 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.941993 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.942122 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.942246 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.942364 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.942503 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.942642 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.942771 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.942903 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.943033 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.943244 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.943353 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.943554 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.943677 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.943784 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.947575 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.947669 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.947759 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.947879 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.947965 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.948044 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.948145 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.948232 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.948324 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.948409 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.948495 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.948583 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.948673 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.948759 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.948861 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.948947 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.949033 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.949120 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.949209 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.949308 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.949395 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.949475 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.949554 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.949639 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.949727 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.949823 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.949914 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.950002 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.950092 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.950173 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.950908 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.951011 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.951126 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.951126 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.951279 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.951364 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.951453 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.951534 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.951629 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.951757 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.951946 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.952045 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.952135 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.952223 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.952308 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.952388 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.952388 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.952538 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.952624 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.952704 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.952792 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.952903 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.952992 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.953083 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.953164 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.953248 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.953364 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.953445 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.953546 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.953678 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.953833 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.953999 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.954212 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.954372 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.954536 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.954733 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.954867 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.955003 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.955149 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.955289 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.955434 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.955644 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.955787 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.956003 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.956100 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.956326 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.956429 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.956661 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.956749 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.957031 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.957277 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.957394 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.957526 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.957658 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.957789 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.957952 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.958103 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.958262 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.958396 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.958520 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.958648 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.958812 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.958938 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.959123 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.959250 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.959448 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.959574 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.959761 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.959919 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.960142 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.960281 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.960405 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.960532 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.960689 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.960821 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.961001 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.961147 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.961314 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.961440 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.961625 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.961753 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.961937 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.962087 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.962248 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.962373 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.962556 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.962695 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.962867 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.962995 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.963179 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.963349 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.963513 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.963649 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.963876 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.964007 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.964180 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.964306 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.964490 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.964627 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.964807 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.964933 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.965120 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.965245 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.965432 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.965567 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.965778 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.965944 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.966087 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.966275 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.966398 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.966638 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.966767 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.967009 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.967128 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.967320 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.967437 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.967646 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.967759 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.976432 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.976569 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.976654 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.976734 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.976827 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.976916 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.977001 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.977082 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.977160 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.977244 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.977336 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.977417 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.977496 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.977575 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.977653 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.977744 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.977824 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.977902 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.977902 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.978051 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.978131 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.978220 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.978306 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.978385 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.978463 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.978541 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.978619 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.978705 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.978785 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.978870 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.978949 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.979029 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.979113 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.979201 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.979281 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.979365 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.979484 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.979565 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.979633 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.979723 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.979803 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.979917 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.980005 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.980088 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.980088 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.980247 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.980327 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:00:07.980412 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.980412 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.980564 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.980640 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.980719 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.980797 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.980880 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.980959 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.981042 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.981135 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.981215 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.981294 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.981377 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.982002 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.982136 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.982251 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.982369 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.982455 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.982541 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.982630 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.982718 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.982804 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.982884 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.982963 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.983041 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.983119 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.983212 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.983292 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.983380 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.983486 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.983576 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.983662 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.983914 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.984015 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.984093 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.984168 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.984254 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.984344 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.984503 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.984587 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.984662 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.984748 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.984748 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.984881 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.984966 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.985046 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.985125 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.985207 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.985286 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.985372 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.985595 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.985674 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.985756 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.985825 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.985905 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.985998 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.986078 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.986157 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.986231 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.986304 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.986382 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.986472 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.986552 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.986627 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.986706 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.986784 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.986862 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.986949 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.987029 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.987029 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.987177 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.987257 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.987342 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.987521 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.987610 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.987888 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.987978 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.988217 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.988317 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.988538 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.988625 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.988860 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.988947 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.989184 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.989280 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.989502 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.989589 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.989820 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.989914 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.990172 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.990323 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.990433 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.990516 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.990746 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.990839 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.991057 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.991160 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.991371 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.991458 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.991683 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.991776 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.999287 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.999402 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.999402 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.999563 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.999645 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.999724 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.999811 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.999911 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:07.999991 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.000075 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.000154 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.000233 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.000233 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.000390 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.000469 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.000554 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.000634 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.000719 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.000803 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.000872 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.000956 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.001035 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.001114 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.001199 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.001280 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.001358 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.001436 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.001513 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.001591 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.001677 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.001770 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.001850 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.001937 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.002018 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.002103 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.002190 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.002301 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.002390 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.002471 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.002549 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.002638 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.002730 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.002811 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.002900 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.002986 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.003071 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.003161 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.003242 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.003327 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.003407 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.003486 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.003563 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.003649 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.003729 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.003813 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.003983 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.004066 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.004145 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.004235 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.004312 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.004386 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.004464 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.004549 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.004641 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.004721 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.004796 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.004863 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.004934 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.005050 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.005050 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.005201 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.005275 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.005353 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.005432 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.005509 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.005600 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.005680 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.005765 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.005844 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.005929 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.006009 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.006096 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.006182 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.006262 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.006340 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.006418 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.006504 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.006596 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.006694 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.006781 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.006948 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.007076 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.007273 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.007387 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.007591 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.007736 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.007935 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.008072 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.008317 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.008410 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.008645 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.008869 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.008968 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.009057 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.009259 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.009385 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.009573 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.009703 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.009930 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.010018 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.010245 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.010334 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.010602 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.010691 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.010927 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.011025 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.011242 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.011328 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.011574 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.011715 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.011910 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.022296 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.022407 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.022521 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.022613 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.022696 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.022785 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.022908 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.022999 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.023082 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.023178 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.023263 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.023345 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.023439 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.023525 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.023622 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.023706 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.023786 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.023922 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.024009 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.024091 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.024171 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.024252 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.024332 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.024422 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.024520 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.024602 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.024684 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.024771 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.024852 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.024965 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.025060 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.025165 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.025270 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.025344 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.025424 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.025514 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.025595 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.025682 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.025775 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.025865 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.025946 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.026054 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.026138 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.026233 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.026327 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.026409 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.026497 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.026579 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.026659 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.026740 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.026819 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.026907 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.026997 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.027086 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.027167 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.027255 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.027337 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.027418 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.027510 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.027599 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.027680 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.027768 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.027885 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.027960 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.027960 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.028105 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.028188 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.028271 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.028352 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.028435 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.028550 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.028702 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.028864 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.029051 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.029152 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.029233 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.029315 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.029396 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.029465 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.029544 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.029624 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.029713 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.029795 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.029875 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.029956 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.030044 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.030133 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.030227 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.030316 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.030398 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.030478 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.030575 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.030669 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.030750 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.030853 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.030946 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.031036 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.031654 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.031767 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.031869 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.031953 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.032047 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.032133 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.032133 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.032288 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.032370 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.032450 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.032537 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.032625 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.032708 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.032819 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.032891 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.032959 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.033034 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.033123 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.033217 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.033299 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.033379 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.033458 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.033539 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.033627 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.033717 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.033805 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.033887 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.033974 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.034057 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.034137 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.034228 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.034310 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.034391 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.034471 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.034559 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.034640 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.034728 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.034810 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.034898 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.034979 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.035059 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.035144 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.035214 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.035295 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.035376 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.035456 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.035537 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.035625 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.035715 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.035796 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.035911 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.036005 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.036074 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.036167 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.036251 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.036331 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.036410 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.036618 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.036728 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.036939 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.037039 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.037270 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.037527 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.037617 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.037870 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.037960 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.038194 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.038289 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.038519 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.038647 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.038846 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.038959 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.039161 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.039251 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.039477 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.039567 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.039796 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.039907 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.040146 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.040235 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.040519 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.045230 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.045331 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.045421 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.045514 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.045597 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.045678 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.045759 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.045846 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.045941 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.046023 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.046104 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.046185 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.046185 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.046348 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.046438 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.046521 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.046610 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.046692 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.046773 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.046862 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.046956 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.047050 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.047139 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.047220 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.047307 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.047307 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.047461 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.047554 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.047664 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.047757 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.047873 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.047959 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.048050 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.048132 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.048237 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.048330 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.048451 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.048542 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.048633 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.048715 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.048795 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.048883 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.048973 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.049055 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.049144 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.049226 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.049307 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.049387 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.049474 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.049567 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.049650 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.049736 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.049817 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.049898 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.049992 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.050087 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.050254 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.050346 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.050571 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.050662 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.050920 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.051024 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.051242 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.051333 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.051557 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.051660 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.051893 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.052009 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.052214 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.052304 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.052531 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.052627 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.052846 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.052936 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.053164 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.053252 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.053473 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.053561 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.053810 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.053907 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.054123 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.054221 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.054442 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.054532 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.054756 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.054846 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.055064 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.055152 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.055379 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.055475 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.055694 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.055783 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.056046 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.056139 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.056356 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.056455 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.056671 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.056760 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.056978 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.057073 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.057290 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.057386 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.057598 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.057684 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.057907 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.057994 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.058217 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.058314 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.058531 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.058628 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.058843 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.058985 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.059150 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.059249 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.059467 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.059554 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.060388 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.060523 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.060772 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.060970 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.061067 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.061314 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.061404 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.061625 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.061724 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.061937 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.062034 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.062252 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.062340 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.062588 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.062688 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.062904 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.063253 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.063476 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.063562 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.063791 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.063983 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.064125 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.064215 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.064435 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.064532 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.064745 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.064835 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.065059 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.065148 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.065373 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.065461 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.065679 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.065771 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.065982 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.066070 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.066288 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.066390 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.066594 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.066684 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.066924 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.067023 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.067237 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.067330 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.067545 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.067643 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.067881 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.067993 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.068196 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.073904 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.074013 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.074099 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.074182 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.074263 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.074344 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.074439 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.074522 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.074604 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.074685 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.074765 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.074853 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.074945 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.075027 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.075109 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.075190 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.075300 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.075382 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.075473 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.075631 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.075717 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.075786 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.075905 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.075998 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.076077 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.076154 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.076224 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.076292 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.076360 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.076440 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.076516 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.076622 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.076696 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.076764 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.076832 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.076908 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.076978 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.077045 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.077112 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.077179 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.077246 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.077321 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.077391 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.077464 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.077560 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.077637 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.077713 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.077713 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.077844 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.077912 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.077978 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.078051 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.078147 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.078217 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.078284 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.078350 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.078416 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.078483 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.078558 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.078628 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.078696 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.078762 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.078762 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.078880 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.078956 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.079031 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.079101 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.079168 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.079242 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.079310 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.079385 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.079460 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.079737 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.079824 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.080124 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.080225 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.080542 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.080629 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.080699 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.080767 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.081007 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.081117 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.081324 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.081412 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.081633 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.081719 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.081957 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.082069 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.082278 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.082399 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.082963 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.083113 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.083255 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.083405 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.083567 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.083704 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.083884 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.083974 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.084150 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.084247 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.084330 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.084409 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.084489 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.084616 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.084757 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.085015 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.085116 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.085337 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.085424 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.085661 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.085857 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.085983 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.086063 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.086272 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.086409 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.086582 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.086731 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.086898 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.087051 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.087233 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.087377 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.087543 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.087674 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.087870 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.088020 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.088183 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.088348 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.091085 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.091421 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.091514 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.091594 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.091674 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.091752 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.091862 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.091957 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.092087 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.092180 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.092329 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.092419 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.092691 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.092787 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.092869 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.092939 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.093026 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.093114 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.093196 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.093285 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.093366 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.093444 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.093522 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.093646 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.093757 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.093827 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.093907 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.093983 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.094064 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.094152 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.094233 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.094320 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.094401 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.094401 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.094543 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.094639 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.094730 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.094839 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.094930 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.095169 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.095322 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.095507 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.095603 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.095827 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.096024 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.096181 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.096268 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.096541 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.096644 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.096910 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.097011 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.097198 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.097286 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.097522 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.097619 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.097849 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.097938 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.098160 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.098246 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.098472 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.098576 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.098788 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.098883 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.099096 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.099184 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.099408 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.099505 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.099743 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.099899 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.100155 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.100256 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.100438 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.100528 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.100754 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.100841 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.101069 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.101237 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.101371 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.101505 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.101681 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.101824 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.102014 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.102170 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.102409 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.102564 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.102745 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.102863 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.102987 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.103087 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.103258 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.103362 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.103584 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.103661 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.103920 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.104020 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.104253 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.104331 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.104571 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.104649 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.104882 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.104973 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.105198 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.105283 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.105509 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.105593 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.105839 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.105925 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.106153 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.106234 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.106986 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.107128 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.107333 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.107440 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.107702 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.108038 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.108140 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.108363 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.113545 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.113634 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.113703 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.113779 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.113847 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.114061 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.114162 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.114245 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.114338 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.114420 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.114489 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.114556 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.114649 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.114731 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.114825 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.114914 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.115002 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.115089 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.115178 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.115260 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.115338 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.115417 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.115496 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.115584 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.115665 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.115745 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.115854 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.115973 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.116058 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.116152 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.116240 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.116318 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.116386 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.116453 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.116614 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.116701 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.116789 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.116860 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.116946 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.117027 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.117134 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.117225 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.117306 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.117390 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.117477 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.117558 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.117650 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.117731 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.117809 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.117888 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.117967 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.118046 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.118133 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.118214 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.118300 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.118379 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.118458 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.118536 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.118623 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.118704 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.118789 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.118877 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.118958 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.119048 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.119140 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.119220 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.119311 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.119403 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.119483 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.119570 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.119650 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.119730 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.119810 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.119938 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.120033 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.120124 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.120236 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.120354 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.120584 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.120672 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.120914 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.121242 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.121338 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.121575 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.121662 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.121894 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.121992 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.122834 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.122956 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.123190 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.123399 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.123497 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.123813 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.123939 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.124156 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.124247 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.124475 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.124562 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.124791 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.124880 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.125109 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.125197 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.125446 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.125533 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.125780 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.125867 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.126108 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.126208 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.126434 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.126530 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.126759 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.126844 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.127081 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.127323 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.127417 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.127662 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.127750 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.128084 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.128187 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.128598 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.128709 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.128790 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.128860 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.129036 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.129126 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.129359 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.129456 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.129678 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.129766 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.129998 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.130091 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.130314 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.130408 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.130632 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.130721 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.130951 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.131048 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.131268 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.131369 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.131594 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.131731 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.131925 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.132030 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.132249 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.132345 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.132582 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.132679 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.132983 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.133086 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.133248 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.133334 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.133550 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.133646 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.133870 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.133972 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.134192 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.134280 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.134527 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.134760 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.134857 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.135079 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.135174 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.135422 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.135510 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.135762 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.135867 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.145153 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.145305 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.145568 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.145656 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.145737 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.145833 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.145930 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.146059 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.146185 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.146272 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.146352 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.146447 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.146447 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.146593 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.146680 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.146680 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.146803 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.146878 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.146959 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.147039 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.147116 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.147195 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.147273 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.147361 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.147453 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.147535 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.147620 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.147702 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.147794 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.148001 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.148084 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.148154 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.148233 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.148303 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.148378 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.148459 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.148546 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.148631 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.148700 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.148779 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.148870 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.148951 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.149036 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.149117 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.149202 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.149283 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.149283 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.149436 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.149516 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.149601 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.149682 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.149772 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.149857 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.149937 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.150023 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.150103 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.150182 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.150278 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.150360 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.150439 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.150518 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.150597 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.150676 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.150839 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.150945 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.150945 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.151081 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.151171 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.151252 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.151340 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.151421 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.151500 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.151579 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.151660 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.151747 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.151843 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.151916 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.151984 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.152061 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.152151 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.152240 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.152322 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.152401 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.152481 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.152559 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.152638 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.152729 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.152810 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.152890 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.152980 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.153061 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.153159 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.153293 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.153395 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.153543 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.153686 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.153777 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.153868 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.153951 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.154042 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.154124 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.154204 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.154297 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.154391 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.154473 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.154554 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.154633 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.154714 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.154793 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.154882 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.154963 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.155044 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.155044 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.155188 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.155268 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.155355 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.155355 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.155500 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.155580 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.155660 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.155752 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.155852 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.155973 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.156233 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.156333 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.156613 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.156729 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.156859 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.156959 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.157175 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.157264 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.157489 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.157587 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.157822 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.157910 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.158140 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.158227 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.158458 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.158554 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.158777 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.158872 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.159094 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.159182 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.159411 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.159500 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.159730 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.159817 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.160075 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.160165 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.160393 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.160489 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.160710 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.160797 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.161026 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.161121 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.161339 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.161603 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.161691 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.161951 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.162087 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.162283 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.162379 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.162794 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.163034 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.163034 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.163181 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.163337 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.163470 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.163583 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.163672 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.163929 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.164020 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.164248 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.164336 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.164567 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.164654 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.164888 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.164975 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.165212 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.165310 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.165536 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.165624 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.165844 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.165948 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.166167 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.166357 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.166490 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.166601 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.166811 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.166913 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.167134 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.167226 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.167456 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.167545 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.167775 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.167979 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.168200 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.168297 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.168472 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.168561 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.168802 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.168882 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.169704 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.169792 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.170245 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.170334 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.170598 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.170750 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.170938 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.171081 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.171273 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.171407 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.171589 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.171717 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.171933 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.172072 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.172248 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.172401 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.172565 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.172749 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.172903 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.173076 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.173247 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.173390 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.173571 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.173831 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.173933 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.174158 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.174246 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.174487 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.174583 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.174818 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.174907 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.175139 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.175239 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.175475 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.175563 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.175814 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.175965 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.176155 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.176250 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.176489 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.176587 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.176802 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.176897 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.177123 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.177224 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.177490 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.177593 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.177758 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.177855 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.178076 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.178177 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.178392 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.178486 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.178726 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.178814 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.179045 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.179133 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.179359 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.179441 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.179693 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.179788 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.180045 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.180137 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.180372 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.180461 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.180694 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.180781 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.181014 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.181103 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.181348 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.181434 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.181664 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.181759 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.181982 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.182070 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.182306 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.182393 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.182622 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.182718 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.182939 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.183027 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.183262 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.183357 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.183583 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.183680 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.183927 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.184018 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.184253 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.184356 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.184576 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.184718 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.185656 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.185804 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.185951 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.186040 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.186278 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.186368 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.186637 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.186737 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.186975 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.187063 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.187300 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.187396 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.187622 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.187710 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.188216 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.188312 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.188474 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 01:00:08.188564 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.188878 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.189225 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.189550 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.189874 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.190205 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.190529 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.190853 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.191181 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.191510 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.191872 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.192217 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.192563 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.192906 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.193263 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.193587 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.193945 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.194290 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.194618 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.194942 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.195260 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:00:08.195513 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 01:00:08.211713 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG oslo_db.sqlalchemy.engines [None req-34d1bd7c-284a-4787-867f-40fcb49adeff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:00:08.219225 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_db.sqlalchemy.engines [None req-7bd4b495-1dd7-4580-8e33-ade676a2441f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:00:08.275715 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.context [None req-34d1bd7c-284a-4787-867f-40fcb49adeff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43422379-6863-4985-aea0-21540c83a2e0(cell1) {{(pid=102672) load_cells /opt/stack/nova/nova/context.py:464}} Feb 21 01:00:08.280159 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG oslo_concurrency.lockutils [None req-34d1bd7c-284a-4787-867f-40fcb49adeff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:08.281760 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG oslo_concurrency.lockutils [None req-34d1bd7c-284a-4787-867f-40fcb49adeff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:08.282598 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG oslo_concurrency.lockutils [None req-34d1bd7c-284a-4787-867f-40fcb49adeff None None] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:08.284416 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.context [None req-7bd4b495-1dd7-4580-8e33-ade676a2441f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43422379-6863-4985-aea0-21540c83a2e0(cell1) {{(pid=102673) load_cells /opt/stack/nova/nova/context.py:464}} Feb 21 01:00:08.284660 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG oslo_concurrency.lockutils [None req-34d1bd7c-284a-4787-867f-40fcb49adeff None None] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:08.288716 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_concurrency.lockutils [None req-7bd4b495-1dd7-4580-8e33-ade676a2441f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:08.290317 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_concurrency.lockutils [None req-7bd4b495-1dd7-4580-8e33-ade676a2441f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:08.291168 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_concurrency.lockutils [None req-7bd4b495-1dd7-4580-8e33-ade676a2441f None None] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:08.293215 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_concurrency.lockutils [None req-7bd4b495-1dd7-4580-8e33-ade676a2441f None None] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:08.296159 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG oslo_db.sqlalchemy.engines [None req-34d1bd7c-284a-4787-867f-40fcb49adeff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:00:08.297496 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG oslo_db.sqlalchemy.engines [None req-34d1bd7c-284a-4787-867f-40fcb49adeff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:00:08.306713 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_db.sqlalchemy.engines [None req-7bd4b495-1dd7-4580-8e33-ade676a2441f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:00:08.309389 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_db.sqlalchemy.engines [None req-7bd4b495-1dd7-4580-8e33-ade676a2441f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:00:08.467031 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG oslo_db.sqlalchemy.engines [None req-34d1bd7c-284a-4787-867f-40fcb49adeff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:00:08.479561 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_db.sqlalchemy.engines [None req-7bd4b495-1dd7-4580-8e33-ade676a2441f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:00:08.911470 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: WARNING keystonemiddleware.auth_token [None req-34d1bd7c-284a-4787-867f-40fcb49adeff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 01:00:08.918015 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: WARNING keystonemiddleware.auth_token [None req-34d1bd7c-284a-4787-867f-40fcb49adeff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 01:00:08.964329 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: WARNING keystonemiddleware.auth_token [None req-7bd4b495-1dd7-4580-8e33-ade676a2441f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 01:00:08.972056 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: WARNING keystonemiddleware.auth_token [None req-7bd4b495-1dd7-4580-8e33-ade676a2441f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 01:00:09.262054 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: WARNING keystonemiddleware.auth_token [None req-34d1bd7c-284a-4787-867f-40fcb49adeff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 01:00:09.267956 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: WARNING keystonemiddleware.auth_token [None req-34d1bd7c-284a-4787-867f-40fcb49adeff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 01:00:09.273285 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564e518349c0 pid: 102672 (default app) Feb 21 01:00:09.275321 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-34d1bd7c-284a-4787-867f-40fcb49adeff None None] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:09.276489 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-34d1bd7c-284a-4787-867f-40fcb49adeff None None] 10.222.0.91 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001712 Feb 21 01:00:09.276903 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 1/1] 10.222.0.91 () {50 vars in 788 bytes} [Mon Feb 21 01:00:09 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:00:09.330642 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: WARNING keystonemiddleware.auth_token [None req-7bd4b495-1dd7-4580-8e33-ade676a2441f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 01:00:09.335911 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: WARNING keystonemiddleware.auth_token [None req-7bd4b495-1dd7-4580-8e33-ade676a2441f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 01:00:09.342004 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564e518349c0 pid: 102673 (default app) Feb 21 01:01:35.748221 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-34d1bd7c-284a-4787-867f-40fcb49adeff None None] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:35.749214 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-34d1bd7c-284a-4787-867f-40fcb49adeff None None] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Feb 21 01:01:35.749869 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 2/2] 10.222.0.91 () {54 vars in 930 bytes} [Mon Feb 21 01:01:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:01:36.215450 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-b2c4edf9-ccf7-4169-8886-a8f27209ed0d admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:36.247215 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-b2c4edf9-ccf7-4169-8886-a8f27209ed0d admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.490597 Feb 21 01:01:36.250575 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 1/3] 10.222.0.91 () {60 vars in 1291 bytes} [Mon Feb 21 01:01:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:38.652389 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-34d1bd7c-284a-4787-867f-40fcb49adeff None None] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:38.653398 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-34d1bd7c-284a-4787-867f-40fcb49adeff None None] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Feb 21 01:01:38.654533 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 3/4] 10.222.0.91 () {54 vars in 930 bytes} [Mon Feb 21 01:01:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:01:38.722680 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-6edb50bd-37f2-471e-a498-f1820fb08fe6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "name": "cirros256"}} {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:01:38.741542 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:01:38.741542 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: warnings.warn(msg) Feb 21 01:01:38.835440 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-6edb50bd-37f2-471e-a498-f1820fb08fe6 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.175467 Feb 21 01:01:38.837488 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 2/5] 10.222.0.91 () {64 vars in 1282 bytes} [Mon Feb 21 01:01:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:01:39.071095 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-561eaee1-1b42-4c23-903c-2568640a02ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:01:39.073646 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:01:39.073646 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: warnings.warn(msg) Feb 21 01:01:39.205195 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-561eaee1-1b42-4c23-903c-2568640a02ef admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.360405 Feb 21 01:01:39.220036 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 4/6] 10.222.0.91 () {64 vars in 1335 bytes} [Mon Feb 21 01:01:38 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:01:41.584808 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-6edb50bd-37f2-471e-a498-f1820fb08fe6 admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:41.585823 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-6edb50bd-37f2-471e-a498-f1820fb08fe6 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Feb 21 01:01:41.586548 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 3/7] 10.222.0.91 () {54 vars in 930 bytes} [Mon Feb 21 01:01:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:01:41.713358 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-29b9619f-e576-4e19-852e-2925f47a6df3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M", "disk": 5, "vcpus": 1, "ram": 512, "id": "d1"}} {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:01:41.733853 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:01:41.733853 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: warnings.warn(msg) Feb 21 01:01:41.827225 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-29b9619f-e576-4e19-852e-2925f47a6df3 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.234643 Feb 21 01:01:41.827985 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 5/8] 10.222.0.91 () {64 vars in 1282 bytes} [Mon Feb 21 01:01:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:01:41.840900 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-a40f8548-3cb4-4f4a-a8e3-fb3dc787475a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:01:41.842438 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:01:41.842438 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: warnings.warn(msg) Feb 21 01:01:41.944888 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-a40f8548-3cb4-4f4a-a8e3-fb3dc787475a admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108390 Feb 21 01:01:41.954546 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 4/9] 10.222.0.91 () {64 vars in 1335 bytes} [Mon Feb 21 01:01:41 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:44.457228 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-29b9619f-e576-4e19-852e-2925f47a6df3 admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:44.458233 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-29b9619f-e576-4e19-852e-2925f47a6df3 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Feb 21 01:01:44.458664 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 6/10] 10.222.0.91 () {54 vars in 930 bytes} [Mon Feb 21 01:01:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:01:44.521890 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-8edab5df-3aca-48d1-b7fa-5d65c60a1d31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "id": "d2"}} {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:01:44.617000 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-8edab5df-3aca-48d1-b7fa-5d65c60a1d31 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.149006 Feb 21 01:01:44.617689 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 5/11] 10.222.0.91 () {64 vars in 1282 bytes} [Mon Feb 21 01:01:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:01:44.629956 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-4890c3c9-d680-4b15-8f35-8d6ac14abadf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:01:44.737426 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-4890c3c9-d680-4b15-8f35-8d6ac14abadf admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111271 Feb 21 01:01:44.738345 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 7/12] 10.222.0.91 () {64 vars in 1335 bytes} [Mon Feb 21 01:01:44 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:47.151023 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-8edab5df-3aca-48d1-b7fa-5d65c60a1d31 admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:47.152173 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-8edab5df-3aca-48d1-b7fa-5d65c60a1d31 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Feb 21 01:01:47.152603 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 6/13] 10.222.0.91 () {54 vars in 930 bytes} [Mon Feb 21 01:01:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:01:47.221808 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-a33f5276-591c-4517-a45d-78e308e46ca8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 2, "name": "ds2G", "swap": 0, "id": "d3", "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:01:47.310861 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-a33f5276-591c-4517-a45d-78e308e46ca8 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.151850 Feb 21 01:01:47.311388 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 8/14] 10.222.0.91 () {64 vars in 1282 bytes} [Mon Feb 21 01:01:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:01:47.323463 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-91649300-ae44-4874-b926-1170f45b4d39 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:01:47.400251 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-91649300-ae44-4874-b926-1170f45b4d39 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080825 Feb 21 01:01:47.400838 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 7/15] 10.222.0.91 () {64 vars in 1335 bytes} [Mon Feb 21 01:01:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:01:49.832852 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-a33f5276-591c-4517-a45d-78e308e46ca8 admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:49.833849 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-a33f5276-591c-4517-a45d-78e308e46ca8 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Feb 21 01:01:49.834280 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 9/16] 10.222.0.91 () {54 vars in 930 bytes} [Mon Feb 21 01:01:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:01:49.899335 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-469f18c2-e066-4f03-9341-73cdc7dff680 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d4", "disk": 20, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "ram": 4096, "swap": 0}} {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:01:49.973736 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-469f18c2-e066-4f03-9341-73cdc7dff680 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.132610 Feb 21 01:01:49.974321 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 8/17] 10.222.0.91 () {64 vars in 1282 bytes} [Mon Feb 21 01:01:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:01:49.987269 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-0d711668-4c51-4d0f-9029-f2045eb24f2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:01:50.064454 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-0d711668-4c51-4d0f-9029-f2045eb24f2e admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080498 Feb 21 01:01:50.065516 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 10/18] 10.222.0.91 () {64 vars in 1335 bytes} [Mon Feb 21 01:01:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:52.522321 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-469f18c2-e066-4f03-9341-73cdc7dff680 admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:52.523543 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-469f18c2-e066-4f03-9341-73cdc7dff680 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Feb 21 01:01:52.524139 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 9/19] 10.222.0.91 () {54 vars in 930 bytes} [Mon Feb 21 01:01:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:01:52.583749 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-b34d8b53-6a2a-40f9-94c3-f092a0126cbd admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:52.608560 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-b34d8b53-6a2a-40f9-94c3-f092a0126cbd admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077162 Feb 21 01:01:52.609028 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 11/20] 10.222.0.91 () {60 vars in 1291 bytes} [Mon Feb 21 01:01:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:01:55.242965 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-469f18c2-e066-4f03-9341-73cdc7dff680 admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:55.244011 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-469f18c2-e066-4f03-9341-73cdc7dff680 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Feb 21 01:01:55.244416 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 10/21] 10.222.0.91 () {54 vars in 930 bytes} [Mon Feb 21 01:01:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:01:55.309406 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-61126e7c-1649-4835-aea5-f1a97f1c1c1e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "id": "1", "swap": 0, "vcpus": 1, "ram": 512, "name": "m1.tiny"}} {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:01:55.395541 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-61126e7c-1649-4835-aea5-f1a97f1c1c1e admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.144961 Feb 21 01:01:55.396467 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 12/22] 10.222.0.91 () {64 vars in 1282 bytes} [Mon Feb 21 01:01:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:01:55.411550 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-cf8352b9-d4cf-4d5d-beb7-1794cb8944ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:01:55.492344 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-cf8352b9-d4cf-4d5d-beb7-1794cb8944ae admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085168 Feb 21 01:01:55.493518 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 11/23] 10.222.0.91 () {64 vars in 1332 bytes} [Mon Feb 21 01:01:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:58.015727 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-61126e7c-1649-4835-aea5-f1a97f1c1c1e admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:58.017225 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-61126e7c-1649-4835-aea5-f1a97f1c1c1e admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001906 Feb 21 01:01:58.017724 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 13/24] 10.222.0.91 () {54 vars in 930 bytes} [Mon Feb 21 01:01:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:01:58.086220 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-d7b35be7-917d-4389-9cc6-4ccfef9bca89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "id": "2"}} {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:01:58.293261 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-d7b35be7-917d-4389-9cc6-4ccfef9bca89 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.269419 Feb 21 01:01:58.293937 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 12/25] 10.222.0.91 () {64 vars in 1282 bytes} [Mon Feb 21 01:01:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:01:58.308936 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-8f0a0f06-4e5e-4d1f-9a63-d777d3c356a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:01:58.392670 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-8f0a0f06-4e5e-4d1f-9a63-d777d3c356a5 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090746 Feb 21 01:01:58.393279 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 14/26] 10.222.0.91 () {64 vars in 1332 bytes} [Mon Feb 21 01:01:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:02:00.766270 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-d7b35be7-917d-4389-9cc6-4ccfef9bca89 admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:00.766270 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-d7b35be7-917d-4389-9cc6-4ccfef9bca89 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Feb 21 01:02:00.766270 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 13/27] 10.222.0.91 () {54 vars in 930 bytes} [Mon Feb 21 01:02:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:02:00.828950 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-115059de-1dd9-4102-8939-29e3d2cf61df admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "ram": 4096, "disk": 40, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:02:00.915848 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-115059de-1dd9-4102-8939-29e3d2cf61df admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.144960 Feb 21 01:02:00.916730 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 15/28] 10.222.0.91 () {64 vars in 1282 bytes} [Mon Feb 21 01:02:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:02:00.928433 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-33f68f77-b10a-4dda-970d-a5ca6204feca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:02:01.067184 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-33f68f77-b10a-4dda-970d-a5ca6204feca admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.142413 Feb 21 01:02:01.068031 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 14/29] 10.222.0.91 () {64 vars in 1332 bytes} [Mon Feb 21 01:02:00 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:03.678975 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-115059de-1dd9-4102-8939-29e3d2cf61df admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:03.681581 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-115059de-1dd9-4102-8939-29e3d2cf61df admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002781 Feb 21 01:02:03.683995 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 16/30] 10.222.0.91 () {54 vars in 930 bytes} [Mon Feb 21 01:02:03 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:02:03.755228 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-8b048d17-1841-46e8-97ae-bb07641ba547 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "id": "4", "disk": 80, "swap": 0, "rxtx_factor": 1.0}} {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:02:04.236933 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-8b048d17-1841-46e8-97ae-bb07641ba547 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.548162 Feb 21 01:02:04.240735 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 15/31] 10.222.0.91 () {64 vars in 1282 bytes} [Mon Feb 21 01:02:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:02:04.250813 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-f820b244-696f-469c-a39b-09a1f9ada745 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:02:04.327268 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-f820b244-696f-469c-a39b-09a1f9ada745 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080062 Feb 21 01:02:04.327881 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 17/32] 10.222.0.91 () {64 vars in 1332 bytes} [Mon Feb 21 01:02:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:02:06.739532 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-8b048d17-1841-46e8-97ae-bb07641ba547 admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:06.740640 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-8b048d17-1841-46e8-97ae-bb07641ba547 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Feb 21 01:02:06.741333 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 16/33] 10.222.0.91 () {54 vars in 930 bytes} [Mon Feb 21 01:02:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:02:06.806884 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-74531896-a1e9-4f53-a9ad-77245f4a66d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0, "vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384}} {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:02:06.889867 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-74531896-a1e9-4f53-a9ad-77245f4a66d7 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.141612 Feb 21 01:02:06.891162 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 18/34] 10.222.0.91 () {64 vars in 1282 bytes} [Mon Feb 21 01:02:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:02:06.903350 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-bf5e5172-f517-4aff-9f5a-800c8c1e6272 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:02:06.990584 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-bf5e5172-f517-4aff-9f5a-800c8c1e6272 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091168 Feb 21 01:02:07.007954 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 17/35] 10.222.0.91 () {64 vars in 1332 bytes} [Mon Feb 21 01:02:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:29.248083 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-74531896-a1e9-4f53-a9ad-77245f4a66d7 admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:29.249094 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-74531896-a1e9-4f53-a9ad-77245f4a66d7 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Feb 21 01:02:29.249524 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 19/36] 10.222.0.91 () {54 vars in 930 bytes} [Mon Feb 21 01:02:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:02:29.307861 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-53272df7-d3df-4ef2-ba35-6e27452f8253 admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:29.325454 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-53272df7-d3df-4ef2-ba35-6e27452f8253 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069952 Feb 21 01:02:29.325996 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 18/37] 10.222.0.91 () {60 vars in 1291 bytes} [Mon Feb 21 01:02:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:02:30.721216 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-74531896-a1e9-4f53-a9ad-77245f4a66d7 admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:30.722212 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-74531896-a1e9-4f53-a9ad-77245f4a66d7 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Feb 21 01:02:30.722616 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 20/38] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Feb 21 01:02:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:02:30.922140 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-eac694b9-c784-40fc-a171-bb476031963a admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:30.927632 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.wsgi [None req-eac694b9-c784-40fc-a171-bb476031963a admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 21 01:02:30.928272 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-eac694b9-c784-40fc-a171-bb476031963a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:02:30.929640 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-eac694b9-c784-40fc-a171-bb476031963a admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057648 Feb 21 01:02:30.930145 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 19/39] 10.222.0.91 () {60 vars in 1190 bytes} [Mon Feb 21 01:02:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:30.939604 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-158c2682-1ed1-4b1f-9d32-a7eba68894d1 admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:30.961004 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-158c2682-1ed1-4b1f-9d32-a7eba68894d1 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024846 Feb 21 01:02:30.961561 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 21/40] 10.222.0.91 () {60 vars in 1210 bytes} [Mon Feb 21 01:02:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:02:30.971273 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-6ee98085-730c-4d99-bd4a-1b780485f35e admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:30.992806 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-6ee98085-730c-4d99-bd4a-1b780485f35e admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024946 Feb 21 01:02:30.993368 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 20/41] 10.222.0.91 () {60 vars in 1210 bytes} [Mon Feb 21 01:02:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:02:31.002622 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-350c04ca-fe0c-4414-9e0f-61f7b1552838 admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:31.008898 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.wsgi [None req-350c04ca-fe0c-4414-9e0f-61f7b1552838 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 21 01:02:31.009460 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-350c04ca-fe0c-4414-9e0f-61f7b1552838 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:02:31.010279 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-350c04ca-fe0c-4414-9e0f-61f7b1552838 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011213 Feb 21 01:02:31.010781 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 22/42] 10.222.0.91 () {60 vars in 1190 bytes} [Mon Feb 21 01:02:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:32.295597 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-6ee98085-730c-4d99-bd4a-1b780485f35e admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:32.296630 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-6ee98085-730c-4d99-bd4a-1b780485f35e admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Feb 21 01:02:32.297025 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 21/43] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Feb 21 01:02:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:02:32.492607 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-79c47de3-45a8-44cb-982f-48f71db9778a admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:32.498337 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.wsgi [None req-79c47de3-45a8-44cb-982f-48f71db9778a admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 21 01:02:32.498896 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-79c47de3-45a8-44cb-982f-48f71db9778a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:02:32.499676 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-79c47de3-45a8-44cb-982f-48f71db9778a admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059599 Feb 21 01:02:32.500210 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 23/44] 10.222.0.91 () {60 vars in 1190 bytes} [Mon Feb 21 01:02:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:32.510159 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-4f706b3c-f766-4d8c-aa67-27addf6d0a15 admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:32.525201 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-4f706b3c-f766-4d8c-aa67-27addf6d0a15 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019133 Feb 21 01:02:32.525757 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 22/45] 10.222.0.91 () {60 vars in 1210 bytes} [Mon Feb 21 01:02:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:02:32.535243 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-7c04c8a2-86aa-43f7-a4c3-fdec9fc69f62 admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:32.549703 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-7c04c8a2-86aa-43f7-a4c3-fdec9fc69f62 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017828 Feb 21 01:02:32.550242 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 24/46] 10.222.0.91 () {60 vars in 1210 bytes} [Mon Feb 21 01:02:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:02:32.560266 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-9b593457-a135-4577-afbb-d957108e64aa admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:32.565592 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.wsgi [None req-9b593457-a135-4577-afbb-d957108e64aa admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 21 01:02:32.566159 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-9b593457-a135-4577-afbb-d957108e64aa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:02:32.566942 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-9b593457-a135-4577-afbb-d957108e64aa admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010503 Feb 21 01:02:32.567440 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 23/47] 10.222.0.91 () {60 vars in 1190 bytes} [Mon Feb 21 01:02:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:33.876846 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-7c04c8a2-86aa-43f7-a4c3-fdec9fc69f62 admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:33.877848 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-7c04c8a2-86aa-43f7-a4c3-fdec9fc69f62 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Feb 21 01:02:33.878222 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 25/48] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Feb 21 01:02:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:02:34.068311 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-855ea4f1-6149-45fa-8acb-ebf73cb5a008 admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:34.074429 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.wsgi [None req-855ea4f1-6149-45fa-8acb-ebf73cb5a008 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 21 01:02:34.074996 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-855ea4f1-6149-45fa-8acb-ebf73cb5a008 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:02:34.075788 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-855ea4f1-6149-45fa-8acb-ebf73cb5a008 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058690 Feb 21 01:02:34.076331 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 24/49] 10.222.0.91 () {60 vars in 1193 bytes} [Mon Feb 21 01:02:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:34.086138 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-a513bbd7-d1e4-4af1-b9fd-51afc55f89f8 admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:34.101687 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-a513bbd7-d1e4-4af1-b9fd-51afc55f89f8 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019633 Feb 21 01:02:34.102230 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 26/50] 10.222.0.91 () {60 vars in 1210 bytes} [Mon Feb 21 01:02:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:02:34.113458 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-892039b9-2b0f-400e-9ca7-da01026f8f0c admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:34.127322 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-892039b9-2b0f-400e-9ca7-da01026f8f0c admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018977 Feb 21 01:02:34.127881 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 25/51] 10.222.0.91 () {60 vars in 1210 bytes} [Mon Feb 21 01:02:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:02:34.137728 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-da22ac5f-5b53-40b6-bf82-b4e69d021f2d admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:34.142921 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.wsgi [None req-da22ac5f-5b53-40b6-bf82-b4e69d021f2d admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 21 01:02:34.143466 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-da22ac5f-5b53-40b6-bf82-b4e69d021f2d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:02:34.144253 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-da22ac5f-5b53-40b6-bf82-b4e69d021f2d admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010068 Feb 21 01:02:34.144738 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 27/52] 10.222.0.91 () {60 vars in 1193 bytes} [Mon Feb 21 01:02:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 21 01:02:35.437186 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-892039b9-2b0f-400e-9ca7-da01026f8f0c admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:35.438169 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-892039b9-2b0f-400e-9ca7-da01026f8f0c admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Feb 21 01:02:35.438557 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 26/53] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Feb 21 01:02:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:02:35.638443 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-07c2829a-551a-4f04-80f0-2bafb1b3986f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:02:35.750241 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-07c2829a-551a-4f04-80f0-2bafb1b3986f admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.164456 Feb 21 01:02:35.750819 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 28/54] 10.222.0.91 () {64 vars in 1235 bytes} [Mon Feb 21 01:02:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:02:37.045501 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-892039b9-2b0f-400e-9ca7-da01026f8f0c admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:37.046519 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-892039b9-2b0f-400e-9ca7-da01026f8f0c admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Feb 21 01:02:37.046913 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 27/55] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Feb 21 01:02:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:02:37.255095 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-e101a3b9-712c-4ba6-9fcc-e3e529d2dca9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:02:37.307807 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-e101a3b9-712c-4ba6-9fcc-e3e529d2dca9 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.109609 Feb 21 01:02:37.308389 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 29/56] 10.222.0.91 () {64 vars in 1235 bytes} [Mon Feb 21 01:02:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:02:38.593657 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-892039b9-2b0f-400e-9ca7-da01026f8f0c admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:38.594656 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-892039b9-2b0f-400e-9ca7-da01026f8f0c admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Feb 21 01:02:38.595049 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 28/57] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Feb 21 01:02:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:02:38.793651 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-f205c377-a659-4e07-a5d6-1a3003844acc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:02:38.922010 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-f205c377-a659-4e07-a5d6-1a3003844acc admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.187264 Feb 21 01:02:38.922594 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 30/58] 10.222.0.91 () {64 vars in 1235 bytes} [Mon Feb 21 01:02:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:02:40.206790 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-892039b9-2b0f-400e-9ca7-da01026f8f0c admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:40.207816 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-892039b9-2b0f-400e-9ca7-da01026f8f0c admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Feb 21 01:02:40.208229 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 29/59] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Feb 21 01:02:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:02:40.401841 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-e7d191b4-31e3-489e-b9bd-c3dd6a205b69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:02:40.481544 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-e7d191b4-31e3-489e-b9bd-c3dd6a205b69 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.131933 Feb 21 01:02:40.482095 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 31/60] 10.222.0.91 () {64 vars in 1235 bytes} [Mon Feb 21 01:02:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:02:41.786171 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-892039b9-2b0f-400e-9ca7-da01026f8f0c admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:41.787263 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-892039b9-2b0f-400e-9ca7-da01026f8f0c admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Feb 21 01:02:41.787707 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 30/61] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Feb 21 01:02:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:02:41.978426 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-ba138a22-f49d-4563-88b3-bf7b007206a7 admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:41.998649 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-ba138a22-f49d-4563-88b3-bf7b007206a7 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073776 Feb 21 01:02:41.999119 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 32/62] 10.222.0.91 () {60 vars in 1202 bytes} [Mon Feb 21 01:02:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:33.444029 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-892039b9-2b0f-400e-9ca7-da01026f8f0c admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:33.445015 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-892039b9-2b0f-400e-9ca7-da01026f8f0c admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Feb 21 01:03:33.445406 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 31/63] 10.222.0.91 () {54 vars in 930 bytes} [Mon Feb 21 01:03:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:03:33.501976 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-63dc2996-5cfd-4941-bd1c-a40545688fd2 admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:33.522941 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-63dc2996-5cfd-4941-bd1c-a40545688fd2 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071798 Feb 21 01:03:33.523414 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 33/64] 10.222.0.91 () {60 vars in 1291 bytes} [Mon Feb 21 01:03:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:33.544978 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-b9529382-361c-47c8-8e68-eda42dc6bb2b admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:33.552650 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-b9529382-361c-47c8-8e68-eda42dc6bb2b admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011636 Feb 21 01:03:33.553166 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 32/65] 10.222.0.91 () {60 vars in 1282 bytes} [Mon Feb 21 01:03:33 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:33.564306 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-7c42e369-ed13-47d2-8117-a51d6b48caaf admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:33.572639 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-7c42e369-ed13-47d2-8117-a51d6b48caaf admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011786 Feb 21 01:03:33.573158 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 34/66] 10.222.0.91 () {60 vars in 1285 bytes} [Mon Feb 21 01:03:33 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:33.584644 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-93e2c3f1-1080-427c-be95-808fd4ae02fd admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:33.592195 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-93e2c3f1-1080-427c-be95-808fd4ae02fd admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011699 Feb 21 01:03:33.592706 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 33/67] 10.222.0.91 () {60 vars in 1285 bytes} [Mon Feb 21 01:03:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:33.603947 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-64ed3921-e583-4a06-8123-3f7507fbc7b3 admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:33.611592 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-64ed3921-e583-4a06-8123-3f7507fbc7b3 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011095 Feb 21 01:03:33.612146 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 35/68] 10.222.0.91 () {60 vars in 1282 bytes} [Mon Feb 21 01:03:33 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:23.853063 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-358cbfd0-e428-4f29-91f2-68ff1aff3a91 tempest-verify_tempest_config-732633060 tempest-verify_tempest_config-732633060-project] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:23.855070 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-358cbfd0-e428-4f29-91f2-68ff1aff3a91 tempest-verify_tempest_config-732633060 tempest-verify_tempest_config-732633060-project] 10.222.0.91 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.150858 Feb 21 01:05:23.855619 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 34/69] 10.222.0.91 () {58 vars in 1133 bytes} [Mon Feb 21 01:05:23 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:07:04.410214 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-64ed3921-e583-4a06-8123-3f7507fbc7b3 admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:04.412197 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-64ed3921-e583-4a06-8123-3f7507fbc7b3 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002365 Feb 21 01:07:04.412961 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 36/70] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Feb 21 01:07:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:07:04.786639 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-00276e03-a23b-4cf5-9acb-a7319c8d35b7 admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:04.787869 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:07:04.787869 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: warnings.warn(msg) Feb 21 01:07:04.789508 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_concurrency.lockutils [None req-00276e03-a23b-4cf5-9acb-a7319c8d35b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:04.789951 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_concurrency.lockutils [None req-00276e03-a23b-4cf5-9acb-a7319c8d35b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:04.791411 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_concurrency.lockutils [None req-00276e03-a23b-4cf5-9acb-a7319c8d35b7 admin admin] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:04.791826 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_concurrency.lockutils [None req-00276e03-a23b-4cf5-9acb-a7319c8d35b7 admin admin] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:04.826796 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-00276e03-a23b-4cf5-9acb-a7319c8d35b7 admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.195134 Feb 21 01:07:04.827287 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 35/71] 10.222.0.91 () {60 vars in 1193 bytes} [Mon Feb 21 01:07:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:07:06.197058 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-64ed3921-e583-4a06-8123-3f7507fbc7b3 admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:06.198904 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-64ed3921-e583-4a06-8123-3f7507fbc7b3 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003107 Feb 21 01:07:06.199332 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 37/72] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Feb 21 01:07:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:07:06.398408 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-5a2ba0dc-a209-47b9-8cc0-a74a7b7a6072 admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:06.400166 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:07:06.400166 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: warnings.warn(msg) Feb 21 01:07:06.401759 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_concurrency.lockutils [None req-5a2ba0dc-a209-47b9-8cc0-a74a7b7a6072 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:06.402227 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_concurrency.lockutils [None req-5a2ba0dc-a209-47b9-8cc0-a74a7b7a6072 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:06.403025 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_concurrency.lockutils [None req-5a2ba0dc-a209-47b9-8cc0-a74a7b7a6072 admin admin] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:06.403453 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_concurrency.lockutils [None req-5a2ba0dc-a209-47b9-8cc0-a74a7b7a6072 admin admin] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:06.427571 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-5a2ba0dc-a209-47b9-8cc0-a74a7b7a6072 admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.086112 Feb 21 01:07:06.428430 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 36/73] 10.222.0.91 () {60 vars in 1193 bytes} [Mon Feb 21 01:07:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:07:18.363231 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-64ed3921-e583-4a06-8123-3f7507fbc7b3 admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:18.364368 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-64ed3921-e583-4a06-8123-3f7507fbc7b3 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001657 Feb 21 01:07:18.364784 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 38/74] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Feb 21 01:07:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:07:18.592394 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-5088da08-f06f-4f9b-b001-fe8ebc49310e admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:18.593815 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:07:18.593815 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: warnings.warn(msg) Feb 21 01:07:18.595650 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_concurrency.lockutils [None req-5088da08-f06f-4f9b-b001-fe8ebc49310e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:18.596232 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_concurrency.lockutils [None req-5088da08-f06f-4f9b-b001-fe8ebc49310e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:18.597161 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_concurrency.lockutils [None req-5088da08-f06f-4f9b-b001-fe8ebc49310e admin admin] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:18.597705 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_concurrency.lockutils [None req-5088da08-f06f-4f9b-b001-fe8ebc49310e admin admin] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:18.630423 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-5088da08-f06f-4f9b-b001-fe8ebc49310e admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.102319 Feb 21 01:07:18.631163 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 37/75] 10.222.0.91 () {60 vars in 1193 bytes} [Mon Feb 21 01:07:18 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:07:20.064345 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: DEBUG nova.api.openstack.wsgi [None req-64ed3921-e583-4a06-8123-3f7507fbc7b3 admin admin] Calling method '>' {{(pid=102672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:20.065357 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: INFO nova.api.openstack.requestlog [None req-64ed3921-e583-4a06-8123-3f7507fbc7b3 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Feb 21 01:07:20.065761 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: [pid: 102672|app: 0|req: 39/76] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Feb 21 01:07:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:07:20.284131 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG nova.api.openstack.wsgi [None req-05e786ab-bd4f-4c0e-8f48-4983a4b16d49 admin admin] Calling method '>' {{(pid=102673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:20.285335 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:07:20.285335 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: warnings.warn(msg) Feb 21 01:07:20.286978 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_concurrency.lockutils [None req-05e786ab-bd4f-4c0e-8f48-4983a4b16d49 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:20.287429 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_concurrency.lockutils [None req-05e786ab-bd4f-4c0e-8f48-4983a4b16d49 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:20.288401 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_concurrency.lockutils [None req-05e786ab-bd4f-4c0e-8f48-4983a4b16d49 admin admin] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:20.288835 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: DEBUG oslo_concurrency.lockutils [None req-05e786ab-bd4f-4c0e-8f48-4983a4b16d49 admin admin] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:20.317341 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: INFO nova.api.openstack.requestlog [None req-05e786ab-bd4f-4c0e-8f48-4983a4b16d49 admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.100130 Feb 21 01:07:20.317929 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: [pid: 102673|app: 0|req: 38/77] 10.222.0.91 () {60 vars in 1193 bytes} [Mon Feb 21 01:07:20 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:20.119868 dv-cinder-813227-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 21 01:08:20.120758 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: Mon Feb 21 01:08:20 2022 - graceful shutdown triggered... Feb 21 01:08:20.121261 dv-cinder-813227-6-iscsi devstack@n-api.service[102672]: Gracefully killing worker 1 (pid: 102672)... Feb 21 01:08:20.121657 dv-cinder-813227-6-iscsi devstack@n-api.service[102673]: Gracefully killing worker 2 (pid: 102673)... Feb 21 01:08:21.124111 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: worker 1 buried after 1 seconds Feb 21 01:08:21.124111 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: worker 2 buried after 1 seconds Feb 21 01:08:21.124111 dv-cinder-813227-6-iscsi devstack@n-api.service[102671]: goodbye to uWSGI. Feb 21 01:08:21.123223 dv-cinder-813227-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Feb 21 01:08:21.123789 dv-cinder-813227-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 21 01:08:21.126578 dv-cinder-813227-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 21 01:08:21.146244 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 21 01:08:21.167883 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 21 01:08:21 2022] *** Feb 21 01:08:21.167883 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 21 01:08:21.167883 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 21 01:08:21.167883 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: nodename: dv-cinder-813227-6-iscsi Feb 21 01:08:21.167883 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: machine: x86_64 Feb 21 01:08:21.167883 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: clock source: unix Feb 21 01:08:21.167883 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: pcre jit disabled Feb 21 01:08:21.167883 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: detected number of CPU cores: 4 Feb 21 01:08:21.167883 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: current working directory: / Feb 21 01:08:21.167883 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: detected binary path: /usr/bin/uwsgi-core Feb 21 01:08:21.167883 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: your processes number limit is 47680 Feb 21 01:08:21.167883 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: your memory page size is 4096 bytes Feb 21 01:08:21.167883 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: detected max file descriptor number: 2048 Feb 21 01:08:21.167883 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: lock engine: pthread robust mutexes Feb 21 01:08:21.169118 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: thunder lock: enabled Feb 21 01:08:21.169118 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 21 01:08:21.169118 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 21 01:08:21.216071 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: Python main interpreter initialized at 0x56162f6229c0 Feb 21 01:08:21.216297 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: python threads support enabled Feb 21 01:08:21.216297 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: your server socket listen backlog is limited to 100 connections Feb 21 01:08:21.216297 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: your mercy for graceful operations on workers is 90 seconds Feb 21 01:08:21.216635 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: mapped 403077 bytes (393 KB) for 2 cores Feb 21 01:08:21.216721 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: *** Operational MODE: preforking *** Feb 21 01:08:21.216941 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: *** uWSGI is running in multiple interpreter mode *** Feb 21 01:08:21.216941 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: spawned uWSGI master process (pid: 117125) Feb 21 01:08:21.217161 dv-cinder-813227-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 21 01:08:21.220111 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: spawned uWSGI worker 1 (pid: 117138, cores: 1) Feb 21 01:08:21.220111 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: spawned uWSGI worker 2 (pid: 117139, cores: 1) Feb 21 01:08:21.220111 dv-cinder-813227-6-iscsi devstack@n-api.service[117125]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 21 01:08:23.193538 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:08:23.193538 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: from cryptography.utils import int_from_bytes Feb 21 01:08:23.194197 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:08:23.194197 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: from cryptography.utils import int_from_bytes Feb 21 01:08:23.197014 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:08:23.197014 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: from cryptography.utils import int_from_bytes Feb 21 01:08:23.197904 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:08:23.197904 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: from cryptography.utils import int_from_bytes Feb 21 01:08:25.692029 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 01:08:25.692718 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 01:08:25.692718 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 01:08:25.693260 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 01:08:25.693460 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 01:08:25.693802 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.694123 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.694420 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.694768 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.695034 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.695364 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.695699 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.696123 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.696462 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.696729 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.697053 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.697397 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813227-6-iscsi {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.697712 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.698025 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.698340 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.698665 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.698978 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.699302 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.699613 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.700159 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.701537 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.701537 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.701537 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.702251 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.702251 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.702681 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.702897 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.703118 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.703370 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.703698 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.704177 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813227-6-iscsi {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.704484 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.704775 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.705096 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.705546 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.705863 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.706178 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.706688 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.706923 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.707115 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.707381 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 01:08:25.708034 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.708208 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 01:08:25.708398 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.708555 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 01:08:25.708729 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.708883 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 01:08:25.709070 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.709230 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 01:08:25.709384 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.709536 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.709715 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.709715 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.710055 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.710204 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.710360 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.710513 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.710665 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.710882 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.711039 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.711202 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.711358 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.711510 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.712213 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.712443 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.712596 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.712740 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.712922 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.712922 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.712922 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.713416 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813227-6-iscsi {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.713569 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.714376 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.714529 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.714691 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.714851 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.715034 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.715266 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.715459 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.715975 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.716143 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.716306 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.716499 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.716656 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.716656 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.717111 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.717287 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.717481 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.717641 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.717796 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.717947 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.718134 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.718134 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.718433 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.718619 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.718790 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.718946 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.719100 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.719259 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.719411 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.719598 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.719746 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.719920 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.720072 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.720236 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.720387 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.720541 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813227-6-iscsi {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.720719 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.720893 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.721051 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.721203 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.721354 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.721509 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.721714 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.721879 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.722027 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.722179 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.725646 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.726271 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.726446 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.726635 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.726788 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.726962 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.726962 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.728086 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.728239 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.728400 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.728548 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.728694 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.728848 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.729047 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.729211 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.729358 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.729524 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.729677 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.729823 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.729982 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.730127 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.730280 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.730435 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.730579 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.730723 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.730876 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.731044 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.731198 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.731363 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.731517 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.731674 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.731852 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.732005 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.732160 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.732312 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.732466 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.732624 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.732624 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.733004 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.733164 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.733331 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.733488 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.733655 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.733803 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.733954 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.734099 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.734284 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.734440 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.734597 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.734743 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.734888 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.735033 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.735204 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.736587 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.736759 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.736906 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.737104 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.737283 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.737572 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.737852 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.738103 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.738259 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.738405 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.738557 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.738779 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.738948 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.739117 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.739263 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.739421 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.739574 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.739719 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.739719 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.740039 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.740039 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.740333 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.740478 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.740631 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.740816 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.741079 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.741331 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.741488 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.741488 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.741862 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.742010 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.742155 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.742313 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.742313 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.742597 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.742961 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.742961 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.743565 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.743742 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.743742 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.744066 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.744228 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.744381 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.744537 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.744537 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.744942 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.745167 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.745167 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.745633 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.746101 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.746101 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.746932 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.747079 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.747226 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.747378 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.747522 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.747824 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.748008 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.748153 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.748299 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.748443 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.748669 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.748669 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.748956 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.749170 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.749368 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.749519 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.749672 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.749825 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.749981 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.750137 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.750340 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.750490 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.750649 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.750804 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.750949 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.751104 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.751104 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.751399 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.751544 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.751687 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.751687 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.752010 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.752165 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.752320 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.752478 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.752640 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.752792 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.752792 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.753106 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.753106 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.753390 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.753544 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.753695 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.753846 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.753999 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.754152 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.754303 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.754465 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.754801 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.754963 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.755120 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.755120 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.755420 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.755596 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.755875 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.756286 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.756782 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.757076 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.757235 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.757446 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.757604 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.757604 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.758048 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.758218 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.758373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.758373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.758696 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.758696 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.758977 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.759123 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.759282 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.759282 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.759566 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.759720 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.759933 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.760097 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.760268 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.760422 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.760575 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.760575 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.760867 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.761023 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.761183 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.761329 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.761481 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.761637 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.761782 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.761941 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.762097 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.762268 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.762429 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.762576 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.762741 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.763026 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.763201 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.763359 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.763513 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.763670 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.763824 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.764080 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.764241 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.764387 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:08:25.764563 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.764718 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.765014 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.765209 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.765372 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.765372 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.765817 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.766090 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.766542 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.767066 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.767393 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.767564 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.767734 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.767734 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.768919 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.769090 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.769261 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.769423 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.769576 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.769728 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.769888 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.770055 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.770216 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.770369 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.770521 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.770694 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.770848 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.771014 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.771169 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.771351 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.771645 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.771849 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.772010 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.772178 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.772343 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.772503 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.772656 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.772819 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.773063 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.773229 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.773394 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.773611 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.773777 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.773930 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.774613 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.774613 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.774925 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.775219 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.775379 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.775532 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.775780 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.775978 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.776258 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.776663 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.776852 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.777343 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.777683 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.777852 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.777852 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.778151 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.778303 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.778455 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.778620 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.778815 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.779113 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.779271 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.779424 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.779650 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.779825 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.780017 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.780171 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.780338 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.780499 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.780662 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.780823 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.780976 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.781141 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.781337 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.781507 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.781669 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.781823 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.781983 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.782136 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.782295 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.782448 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.782448 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.782812 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.782974 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.783136 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.783299 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.783466 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.783632 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.783798 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.784019 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.784172 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.784323 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.784490 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.784651 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.784810 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.784972 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.785125 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.785409 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.785583 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.785744 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.785912 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.786066 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.786248 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.787009 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.787510 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.787510 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.788003 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.788165 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.788319 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.788486 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.788652 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.788806 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.788958 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.789131 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.789432 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.789612 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.790426 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.790598 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.790759 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.790913 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.791074 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.791237 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.791398 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.791571 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.791733 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.791929 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.792100 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.792265 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.792431 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.792608 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.792761 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.792920 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.793091 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.793266 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.793496 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.793679 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.793854 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.794008 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.794169 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.794334 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.794500 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.794661 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.794828 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.794989 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.795152 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.795305 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.795598 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.795764 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.795956 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.796122 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.796337 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.796496 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.796887 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.797185 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.797733 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.797913 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.798230 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.798403 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.798559 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.804476 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.804708 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.804912 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.805081 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.805238 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.805429 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.805616 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.805831 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.806001 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.806166 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.806329 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.806482 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.806642 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.806822 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.807007 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.807197 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.807356 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.807530 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.807720 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.807899 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.808071 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.809686 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.809866 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.810024 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.810180 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.810345 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.810508 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.810740 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.810916 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.811079 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.811241 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.811410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.811572 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.811792 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.811984 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.812149 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.812311 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.812819 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.812992 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.812992 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.813307 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.813674 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.813843 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.814007 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.814183 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.814892 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.815059 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.815213 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.815386 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.815386 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.815688 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.815860 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.816031 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.816197 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.816367 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.816520 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.816692 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.816976 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.817140 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.817466 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.817638 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.817913 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.818069 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.818183 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.818306 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.818970 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.819138 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.819263 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.819387 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.819510 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.819625 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.819823 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.825171 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.825390 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.825560 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.825746 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.825914 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.826101 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.826265 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.826438 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.826594 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.826746 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.826899 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.827065 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.827226 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.827387 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.827541 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.827698 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.827897 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.828072 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.828228 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.828388 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.828581 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.829222 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.829400 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.829555 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.829708 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.829860 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.830038 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.830501 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.830676 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.830867 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.831026 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.831178 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.831338 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.831649 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.831825 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.832040 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.832040 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.832333 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.832501 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.832663 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.832825 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.833018 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.833185 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.833460 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.833618 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.833929 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.834134 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.834302 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.834456 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.834608 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.834760 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.834927 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.835089 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.835244 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.835408 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.835577 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.835742 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.835933 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.836151 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.836319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.836481 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.837161 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.837448 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.837618 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.837773 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.838142 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.838142 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.838481 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.838643 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.838808 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.839316 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.839498 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.839653 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.839805 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.840043 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.840207 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.840694 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.840857 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.841018 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.841172 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.841334 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.841489 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.841660 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.841895 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.842081 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.842243 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.842443 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.842617 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.842772 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.842937 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.843090 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.843241 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.843400 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.843553 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.843706 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.843926 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.844232 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.844402 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.844402 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.844696 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.844847 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.845010 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.845163 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.845321 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.845517 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.845676 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.845828 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.845989 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.846150 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.846314 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.846503 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.846662 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.846831 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.846993 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.847146 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.847298 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.847458 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.847612 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.847612 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.847942 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.848093 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.848208 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.853930 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.854147 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.854354 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.854521 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.854714 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.854884 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.855055 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.855213 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.855377 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.855531 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.855683 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.855864 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.856047 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.856235 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.856391 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.856543 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.856707 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.856867 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.857020 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.857188 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.857350 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.857504 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.857656 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.857808 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.857961 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.858141 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.858304 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.858456 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.858617 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.858810 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.858978 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.859146 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.859300 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.859452 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.859653 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.859863 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.860069 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.860235 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.860235 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.860235 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.860707 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.860900 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.860900 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.861223 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.861377 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.861540 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.861734 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.861893 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.862054 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.862207 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.862359 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.862543 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.862698 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.862850 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.863107 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.864979 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.865184 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.865184 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.865483 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.865666 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.865860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.866029 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.866195 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.866360 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.866532 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.866532 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.866875 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.867035 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.867188 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.867188 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.867490 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.868254 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.868424 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.868594 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.868765 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.868765 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.869077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.869077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.869077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.869609 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.869867 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.869867 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.871108 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.871288 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.871459 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.871624 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.871799 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.872051 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.872209 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.872378 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.872530 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.872681 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.872849 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.873044 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.873206 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.873359 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.873558 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.874285 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.874442 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.874603 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.874765 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.874962 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.875133 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.876092 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.876264 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.876429 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.876429 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.876739 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.876893 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.877091 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.877290 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.877420 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.877544 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.877658 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.877779 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.877906 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.878329 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.878463 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.878586 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.879412 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.879556 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.879556 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.879783 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.882119 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.882255 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.882382 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.882533 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.882533 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.882856 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.882980 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.883139 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.883139 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.883139 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.884250 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.884447 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.884447 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.884811 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.885015 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.885283 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.885530 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.885741 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.885908 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.886026 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.886210 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.887416 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.887546 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.887746 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.888272 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.888699 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.888841 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.888966 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.889082 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.889218 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.889362 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.889477 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.889679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.889679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.889679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.890023 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.890146 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.890428 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.890550 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.890550 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.890776 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.890891 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.891004 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.891116 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.891237 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.891416 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.891555 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.891678 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.891791 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.891963 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.892113 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.892240 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.892401 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.892546 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.892673 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.892787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.892787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.893056 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.893202 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.893322 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.893436 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.893648 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.893779 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.893905 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.894082 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.894209 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.894342 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.894480 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.894902 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.895061 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.895328 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.895495 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.895614 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.895735 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.895868 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.896033 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.896176 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.896176 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.896426 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.896544 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.896666 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.896826 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.896826 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.897513 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.897636 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.897775 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.897910 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.897910 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.898441 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.898557 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.898668 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.898779 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.898901 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.899015 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.899787 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.900132 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.900132 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.900132 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.900764 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.901136 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.901241 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.901329 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.901425 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.901595 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.901698 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.901786 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.901880 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.902010 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.902138 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.902241 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.902374 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.902469 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.902469 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.902655 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.902750 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.902866 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.902955 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.903048 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.903134 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.903220 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.903305 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.903405 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.904447 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.904549 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.904653 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.904769 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.904872 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.904967 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.905070 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.905219 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.905319 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.905406 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.905539 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.905688 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.905780 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.905882 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.905969 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.906062 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.906163 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.906348 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.906458 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.906545 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.906618 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.906689 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.906777 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.906852 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.906963 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.906963 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.907133 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.907227 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.907683 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.907789 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.907960 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.908491 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.908607 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.908712 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.908712 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.908899 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.908993 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.909080 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.909189 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.909303 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.909393 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.909479 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.909571 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.909664 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.909750 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.909750 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.909942 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.910029 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.910121 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.910214 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.910309 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.910489 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.910601 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.910696 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.910783 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.910867 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.910867 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.911057 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.911149 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.911149 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.911149 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.911432 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.911578 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.911675 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.911762 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.911872 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.911978 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.911978 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.912145 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.912240 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.912334 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.912514 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.912635 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.912734 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.912734 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.912734 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.912734 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.912734 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.912734 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.913213 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.913318 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.913422 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.913508 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.913593 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.913686 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.913686 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.913853 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.913947 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.914042 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.914136 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.914230 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.914323 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.914323 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.914489 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.914619 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.914619 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.914858 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.915206 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.915374 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.915464 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.915464 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.915464 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.915696 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.915782 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.915782 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.915954 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.916057 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.916160 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.916248 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.916394 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.916470 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.916555 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.916641 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.916744 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.916840 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.916934 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.917024 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.917140 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.917334 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.917442 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.917861 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.918007 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.918100 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.918100 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.918265 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.918417 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.918747 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.918873 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.918964 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.919049 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.919144 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.919231 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.919346 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.919434 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.919526 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.919621 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.919720 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.919807 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.919967 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.920083 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.920172 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.920266 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.920352 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.920436 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.920436 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.920436 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.920436 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.920779 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.920867 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.920951 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.921045 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.921131 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.921224 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.921319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.921413 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.921413 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.921577 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.921708 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.921832 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.921928 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.922015 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.922087 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.922172 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.922256 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.922256 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.922429 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.922515 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.922515 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.922678 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.922764 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.922864 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.922949 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.923043 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.923128 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.923213 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.923297 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.923394 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.923492 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.923579 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.923674 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.923760 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.923871 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.923960 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.924052 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.924139 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.924236 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.924333 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.924483 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.924578 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.924673 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.924760 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.924844 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.924935 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.925035 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.925035 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.925191 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.925191 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.925355 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.925450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.925536 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.925536 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.925673 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.925753 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.925834 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.925915 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.925995 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.926068 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.926149 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.926228 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.926228 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.926374 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.926455 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.926534 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.926534 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.926664 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.926749 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.926830 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.926914 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.926996 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.926996 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.927142 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.927222 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.927305 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.927384 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.927465 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.927543 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.927625 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.927726 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.928132 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.928234 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.928234 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.928401 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.928483 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.928557 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.928704 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.928704 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.928704 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.928704 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.929202 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.929277 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.929355 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.929440 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.929514 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.929584 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.929667 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.929740 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.929740 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.929867 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.929946 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.930028 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.930109 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.930109 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.930246 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.930351 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.930444 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.930554 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.930641 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.930722 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.930722 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.930861 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.930940 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.931026 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.931100 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.931173 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.931244 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.931315 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.931385 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.931472 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.931554 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.931627 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.931705 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.931784 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.933119 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.933232 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.933232 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.933400 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.933496 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.933582 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.933679 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.933767 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.933853 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.933937 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.933937 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.933937 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.933937 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.933937 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.933937 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.933937 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.933937 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.934553 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.934553 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.934553 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.934553 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.934553 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.934553 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.934553 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.934553 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.935215 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.935215 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.935215 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.935215 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.935526 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.935613 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.935699 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.935791 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.935791 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.935986 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.936085 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.936174 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.936259 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.936359 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.936455 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.936543 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.936636 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.936750 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.936849 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.936938 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.937031 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.937188 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.937277 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.937277 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.937453 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.937539 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.937625 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.937719 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.937805 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.937890 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.937998 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.938282 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.938379 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.938480 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.938480 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.938480 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.938480 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.938783 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.938869 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.939120 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.939277 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.939371 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.939371 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.939537 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.939633 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.939633 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.939633 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.939633 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.939633 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.940071 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.940171 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.940171 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.940333 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.940420 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.940504 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.940589 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.940685 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.940760 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.940832 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.940903 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.940974 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.941054 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.941140 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.941214 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.941296 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.941377 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.941456 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.941456 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.941456 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.941456 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.941456 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.941456 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.941456 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.941456 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.942164 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.942276 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.942372 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.942456 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.942531 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.942612 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.942707 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.942802 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.942895 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.942981 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.943079 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.943174 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.943261 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.943352 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.943352 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.943515 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.943611 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.943705 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.943791 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.943946 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.944036 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.944133 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.944234 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.944317 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.944410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.944410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.944566 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.944566 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.944739 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.944826 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.944918 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.945004 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.945096 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.945193 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.945267 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.945340 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.945433 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.945519 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.945519 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.945695 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.945695 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.945859 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.946636 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.946742 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.946829 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.946917 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.947010 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.947106 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.947201 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.947288 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.947383 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.947483 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.947570 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.947655 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.947742 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.947858 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.947961 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.948050 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.948143 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.948272 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.948358 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.948444 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.948518 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.948611 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.948705 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.948800 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.948892 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.948988 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.949071 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.949443 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.949538 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.949625 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.949710 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.949806 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.949894 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.949980 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.950073 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.950167 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.950263 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.950351 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.950436 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.950529 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.950616 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.950709 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.950805 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.950892 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.950985 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.951113 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.951222 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.951311 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.951410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.951410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.951410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.951638 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.951723 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.951808 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.951950 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.952041 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.952133 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.952133 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.952305 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.952405 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.952501 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.952636 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.952731 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.952815 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.952909 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.953009 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.953097 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.953181 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.953267 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.953400 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.953492 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.953591 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.953687 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.953780 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.953874 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.953961 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.954055 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.954148 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.954235 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.954333 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.954421 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.954506 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.954599 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.954686 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.954778 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.954864 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.954864 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.954864 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.955113 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.955207 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.955294 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.955386 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.955481 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.955581 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.955581 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.955754 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.955858 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.955946 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.956043 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.956145 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.956241 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.956328 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.956420 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.956514 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.956600 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.956696 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.956782 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.956867 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.956987 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.957162 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.957304 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.957509 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.957619 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.957888 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.957991 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.958149 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 01:08:25.958251 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.958603 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.958925 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.959373 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.959616 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.960038 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.960365 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.960708 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.961049 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.961366 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.961745 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.963224 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.963611 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.963984 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.964310 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.964705 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.965053 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.965388 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.965749 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.966071 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.966394 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.966787 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.967132 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.967483 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.967973 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.968221 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.968597 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.968936 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.969355 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.969717 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.969985 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.970309 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.970634 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.971003 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.971405 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.971952 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.972325 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.972748 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.973024 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.973366 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.973684 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.974003 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.974322 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.974658 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.974982 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.975316 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.975621 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.975967 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.976296 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.976619 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.977056 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.978331 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.978683 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.978991 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.979432 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.979651 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.980107 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.980451 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.980781 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.981106 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.981622 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.981940 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.982263 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.982429 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_db.sqlalchemy.engines [None req-0be3e1fd-843e-481c-8e7a-5c1ff9b6d73d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117139) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:08:25.982574 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.982899 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.983232 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.983572 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.983939 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.984260 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.984701 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.985027 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.985361 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.985847 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.986174 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.986515 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.986852 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.987175 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.987506 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.987840 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.991006 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.991006 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.991006 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.991006 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.991006 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.991006 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.991006 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.991006 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.991658 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.991658 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.991658 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.991908 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.992081 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.992412 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.992732 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.993096 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.994106 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.994448 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.994776 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.995120 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.995445 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.995772 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.996126 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.996448 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.996777 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.997100 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.997437 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.997775 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.998096 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.998431 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.998789 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.999122 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.999450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:25.999775 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:26.000139 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:26.000465 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:26.000783 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:26.001109 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:26.001429 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:26.001754 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:26.002078 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:26.002405 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:26.002742 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:26.003079 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:26.003416 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:26.003752 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:26.004134 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:26.004458 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:26.004817 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:26.005158 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:26.005483 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:26.006278 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:26.006604 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:08:26.006856 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 01:08:26.031826 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_db.sqlalchemy.engines [None req-6d848f43-6bc7-4200-a194-6e895db8ceff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117138) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:08:26.046762 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.context [None req-0be3e1fd-843e-481c-8e7a-5c1ff9b6d73d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43422379-6863-4985-aea0-21540c83a2e0(cell1) {{(pid=117139) load_cells /opt/stack/nova/nova/context.py:464}} Feb 21 01:08:26.051147 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0be3e1fd-843e-481c-8e7a-5c1ff9b6d73d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:26.052793 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0be3e1fd-843e-481c-8e7a-5c1ff9b6d73d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:26.053634 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0be3e1fd-843e-481c-8e7a-5c1ff9b6d73d None None] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:26.055632 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0be3e1fd-843e-481c-8e7a-5c1ff9b6d73d None None] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:26.067950 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_db.sqlalchemy.engines [None req-0be3e1fd-843e-481c-8e7a-5c1ff9b6d73d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117139) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:08:26.068905 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_db.sqlalchemy.engines [None req-0be3e1fd-843e-481c-8e7a-5c1ff9b6d73d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117139) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:08:26.099894 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.context [None req-6d848f43-6bc7-4200-a194-6e895db8ceff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43422379-6863-4985-aea0-21540c83a2e0(cell1) {{(pid=117138) load_cells /opt/stack/nova/nova/context.py:464}} Feb 21 01:08:26.104379 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6d848f43-6bc7-4200-a194-6e895db8ceff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:26.105982 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6d848f43-6bc7-4200-a194-6e895db8ceff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:26.106739 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6d848f43-6bc7-4200-a194-6e895db8ceff None None] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:26.109161 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6d848f43-6bc7-4200-a194-6e895db8ceff None None] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:26.120794 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_db.sqlalchemy.engines [None req-6d848f43-6bc7-4200-a194-6e895db8ceff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117138) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:08:26.121804 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_db.sqlalchemy.engines [None req-6d848f43-6bc7-4200-a194-6e895db8ceff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117138) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:08:26.229035 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_db.sqlalchemy.engines [None req-0be3e1fd-843e-481c-8e7a-5c1ff9b6d73d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117139) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:08:26.287568 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_db.sqlalchemy.engines [None req-6d848f43-6bc7-4200-a194-6e895db8ceff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117138) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:08:26.575592 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: WARNING keystonemiddleware.auth_token [None req-0be3e1fd-843e-481c-8e7a-5c1ff9b6d73d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 01:08:26.582645 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: WARNING keystonemiddleware.auth_token [None req-0be3e1fd-843e-481c-8e7a-5c1ff9b6d73d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 01:08:26.621976 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: WARNING keystonemiddleware.auth_token [None req-6d848f43-6bc7-4200-a194-6e895db8ceff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 01:08:26.629215 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: WARNING keystonemiddleware.auth_token [None req-6d848f43-6bc7-4200-a194-6e895db8ceff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 01:08:26.942392 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: WARNING keystonemiddleware.auth_token [None req-0be3e1fd-843e-481c-8e7a-5c1ff9b6d73d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 01:08:26.949613 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: WARNING keystonemiddleware.auth_token [None req-0be3e1fd-843e-481c-8e7a-5c1ff9b6d73d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 01:08:26.955224 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56162f6229c0 pid: 117139 (default app) Feb 21 01:08:26.987294 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: WARNING keystonemiddleware.auth_token [None req-6d848f43-6bc7-4200-a194-6e895db8ceff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 01:08:26.992624 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: WARNING keystonemiddleware.auth_token [None req-6d848f43-6bc7-4200-a194-6e895db8ceff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 01:08:26.999034 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56162f6229c0 pid: 117138 (default app) Feb 21 01:09:06.756188 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f6a1e19e-b549-495b-b68c-b5f7e0f93049 tempest-VolumesGetTestJSON-1799310214 tempest-VolumesGetTestJSON-1799310214-project] Action: 'create', calling method: .version_select at 0x7f4ad06980d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-330879644", "metadata": {"Type": "work"}}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:08.092139 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6f6c4a47-1660-421b-b144-812008ddc598 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-12377890", "imageRef": "9b96cc67-20b9-414f-8afb-039ff7953adc", "flavorRef": "452", "networks": [{"uuid": "8d88ddc9-10c8-4356-a5fc-74ca444968a9"}]}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:08.444635 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.network.neutron [None req-6f6c4a47-1660-421b-b144-812008ddc598 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] validate_networks() for [('8d88ddc9-10c8-4356-a5fc-74ca444968a9', None, None, None, None, None)] {{(pid=117138) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:09:08.725599 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f6a1e19e-b549-495b-b68c-b5f7e0f93049 tempest-VolumesGetTestJSON-1799310214 tempest-VolumesGetTestJSON-1799310214-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.007281 Feb 21 01:09:08.726379 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1/1] 10.222.0.91 () {60 vars in 1155 bytes} [Mon Feb 21 01:09:05 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3010 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 21 01:09:08.812861 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-62001d44-c3e6-4cdd-a557-27dc7cdc7387 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-312550893", "imageRef": "9b96cc67-20b9-414f-8afb-039ff7953adc", "flavorRef": "452", "networks": [{"uuid": "f083536d-4146-4f8c-b181-2d07e06528e7"}]}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:09.002222 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.network.neutron [None req-62001d44-c3e6-4cdd-a557-27dc7cdc7387 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] validate_networks() for [('f083536d-4146-4f8c-b181-2d07e06528e7', None, None, None, None, None)] {{(pid=117139) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:09:09.690650 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-6f6c4a47-1660-421b-b144-812008ddc598 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Flavor limits 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:09:09.691206 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-6f6c4a47-1660-421b-b144-812008ddc598 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Image limits 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:09:09.691516 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-6f6c4a47-1660-421b-b144-812008ddc598 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Flavor pref 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:09:09.691942 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-6f6c4a47-1660-421b-b144-812008ddc598 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Image pref 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:09:09.692676 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-6f6c4a47-1660-421b-b144-812008ddc598 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:09:09.707810 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6f6c4a47-1660-421b-b144-812008ddc598 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:09.708535 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6f6c4a47-1660-421b-b144-812008ddc598 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:09.710046 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6f6c4a47-1660-421b-b144-812008ddc598 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:09.710623 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6f6c4a47-1660-421b-b144-812008ddc598 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:09.757563 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-6f6c4a47-1660-421b-b144-812008ddc598 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Getting quotas for project 24c1bf236b2f4eb1bffab124b7392ca5. Resources: {'ram', 'cores', 'instances'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:09:09.764364 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-6f6c4a47-1660-421b-b144-812008ddc598 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Getting quotas for user 70516383f3b14d5283462803cac26d8b and project 24c1bf236b2f4eb1bffab124b7392ca5. Resources: {'ram', 'cores', 'instances'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:09:09.786250 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6f6c4a47-1660-421b-b144-812008ddc598 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Going to run 1 instances... {{(pid=117138) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:09:09.790172 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6f6c4a47-1660-421b-b144-812008ddc598 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b96cc67-20b9-414f-8afb-039ff7953adc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117138) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:09:09.980320 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6f6c4a47-1660-421b-b144-812008ddc598 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.246387 Feb 21 01:09:09.984827 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1/2] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Feb 21 01:09:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 21 01:09:09.988455 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2a2954f0-b458-4f1c-a62b-43e1a00c1807 tempest-VolumesGetTestJSON-1799310214 tempest-VolumesGetTestJSON-1799310214-project] Calling method '.version_select at 0x7f4acfc82a60>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:10.128832 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2a2954f0-b458-4f1c-a62b-43e1a00c1807 tempest-VolumesGetTestJSON-1799310214 tempest-VolumesGetTestJSON-1799310214-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/5013117d-ebb9-48e5-8f57-1a254423afb8" status: 200 len: 353 microversion: 2.1 time: 0.146633 Feb 21 01:09:10.129733 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 2/3] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Feb 21 01:09:09 2022] GET /compute/v2.1/os-volumes/5013117d-ebb9-48e5-8f57-1a254423afb8 => generated 353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:09:10.136539 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8af8b367-aca8-486f-b5f0-b9c6aafb7c66 tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] Calling method '.version_select at 0x7f4acfc82e50>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:10.274595 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8af8b367-aca8-486f-b5f0-b9c6aafb7c66 tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/bbe82daf-864a-4a3e-9cd9-51302020e3b9" status: 200 len: 351 microversion: 2.1 time: 0.144139 Feb 21 01:09:10.275449 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 3/4] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Feb 21 01:09:10 2022] GET /compute/v2.1/os-volumes/bbe82daf-864a-4a3e-9cd9-51302020e3b9 => generated 351 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:09:10.280450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fc8c9334-853d-4287-86d0-03c1ec5b664b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:10.283945 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fc8c9334-853d-4287-86d0-03c1ec5b664b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:10.318248 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-62001d44-c3e6-4cdd-a557-27dc7cdc7387 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Flavor limits 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:09:10.320240 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-62001d44-c3e6-4cdd-a557-27dc7cdc7387 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Image limits 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:09:10.320886 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-62001d44-c3e6-4cdd-a557-27dc7cdc7387 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Flavor pref 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:09:10.326462 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-62001d44-c3e6-4cdd-a557-27dc7cdc7387 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Image pref 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:09:10.326462 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-62001d44-c3e6-4cdd-a557-27dc7cdc7387 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:09:10.352482 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-62001d44-c3e6-4cdd-a557-27dc7cdc7387 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:10.353468 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-62001d44-c3e6-4cdd-a557-27dc7cdc7387 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:10.356726 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-62001d44-c3e6-4cdd-a557-27dc7cdc7387 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:10.357389 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-62001d44-c3e6-4cdd-a557-27dc7cdc7387 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:10.477028 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.quota [None req-62001d44-c3e6-4cdd-a557-27dc7cdc7387 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Getting quotas for project 784d5ee9775c49d6a4127a0bea10323c. Resources: {'ram', 'cores', 'instances'} {{(pid=117139) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:09:10.504145 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.quota [None req-62001d44-c3e6-4cdd-a557-27dc7cdc7387 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Getting quotas for user 94dda2419e2242cc8102a08ad4c8c0b4 and project 784d5ee9775c49d6a4127a0bea10323c. Resources: {'ram', 'cores', 'instances'} {{(pid=117139) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:09:10.513816 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fc8c9334-853d-4287-86d0-03c1ec5b664b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:10.530083 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-62001d44-c3e6-4cdd-a557-27dc7cdc7387 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Going to run 1 instances... {{(pid=117139) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:09:10.535272 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-62001d44-c3e6-4cdd-a557-27dc7cdc7387 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b96cc67-20b9-414f-8afb-039ff7953adc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117139) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:09:10.536753 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fc8c9334-853d-4287-86d0-03c1ec5b664b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1216 microversion: 2.1 time: 0.260038 Feb 21 01:09:10.557244 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 4/5] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:10 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1216 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:10.562346 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c4fcd538-589b-4dd7-bddd-b659b9917ad3 tempest-VolumesGetTestJSON-1799310214 tempest-VolumesGetTestJSON-1799310214-project] Calling method '.version_select at 0x7f4acf401ee0>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:10.779222 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-62001d44-c3e6-4cdd-a557-27dc7cdc7387 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.051269 Feb 21 01:09:10.785570 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 2/6] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Feb 21 01:09:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:09:10.797817 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f57f401a-fd40-4c67-b959-fe2e13845b65 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:10.798447 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f57f401a-fd40-4c67-b959-fe2e13845b65 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:11.013139 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c4fcd538-589b-4dd7-bddd-b659b9917ad3 tempest-VolumesGetTestJSON-1799310214 tempest-VolumesGetTestJSON-1799310214-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/5013117d-ebb9-48e5-8f57-1a254423afb8" status: 200 len: 353 microversion: 2.1 time: 0.454223 Feb 21 01:09:11.015254 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 5/7] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Feb 21 01:09:10 2022] GET /compute/v2.1/os-volumes/5013117d-ebb9-48e5-8f57-1a254423afb8 => generated 353 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:09:11.026949 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-bf32d463-3966-4943-85d2-7d9cd2461184 tempest-VolumesGetTestJSON-1799310214 tempest-VolumesGetTestJSON-1799310214-project] Calling method '.version_select at 0x7f4acf418f70>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:11.149757 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f57f401a-fd40-4c67-b959-fe2e13845b65 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:11.165090 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f57f401a-fd40-4c67-b959-fe2e13845b65 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1214 microversion: 2.1 time: 0.373606 Feb 21 01:09:11.176020 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 3/8] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:10 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1214 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:11.403513 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-bf32d463-3966-4943-85d2-7d9cd2461184 tempest-VolumesGetTestJSON-1799310214 tempest-VolumesGetTestJSON-1799310214-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/5013117d-ebb9-48e5-8f57-1a254423afb8" status: 202 len: 0 microversion: 2.1 time: 0.377976 Feb 21 01:09:11.403513 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 6/9] 10.222.0.91 () {58 vars in 1247 bytes} [Mon Feb 21 01:09:11 2022] DELETE /compute/v2.1/os-volumes/5013117d-ebb9-48e5-8f57-1a254423afb8 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:09:11.416509 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5dbc99bf-c5d1-4344-9f7c-c1b61e9677ea tempest-VolumesGetTestJSON-1799310214 tempest-VolumesGetTestJSON-1799310214-project] Calling method '.version_select at 0x7f4acfc16c10>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:11.520819 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5dbc99bf-c5d1-4344-9f7c-c1b61e9677ea tempest-VolumesGetTestJSON-1799310214 tempest-VolumesGetTestJSON-1799310214-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/5013117d-ebb9-48e5-8f57-1a254423afb8" status: 200 len: 352 microversion: 2.1 time: 0.107966 Feb 21 01:09:11.523437 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 4/10] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Feb 21 01:09:11 2022] GET /compute/v2.1/os-volumes/5013117d-ebb9-48e5-8f57-1a254423afb8 => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:09:11.554747 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f3d84721-78d9-47dc-b4ac-4978523946ab tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:11.555382 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f3d84721-78d9-47dc-b4ac-4978523946ab tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:11.735059 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f3d84721-78d9-47dc-b4ac-4978523946ab tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:11.743122 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f3d84721-78d9-47dc-b4ac-4978523946ab tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1216 microversion: 2.1 time: 0.192494 Feb 21 01:09:11.745023 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 7/11] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:11 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1216 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:12.184797 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b1d68982-8808-43b9-84f8-2c308ba23da7 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:12.185447 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b1d68982-8808-43b9-84f8-2c308ba23da7 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:12.438334 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b1d68982-8808-43b9-84f8-2c308ba23da7 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:12.448765 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b1d68982-8808-43b9-84f8-2c308ba23da7 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1214 microversion: 2.1 time: 0.269102 Feb 21 01:09:12.449436 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 5/12] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:12 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1214 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:12.536045 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6aaea14e-c16b-42b8-9aca-18b356ea4646 tempest-VolumesGetTestJSON-1799310214 tempest-VolumesGetTestJSON-1799310214-project] Calling method '.version_select at 0x7f4acf3ffc10>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:12.977275 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4fb166cf-898c-48ba-9dce-765f5f2ae152 tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] Calling method '.version_select at 0x7f4acf3b8c10>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:12.981781 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.wsgi [None req-6aaea14e-c16b-42b8-9aca-18b356ea4646 tempest-VolumesGetTestJSON-1799310214 tempest-VolumesGetTestJSON-1799310214-project] HTTP exception thrown: Volume 5013117d-ebb9-48e5-8f57-1a254423afb8 could not be found. Feb 21 01:09:12.981781 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6aaea14e-c16b-42b8-9aca-18b356ea4646 tempest-VolumesGetTestJSON-1799310214 tempest-VolumesGetTestJSON-1799310214-project] Returning 404 to user: Volume 5013117d-ebb9-48e5-8f57-1a254423afb8 could not be found. {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:09:12.981781 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6aaea14e-c16b-42b8-9aca-18b356ea4646 tempest-VolumesGetTestJSON-1799310214 tempest-VolumesGetTestJSON-1799310214-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/5013117d-ebb9-48e5-8f57-1a254423afb8" status: 404 len: 109 microversion: 2.1 time: 0.119916 Feb 21 01:09:12.981781 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 8/13] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Feb 21 01:09:12 2022] GET /compute/v2.1/os-volumes/5013117d-ebb9-48e5-8f57-1a254423afb8 => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:09:12.983728 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4fb166cf-898c-48ba-9dce-765f5f2ae152 tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/fd9877fe-2df7-4339-879b-b1ba76857084" status: 200 len: 349 microversion: 2.1 time: 0.095250 Feb 21 01:09:12.983728 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 6/14] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Feb 21 01:09:12 2022] GET /compute/v2.1/os-volumes/fd9877fe-2df7-4339-879b-b1ba76857084 => generated 349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:09:12.988538 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-917e2d2b-2c35-445c-b667-3d69458f5183 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:12.988538 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-917e2d2b-2c35-445c-b667-3d69458f5183 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:12.988538 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-917e2d2b-2c35-445c-b667-3d69458f5183 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:12.988538 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-917e2d2b-2c35-445c-b667-3d69458f5183 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1216 microversion: 2.1 time: 0.086653 Feb 21 01:09:12.992261 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 9/15] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:12 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1216 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:13.466203 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-09296d81-4d95-4ad1-8af8-ec49974665cd tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:13.466817 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-09296d81-4d95-4ad1-8af8-ec49974665cd tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:13.474531 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-09296d81-4d95-4ad1-8af8-ec49974665cd tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:13.480626 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-09296d81-4d95-4ad1-8af8-ec49974665cd tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:13.503635 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-09296d81-4d95-4ad1-8af8-ec49974665cd tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:13.504629 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-09296d81-4d95-4ad1-8af8-ec49974665cd tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:13.850860 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-09296d81-4d95-4ad1-8af8-ec49974665cd tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:13.863445 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-09296d81-4d95-4ad1-8af8-ec49974665cd tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1210 microversion: 2.1 time: 0.400848 Feb 21 01:09:13.875010 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 7/16] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:13 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1210 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:13.889487 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-aa3824ce-0152-4ea5-87d3-09e79a0f4972 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:13.890243 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-aa3824ce-0152-4ea5-87d3-09e79a0f4972 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:13.905199 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aa3824ce-0152-4ea5-87d3-09e79a0f4972 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:13.905697 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aa3824ce-0152-4ea5-87d3-09e79a0f4972 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:13.906438 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aa3824ce-0152-4ea5-87d3-09e79a0f4972 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:13.906870 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aa3824ce-0152-4ea5-87d3-09e79a0f4972 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:13.975037 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-76b68668-c1e9-4804-8da9-c1ade86c2fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-309965793", "imageRef": "9b96cc67-20b9-414f-8afb-039ff7953adc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:14.026610 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-aa3824ce-0152-4ea5-87d3-09e79a0f4972 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:14.038817 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-aa3824ce-0152-4ea5-87d3-09e79a0f4972 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1212 microversion: 2.1 time: 0.156918 Feb 21 01:09:14.040022 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 8/17] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:13 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1212 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:14.051798 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.network.neutron [None req-76b68668-c1e9-4804-8da9-c1ade86c2fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] validate_networks() for [('507705df-01e7-4a80-bc5b-3439c16043cf', None, None, None, None, None)] {{(pid=117138) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:09:14.836899 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-76b68668-c1e9-4804-8da9-c1ade86c2fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Flavor limits 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:09:14.837547 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-76b68668-c1e9-4804-8da9-c1ade86c2fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Image limits 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:09:14.838341 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-76b68668-c1e9-4804-8da9-c1ade86c2fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Flavor pref 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:09:14.839262 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-76b68668-c1e9-4804-8da9-c1ade86c2fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Image pref 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:09:14.841042 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-76b68668-c1e9-4804-8da9-c1ade86c2fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:09:14.880866 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b54ac18a-8a42-4a3b-b248-b78760d2b60d tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:14.882107 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b54ac18a-8a42-4a3b-b248-b78760d2b60d tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:14.892293 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-76b68668-c1e9-4804-8da9-c1ade86c2fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:14.892810 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-76b68668-c1e9-4804-8da9-c1ade86c2fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:14.893807 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-76b68668-c1e9-4804-8da9-c1ade86c2fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:14.894629 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b54ac18a-8a42-4a3b-b248-b78760d2b60d tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:14.895239 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b54ac18a-8a42-4a3b-b248-b78760d2b60d tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:14.897097 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b54ac18a-8a42-4a3b-b248-b78760d2b60d tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:14.898191 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b54ac18a-8a42-4a3b-b248-b78760d2b60d tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:14.905454 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-76b68668-c1e9-4804-8da9-c1ade86c2fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:14.955105 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-76b68668-c1e9-4804-8da9-c1ade86c2fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Getting quotas for project a5cb0164f98741baba94fcc1b7709e7e. Resources: {'ram', 'cores', 'instances'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:09:14.965784 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-76b68668-c1e9-4804-8da9-c1ade86c2fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Getting quotas for user 8287f43e83034c0a80ee051456d502c6 and project a5cb0164f98741baba94fcc1b7709e7e. Resources: {'ram', 'cores', 'instances'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:09:14.987267 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-76b68668-c1e9-4804-8da9-c1ade86c2fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Going to run 1 instances... {{(pid=117138) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:09:15.001800 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-76b68668-c1e9-4804-8da9-c1ade86c2fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b96cc67-20b9-414f-8afb-039ff7953adc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117138) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:09:15.111641 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b54ac18a-8a42-4a3b-b248-b78760d2b60d tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:15.135796 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b54ac18a-8a42-4a3b-b248-b78760d2b60d tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1274 microversion: 2.1 time: 0.258661 Feb 21 01:09:15.139998 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 9/18] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:14 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1274 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:09:15.156790 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b2bba941-294e-4c9c-a712-1e957708a99c tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] Calling method '.version_select at 0x7f4acf3a7310>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:15.195345 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-76b68668-c1e9-4804-8da9-c1ade86c2fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.542258 Feb 21 01:09:15.216129 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 10/19] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Feb 21 01:09:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:09:15.249674 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9a1654a7-a5c8-4239-95df-c5fd92fe1379 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:15.250217 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9a1654a7-a5c8-4239-95df-c5fd92fe1379 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:15.283541 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9a1654a7-a5c8-4239-95df-c5fd92fe1379 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:15.285457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9a1654a7-a5c8-4239-95df-c5fd92fe1379 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:15.293575 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9a1654a7-a5c8-4239-95df-c5fd92fe1379 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:15.296379 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9a1654a7-a5c8-4239-95df-c5fd92fe1379 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:15.314062 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b2bba941-294e-4c9c-a712-1e957708a99c tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/859c4d70-d26f-441d-9132-fff19dde5018" status: 200 len: 350 microversion: 2.1 time: 0.172460 Feb 21 01:09:15.315066 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 10/20] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Feb 21 01:09:15 2022] GET /compute/v2.1/os-volumes/859c4d70-d26f-441d-9132-fff19dde5018 => generated 350 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:09:15.321456 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0c45d805-b5a9-4cc6-89dd-3ad11cb9d1bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:15.322411 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0c45d805-b5a9-4cc6-89dd-3ad11cb9d1bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:15.601580 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0c45d805-b5a9-4cc6-89dd-3ad11cb9d1bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:15.615875 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0c45d805-b5a9-4cc6-89dd-3ad11cb9d1bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1221 microversion: 2.1 time: 0.293431 Feb 21 01:09:15.623501 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 11/21] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:15 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1221 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:15.630587 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6ed3f5d6-3d38-47d4-8566-d58148b444b1 tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] Calling method '.version_select at 0x7f4acf302430>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:15.697394 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9a1654a7-a5c8-4239-95df-c5fd92fe1379 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:15.752211 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9a1654a7-a5c8-4239-95df-c5fd92fe1379 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1276 microversion: 2.1 time: 0.495972 Feb 21 01:09:15.766377 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 11/22] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:15 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1276 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:15.891290 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6ed3f5d6-3d38-47d4-8566-d58148b444b1 tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] 10.222.0.91 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.266567 Feb 21 01:09:15.900651 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 12/23] 10.222.0.91 () {58 vars in 1133 bytes} [Mon Feb 21 01:09:15 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:15.919907 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f1ae4b58-53f2-4884-af8c-74c938489499 tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] Calling method '.version_select at 0x7f4acf398700>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:16.097463 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f1ae4b58-53f2-4884-af8c-74c938489499 tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] 10.222.0.91 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.192204 Feb 21 01:09:16.106987 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 12/24] 10.222.0.91 () {58 vars in 1148 bytes} [Mon Feb 21 01:09:15 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:09:16.114465 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-192a3698-0e77-4e7f-a23b-0a2e3ded4ab0 tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] Calling method '.version_select at 0x7f4acf3afa60>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:16.160222 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fd8a6458-650a-4ac5-9d3d-934571443345 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:16.160939 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fd8a6458-650a-4ac5-9d3d-934571443345 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:16.171672 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fd8a6458-650a-4ac5-9d3d-934571443345 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:16.172207 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fd8a6458-650a-4ac5-9d3d-934571443345 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:16.173029 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fd8a6458-650a-4ac5-9d3d-934571443345 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:16.174164 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fd8a6458-650a-4ac5-9d3d-934571443345 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:16.265984 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fd8a6458-650a-4ac5-9d3d-934571443345 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:16.294444 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fd8a6458-650a-4ac5-9d3d-934571443345 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1272 microversion: 2.1 time: 0.138336 Feb 21 01:09:16.295309 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 13/25] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:16 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1272 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:16.305391 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-78dfc1b9-816a-4d6c-a89d-976e35a5e42e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-107768154", "imageRef": "9b96cc67-20b9-414f-8afb-039ff7953adc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:16.447542 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-192a3698-0e77-4e7f-a23b-0a2e3ded4ab0 tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] 10.222.0.91 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.338165 Feb 21 01:09:16.457589 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 13/26] 10.222.0.91 () {58 vars in 1133 bytes} [Mon Feb 21 01:09:16 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:16.467219 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8c8a780c-2a72-4fd3-93b7-d2df6a79de4b tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] Calling method '.version_select at 0x7f4acf2fe700>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:16.478208 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.network.neutron [None req-78dfc1b9-816a-4d6c-a89d-976e35a5e42e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] validate_networks() for [('507705df-01e7-4a80-bc5b-3439c16043cf', None, None, None, None, None)] {{(pid=117138) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:09:16.595164 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8c8a780c-2a72-4fd3-93b7-d2df6a79de4b tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] 10.222.0.91 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.133132 Feb 21 01:09:16.596186 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 14/27] 10.222.0.91 () {58 vars in 1166 bytes} [Mon Feb 21 01:09:16 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:09:16.615231 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0e37f809-1992-484b-ab0f-06a89a231ef7 tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] Calling method '.version_select at 0x7f4acf3a7430>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:16.773749 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0e37f809-1992-484b-ab0f-06a89a231ef7 tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.164006 Feb 21 01:09:16.783729 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 15/28] 10.222.0.91 () {58 vars in 1169 bytes} [Mon Feb 21 01:09:16 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:09:16.790510 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e3bf1b67-e29d-485d-b7f6-136526231af1 tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] Calling method '.version_select at 0x7f4acf302310>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:17.051613 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e3bf1b67-e29d-485d-b7f6-136526231af1 tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.265962 Feb 21 01:09:17.057684 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 16/29] 10.222.0.91 () {58 vars in 1154 bytes} [Mon Feb 21 01:09:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:17.069354 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4a72819c-e669-4670-b99f-554220c778be tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:17.070111 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4a72819c-e669-4670-b99f-554220c778be tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:17.084055 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4a72819c-e669-4670-b99f-554220c778be tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:17.084754 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4a72819c-e669-4670-b99f-554220c778be tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:17.088743 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4a72819c-e669-4670-b99f-554220c778be tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:17.089587 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4a72819c-e669-4670-b99f-554220c778be tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:17.313543 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4a72819c-e669-4670-b99f-554220c778be tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:17.322326 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4a72819c-e669-4670-b99f-554220c778be tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1274 microversion: 2.1 time: 0.263614 Feb 21 01:09:17.337616 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 17/30] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:17 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1274 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:17.341504 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-804c8c53-d9eb-4c17-b0a7-89bbf608cce1 tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] Calling method '.version_select at 0x7f4acf2fe670>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:17.594674 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-804c8c53-d9eb-4c17-b0a7-89bbf608cce1 tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.258439 Feb 21 01:09:17.595614 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 18/31] 10.222.0.91 () {58 vars in 1187 bytes} [Mon Feb 21 01:09:17 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:09:17.611459 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e3eb03f1-a735-4d72-806d-782940ecd17d tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:17.612395 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e3eb03f1-a735-4d72-806d-782940ecd17d tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:17.621346 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e3eb03f1-a735-4d72-806d-782940ecd17d tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:17.625067 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e3eb03f1-a735-4d72-806d-782940ecd17d tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:17.628202 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e3eb03f1-a735-4d72-806d-782940ecd17d tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:17.630177 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e3eb03f1-a735-4d72-806d-782940ecd17d tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:18.214722 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e3eb03f1-a735-4d72-806d-782940ecd17d tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:18.226131 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e3eb03f1-a735-4d72-806d-782940ecd17d tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1314 microversion: 2.1 time: 0.626862 Feb 21 01:09:18.228141 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 19/32] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:17 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:18.248097 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-471d10d2-14b5-41d1-aecf-283e78f82226 tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] Calling method '.version_select at 0x7f4acf2fe160>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:18.440410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-471d10d2-14b5-41d1-aecf-283e78f82226 tempest-VolumesTestJSON-590782533 tempest-VolumesTestJSON-590782533-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.210786 Feb 21 01:09:18.441333 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 20/33] 10.222.0.91 () {58 vars in 1154 bytes} [Mon Feb 21 01:09:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:18.447651 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-27b84eb5-7372-443a-ae69-a5fde45de076 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:18.448439 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-27b84eb5-7372-443a-ae69-a5fde45de076 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:18.465840 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-27b84eb5-7372-443a-ae69-a5fde45de076 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:18.467225 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-27b84eb5-7372-443a-ae69-a5fde45de076 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:18.468079 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-27b84eb5-7372-443a-ae69-a5fde45de076 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:18.471729 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-27b84eb5-7372-443a-ae69-a5fde45de076 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:18.656747 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-27b84eb5-7372-443a-ae69-a5fde45de076 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:18.676815 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-27b84eb5-7372-443a-ae69-a5fde45de076 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1274 microversion: 2.1 time: 0.229011 Feb 21 01:09:18.692045 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 21/34] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:18 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1274 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:19.455791 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8cfa23b3-40fc-44a7-bb38-39a0b7581d76 tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] Action: 'create', calling method: .version_select at 0x7f4acf3a7670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1516020097", "metadata": {"Type": "work"}}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:19.458205 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8cfa23b3-40fc-44a7-bb38-39a0b7581d76 tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:09:19.460050 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8cfa23b3-40fc-44a7-bb38-39a0b7581d76 tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.334599 Feb 21 01:09:19.467203 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 22/35] 10.222.0.91 () {60 vars in 1155 bytes} [Mon Feb 21 01:09:19 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 342 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:09:19.484884 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-daf00f1c-f56c-4621-9069-4ba1da501329 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:19.488152 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-daf00f1c-f56c-4621-9069-4ba1da501329 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:19.502983 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-78dfc1b9-816a-4d6c-a89d-976e35a5e42e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Flavor limits 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:09:19.504140 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-78dfc1b9-816a-4d6c-a89d-976e35a5e42e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Image limits 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:09:19.504838 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-78dfc1b9-816a-4d6c-a89d-976e35a5e42e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Flavor pref 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:09:19.508090 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-78dfc1b9-816a-4d6c-a89d-976e35a5e42e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Image pref 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:09:19.508780 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-78dfc1b9-816a-4d6c-a89d-976e35a5e42e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:09:19.523256 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-daf00f1c-f56c-4621-9069-4ba1da501329 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:19.525316 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-daf00f1c-f56c-4621-9069-4ba1da501329 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:19.526195 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-78dfc1b9-816a-4d6c-a89d-976e35a5e42e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:19.527950 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-78dfc1b9-816a-4d6c-a89d-976e35a5e42e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:19.531133 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-78dfc1b9-816a-4d6c-a89d-976e35a5e42e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:19.533271 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-78dfc1b9-816a-4d6c-a89d-976e35a5e42e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:19.540016 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-daf00f1c-f56c-4621-9069-4ba1da501329 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:19.542857 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-daf00f1c-f56c-4621-9069-4ba1da501329 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:19.588095 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-78dfc1b9-816a-4d6c-a89d-976e35a5e42e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Getting quotas for project a5cb0164f98741baba94fcc1b7709e7e. Resources: {'ram', 'cores', 'instances'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:09:19.599048 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-78dfc1b9-816a-4d6c-a89d-976e35a5e42e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Getting quotas for user 8287f43e83034c0a80ee051456d502c6 and project a5cb0164f98741baba94fcc1b7709e7e. Resources: {'ram', 'cores', 'instances'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:09:19.624404 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-78dfc1b9-816a-4d6c-a89d-976e35a5e42e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Going to run 1 instances... {{(pid=117138) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:09:19.627334 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-78dfc1b9-816a-4d6c-a89d-976e35a5e42e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b96cc67-20b9-414f-8afb-039ff7953adc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117138) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:09:19.768386 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-78dfc1b9-816a-4d6c-a89d-976e35a5e42e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.471869 Feb 21 01:09:19.769561 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 14/36] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Feb 21 01:09:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 3474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:09:19.779250 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-93e433c1-f39e-40bb-8440-f66301196bbb tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] Action: 'create', calling method: .version_select at 0x7f4acf358e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1823530876", "metadata": {"Type": "work"}}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:19.781683 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-93e433c1-f39e-40bb-8440-f66301196bbb tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:09:19.785528 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-93e433c1-f39e-40bb-8440-f66301196bbb tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013494 Feb 21 01:09:19.792519 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 15/37] 10.222.0.91 () {60 vars in 1155 bytes} [Mon Feb 21 01:09:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:09:19.807374 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-761f1982-5ec2-4091-ab44-d3d3644b2e35 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:19.808287 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-761f1982-5ec2-4091-ab44-d3d3644b2e35 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:19.817310 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-761f1982-5ec2-4091-ab44-d3d3644b2e35 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:19.818616 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-761f1982-5ec2-4091-ab44-d3d3644b2e35 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:19.819921 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-761f1982-5ec2-4091-ab44-d3d3644b2e35 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:19.820514 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-761f1982-5ec2-4091-ab44-d3d3644b2e35 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:20.234309 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-daf00f1c-f56c-4621-9069-4ba1da501329 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:20.248909 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-daf00f1c-f56c-4621-9069-4ba1da501329 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1314 microversion: 2.1 time: 0.777796 Feb 21 01:09:20.259713 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 23/38] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:19 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1314 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:20.264979 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-910bc78a-edda-492d-9198-a3250c241576 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:20.286367 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-910bc78a-edda-492d-9198-a3250c241576 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:20.416422 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-761f1982-5ec2-4091-ab44-d3d3644b2e35 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:20.418692 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-910bc78a-edda-492d-9198-a3250c241576 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:20.429433 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-761f1982-5ec2-4091-ab44-d3d3644b2e35 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1316 microversion: 2.1 time: 0.632695 Feb 21 01:09:20.431287 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 16/39] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:19 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1316 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:20.441378 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-910bc78a-edda-492d-9198-a3250c241576 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1221 microversion: 2.1 time: 0.180252 Feb 21 01:09:20.449755 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 24/40] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:20 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1221 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:20.449854 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-84690d42-b771-40c3-a61b-524222b286a7 tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] Action: 'create', calling method: .version_select at 0x7f4acf358ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-767604168", "metadata": {"Type": "work"}}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:20.449854 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-84690d42-b771-40c3-a61b-524222b286a7 tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:09:20.457401 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-84690d42-b771-40c3-a61b-524222b286a7 tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024664 Feb 21 01:09:20.458397 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 17/41] 10.222.0.91 () {60 vars in 1155 bytes} [Mon Feb 21 01:09:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:09:20.475061 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e582ca85-d13d-4153-a206-016e031d9447 tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] Calling method '.version_select at 0x7f4acf3a7f70>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:20.695951 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-e582ca85-d13d-4153-a206-016e031d9447 tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] HTTP exception thrown: Volume tempest-invalid-1049786101 could not be found. Feb 21 01:09:20.697063 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e582ca85-d13d-4153-a206-016e031d9447 tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] Returning 404 to user: Volume tempest-invalid-1049786101 could not be found. {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:09:20.698956 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e582ca85-d13d-4153-a206-016e031d9447 tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1049786101" status: 404 len: 99 microversion: 2.1 time: 0.231438 Feb 21 01:09:20.700411 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 25/42] 10.222.0.91 () {58 vars in 1217 bytes} [Mon Feb 21 01:09:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1049786101 => generated 99 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 21 01:09:20.723781 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7edd2072-cde8-484b-804b-140506eef90a tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010452 Feb 21 01:09:20.737411 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 18/43] 10.222.0.91 () {58 vars in 1139 bytes} [Mon Feb 21 01:09:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 21 01:09:20.741919 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-373f089e-6ad8-4de7-b4ac-57d4abd0bcdd tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006369 Feb 21 01:09:20.744895 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 26/44] 10.222.0.91 () {58 vars in 1136 bytes} [Mon Feb 21 01:09:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Feb 21 01:09:20.762449 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-273ebf78-ee1a-4a7c-afd6-d9a711b63ed3 tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] Calling method '.version_select at 0x7f4acf347790>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:20.855860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.wsgi [None req-273ebf78-ee1a-4a7c-afd6-d9a711b63ed3 tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] HTTP exception thrown: Volume 64dc6af2-44ef-4f08-8198-19878944a1b1 could not be found. Feb 21 01:09:20.857063 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-273ebf78-ee1a-4a7c-afd6-d9a711b63ed3 tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] Returning 404 to user: Volume 64dc6af2-44ef-4f08-8198-19878944a1b1 could not be found. {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:09:20.875430 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-273ebf78-ee1a-4a7c-afd6-d9a711b63ed3 tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/64dc6af2-44ef-4f08-8198-19878944a1b1" status: 404 len: 109 microversion: 2.1 time: 0.116171 Feb 21 01:09:20.875430 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 19/45] 10.222.0.91 () {58 vars in 1247 bytes} [Mon Feb 21 01:09:20 2022] DELETE /compute/v2.1/os-volumes/64dc6af2-44ef-4f08-8198-19878944a1b1 => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:09:20.892826 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-32a9bfcf-9920-4558-b758-b9ffa591e79b tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] Calling method '.version_select at 0x7f4acf302550>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:20.959583 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-32a9bfcf-9920-4558-b758-b9ffa591e79b tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] HTTP exception thrown: Volume cc1d8ae1-3fba-4775-bec4-0f2bc625b6e2 could not be found. Feb 21 01:09:20.961204 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-32a9bfcf-9920-4558-b758-b9ffa591e79b tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] Returning 404 to user: Volume cc1d8ae1-3fba-4775-bec4-0f2bc625b6e2 could not be found. {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:09:20.968407 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-32a9bfcf-9920-4558-b758-b9ffa591e79b tempest-VolumesNegativeTest-1060241800 tempest-VolumesNegativeTest-1060241800-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/cc1d8ae1-3fba-4775-bec4-0f2bc625b6e2" status: 404 len: 109 microversion: 2.1 time: 0.085769 Feb 21 01:09:20.968407 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 27/46] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Feb 21 01:09:20 2022] GET /compute/v2.1/os-volumes/cc1d8ae1-3fba-4775-bec4-0f2bc625b6e2 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:09:21.274983 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-abd60c0f-737d-430d-902a-3ef9ce2cb659 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:21.274983 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-abd60c0f-737d-430d-902a-3ef9ce2cb659 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:21.281701 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-abd60c0f-737d-430d-902a-3ef9ce2cb659 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:21.282469 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-abd60c0f-737d-430d-902a-3ef9ce2cb659 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:21.284838 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-abd60c0f-737d-430d-902a-3ef9ce2cb659 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:21.286587 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-abd60c0f-737d-430d-902a-3ef9ce2cb659 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:21.452612 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1e3a3e22-9724-4542-a2d7-6dd7ad82da26 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:21.454618 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1e3a3e22-9724-4542-a2d7-6dd7ad82da26 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:21.475039 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e3a3e22-9724-4542-a2d7-6dd7ad82da26 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:21.475914 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e3a3e22-9724-4542-a2d7-6dd7ad82da26 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:21.477398 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e3a3e22-9724-4542-a2d7-6dd7ad82da26 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:21.478239 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e3a3e22-9724-4542-a2d7-6dd7ad82da26 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:21.691799 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-abd60c0f-737d-430d-902a-3ef9ce2cb659 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:21.715398 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-abd60c0f-737d-430d-902a-3ef9ce2cb659 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1314 microversion: 2.1 time: 0.452697 Feb 21 01:09:21.721100 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 20/47] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:21 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:21.730594 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6f966e6d-2c04-4054-af3d-76aaf0f22758 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:21.735070 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6f966e6d-2c04-4054-af3d-76aaf0f22758 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:21.751672 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6f966e6d-2c04-4054-af3d-76aaf0f22758 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:21.756897 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6f966e6d-2c04-4054-af3d-76aaf0f22758 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:21.759052 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6f966e6d-2c04-4054-af3d-76aaf0f22758 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:21.762447 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6f966e6d-2c04-4054-af3d-76aaf0f22758 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:22.619390 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6f966e6d-2c04-4054-af3d-76aaf0f22758 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:22.629748 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6f966e6d-2c04-4054-af3d-76aaf0f22758 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1217 microversion: 2.1 time: 0.907382 Feb 21 01:09:22.630738 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 21/48] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:21 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1217 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:22.867788 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-bc0fd4b1-1825-40d6-8538-fc97ff45ac5c req-ef483e10-c361-4495-95d9-ff81b6f2b00c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36f6bf82-ad85-4c8b-80b3-afcfe2b390ad", "tag": "7a2e0e55-f2bb-4209-af1c-69f2a613873a"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:22.887948 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:09:22.887948 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:09:22.955563 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-bc0fd4b1-1825-40d6-8538-fc97ff45ac5c req-ef483e10-c361-4495-95d9-ff81b6f2b00c service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:22.956202 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-bc0fd4b1-1825-40d6-8538-fc97ff45ac5c req-ef483e10-c361-4495-95d9-ff81b6f2b00c service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:23.019385 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-bc0fd4b1-1825-40d6-8538-fc97ff45ac5c req-ef483e10-c361-4495-95d9-ff81b6f2b00c service nova] Creating event network-changed:7a2e0e55-f2bb-4209-af1c-69f2a613873a for instance 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad on hv-cinder-81322 Feb 21 01:09:23.020026 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-bc0fd4b1-1825-40d6-8538-fc97ff45ac5c req-ef483e10-c361-4495-95d9-ff81b6f2b00c service nova] Acquired lock "compute-rpcapi-router" {{(pid=117138) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 21 01:09:23.029719 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5505d728-fbd4-45f0-a3dc-6bd7d41a16b0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:23.033039 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5505d728-fbd4-45f0-a3dc-6bd7d41a16b0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:23.035568 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5505d728-fbd4-45f0-a3dc-6bd7d41a16b0 None None] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:23.038914 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5505d728-fbd4-45f0-a3dc-6bd7d41a16b0 None None] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:23.086909 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.compute.rpcapi [None req-5505d728-fbd4-45f0-a3dc-6bd7d41a16b0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 21 01:09:23.095946 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5505d728-fbd4-45f0-a3dc-6bd7d41a16b0 None None] Releasing lock "compute-rpcapi-router" {{(pid=117138) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 21 01:09:23.129861 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5505d728-fbd4-45f0-a3dc-6bd7d41a16b0 None None] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.485758 Feb 21 01:09:23.131098 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 22/49] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:09:23.147565 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-bac73a7d-ffa2-4218-939d-de96793fb474 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:23.148307 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-bac73a7d-ffa2-4218-939d-de96793fb474 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:23.162778 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bac73a7d-ffa2-4218-939d-de96793fb474 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:23.163113 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bac73a7d-ffa2-4218-939d-de96793fb474 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:23.164254 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bac73a7d-ffa2-4218-939d-de96793fb474 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:23.164836 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bac73a7d-ffa2-4218-939d-de96793fb474 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:23.351104 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1e3a3e22-9724-4542-a2d7-6dd7ad82da26 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:23.368587 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1e3a3e22-9724-4542-a2d7-6dd7ad82da26 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1316 microversion: 2.1 time: 1.925520 Feb 21 01:09:23.378939 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 28/50] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:21 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1316 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:09:23.884231 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-d5ad2307-dd4c-42f2-9a14-6ffdcb803896 req-d1b09fa9-06c7-49bd-95d2-fa1b897a73dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aa6aec1-9bd9-4713-aec8-c472d32aac72", "tag": "6f9526d4-7752-4bd3-924b-5a3062434379"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:23.892275 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:09:23.892275 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:09:23.941726 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-d5ad2307-dd4c-42f2-9a14-6ffdcb803896 req-d1b09fa9-06c7-49bd-95d2-fa1b897a73dc service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:23.946186 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-d5ad2307-dd4c-42f2-9a14-6ffdcb803896 req-d1b09fa9-06c7-49bd-95d2-fa1b897a73dc service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:23.999633 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-d5ad2307-dd4c-42f2-9a14-6ffdcb803896 req-d1b09fa9-06c7-49bd-95d2-fa1b897a73dc service nova] Creating event network-changed:6f9526d4-7752-4bd3-924b-5a3062434379 for instance 9aa6aec1-9bd9-4713-aec8-c472d32aac72 on hv-cinder-81322 Feb 21 01:09:24.000951 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-d5ad2307-dd4c-42f2-9a14-6ffdcb803896 req-d1b09fa9-06c7-49bd-95d2-fa1b897a73dc service nova] Acquired lock "compute-rpcapi-router" {{(pid=117139) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 21 01:09:24.002799 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bd071f58-f895-4654-9c0a-7314f8d1de87 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:24.004282 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bd071f58-f895-4654-9c0a-7314f8d1de87 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:24.007199 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bd071f58-f895-4654-9c0a-7314f8d1de87 None None] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:24.008289 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bd071f58-f895-4654-9c0a-7314f8d1de87 None None] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:24.023494 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.compute.rpcapi [None req-bd071f58-f895-4654-9c0a-7314f8d1de87 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 21 01:09:24.024850 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bd071f58-f895-4654-9c0a-7314f8d1de87 None None] Releasing lock "compute-rpcapi-router" {{(pid=117139) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 21 01:09:24.064869 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-bd071f58-f895-4654-9c0a-7314f8d1de87 None None] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.682664 Feb 21 01:09:24.067664 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 29/51] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:09:24.079602 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f80d716b-5768-4492-b7ce-c9b874c68e2a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:24.080378 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f80d716b-5768-4492-b7ce-c9b874c68e2a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:24.103708 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f80d716b-5768-4492-b7ce-c9b874c68e2a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:24.106364 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f80d716b-5768-4492-b7ce-c9b874c68e2a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:24.108373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f80d716b-5768-4492-b7ce-c9b874c68e2a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:24.109002 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f80d716b-5768-4492-b7ce-c9b874c68e2a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:24.351378 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f80d716b-5768-4492-b7ce-c9b874c68e2a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:24.401410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f80d716b-5768-4492-b7ce-c9b874c68e2a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1279 microversion: 2.1 time: 0.323986 Feb 21 01:09:24.409509 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 30/52] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:24 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1279 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:24.431054 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-76ff75bc-aff8-4393-b79e-83b6d6707401 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:24.443067 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-76ff75bc-aff8-4393-b79e-83b6d6707401 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:24.459686 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-76ff75bc-aff8-4393-b79e-83b6d6707401 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:24.460161 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-76ff75bc-aff8-4393-b79e-83b6d6707401 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:24.469137 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-76ff75bc-aff8-4393-b79e-83b6d6707401 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:24.471986 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-76ff75bc-aff8-4393-b79e-83b6d6707401 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:24.620578 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bac73a7d-ffa2-4218-939d-de96793fb474 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:24.638485 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-bac73a7d-ffa2-4218-939d-de96793fb474 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1314 microversion: 2.1 time: 1.506012 Feb 21 01:09:24.649270 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 23/53] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:23 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1314 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:24.842561 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-76ff75bc-aff8-4393-b79e-83b6d6707401 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:24.870837 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-76ff75bc-aff8-4393-b79e-83b6d6707401 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1316 microversion: 2.1 time: 0.457361 Feb 21 01:09:24.874920 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 31/54] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:24 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1316 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:25.195010 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-b2a07bc7-386c-4050-a9ac-f166a18326bd req-059f953c-8536-49db-a9af-f50d23c95a34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c2b10b2-e67d-4479-9f7a-0ce69607b1ab", "tag": "10c581fc-f817-48b4-9e2f-a1221c3603ea"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:25.197679 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:09:25.197679 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:09:25.226035 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-b2a07bc7-386c-4050-a9ac-f166a18326bd req-059f953c-8536-49db-a9af-f50d23c95a34 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:25.227672 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-b2a07bc7-386c-4050-a9ac-f166a18326bd req-059f953c-8536-49db-a9af-f50d23c95a34 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:25.262172 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-b2a07bc7-386c-4050-a9ac-f166a18326bd req-059f953c-8536-49db-a9af-f50d23c95a34 service nova] Creating event network-changed:10c581fc-f817-48b4-9e2f-a1221c3603ea for instance 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab on hv-cinder-81322 Feb 21 01:09:25.269644 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-b2a07bc7-386c-4050-a9ac-f166a18326bd req-059f953c-8536-49db-a9af-f50d23c95a34 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079318 Feb 21 01:09:25.271887 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 24/55] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:09:25.429035 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4f8f5767-8c65-40b0-8f60-6f341d18ba29 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:25.431868 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4f8f5767-8c65-40b0-8f60-6f341d18ba29 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:25.442299 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f8f5767-8c65-40b0-8f60-6f341d18ba29 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:25.443993 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f8f5767-8c65-40b0-8f60-6f341d18ba29 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:25.446713 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f8f5767-8c65-40b0-8f60-6f341d18ba29 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:25.449296 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f8f5767-8c65-40b0-8f60-6f341d18ba29 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:25.595435 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4f8f5767-8c65-40b0-8f60-6f341d18ba29 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:25.604120 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4f8f5767-8c65-40b0-8f60-6f341d18ba29 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1279 microversion: 2.1 time: 0.180974 Feb 21 01:09:25.616993 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 32/56] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:25 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1279 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:25.657364 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d7e299d0-315f-4a75-88ce-524f5affdfb2 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:25.658051 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d7e299d0-315f-4a75-88ce-524f5affdfb2 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:25.666886 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d7e299d0-315f-4a75-88ce-524f5affdfb2 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:25.667341 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d7e299d0-315f-4a75-88ce-524f5affdfb2 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:25.668179 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d7e299d0-315f-4a75-88ce-524f5affdfb2 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:25.668619 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d7e299d0-315f-4a75-88ce-524f5affdfb2 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:25.888317 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1590a423-4174-413e-b302-076faa535d3e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:25.888931 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1590a423-4174-413e-b302-076faa535d3e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:25.899679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1590a423-4174-413e-b302-076faa535d3e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:25.900083 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1590a423-4174-413e-b302-076faa535d3e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:25.900889 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1590a423-4174-413e-b302-076faa535d3e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:25.901329 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1590a423-4174-413e-b302-076faa535d3e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:26.122259 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1590a423-4174-413e-b302-076faa535d3e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:26.130297 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1590a423-4174-413e-b302-076faa535d3e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1316 microversion: 2.1 time: 0.245929 Feb 21 01:09:26.131327 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 33/57] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:25 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:09:26.293768 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d7e299d0-315f-4a75-88ce-524f5affdfb2 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:26.317271 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d7e299d0-315f-4a75-88ce-524f5affdfb2 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1314 microversion: 2.1 time: 0.664498 Feb 21 01:09:26.321583 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 25/58] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:25 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1314 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:26.620772 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-285dfdc5-7d39-4f22-acaf-8a13a1f33cd4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:26.621379 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-285dfdc5-7d39-4f22-acaf-8a13a1f33cd4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:26.627075 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-285dfdc5-7d39-4f22-acaf-8a13a1f33cd4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:26.627528 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-285dfdc5-7d39-4f22-acaf-8a13a1f33cd4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:26.628348 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-285dfdc5-7d39-4f22-acaf-8a13a1f33cd4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:26.628776 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-285dfdc5-7d39-4f22-acaf-8a13a1f33cd4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:26.858036 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-285dfdc5-7d39-4f22-acaf-8a13a1f33cd4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:26.860403 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-285dfdc5-7d39-4f22-acaf-8a13a1f33cd4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1321 microversion: 2.1 time: 0.243290 Feb 21 01:09:26.861054 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 34/59] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:26 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:09:27.150296 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f872e1e3-627e-4555-a282-2b434661abe7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:27.152001 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f872e1e3-627e-4555-a282-2b434661abe7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:27.160987 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f872e1e3-627e-4555-a282-2b434661abe7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:27.163141 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f872e1e3-627e-4555-a282-2b434661abe7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:27.163827 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f872e1e3-627e-4555-a282-2b434661abe7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:27.164435 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f872e1e3-627e-4555-a282-2b434661abe7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:27.316358 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f872e1e3-627e-4555-a282-2b434661abe7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:27.328952 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f872e1e3-627e-4555-a282-2b434661abe7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1316 microversion: 2.1 time: 0.183962 Feb 21 01:09:27.330330 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 26/60] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:27 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:27.347996 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6b8d7534-d767-48eb-8ca7-09e7f1d7600c tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:27.349701 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6b8d7534-d767-48eb-8ca7-09e7f1d7600c tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:27.367979 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6b8d7534-d767-48eb-8ca7-09e7f1d7600c tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:27.369225 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6b8d7534-d767-48eb-8ca7-09e7f1d7600c tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:27.372881 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6b8d7534-d767-48eb-8ca7-09e7f1d7600c tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:27.373519 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6b8d7534-d767-48eb-8ca7-09e7f1d7600c tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:27.529059 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-6b8d7534-d767-48eb-8ca7-09e7f1d7600c tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:27.536677 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6b8d7534-d767-48eb-8ca7-09e7f1d7600c tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1314 microversion: 2.1 time: 0.192124 Feb 21 01:09:27.537497 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 35/61] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:27 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:27.877547 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-673f1047-6e5d-46f6-816a-a466318410a6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:27.878483 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-673f1047-6e5d-46f6-816a-a466318410a6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:27.885674 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-673f1047-6e5d-46f6-816a-a466318410a6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:27.886457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-673f1047-6e5d-46f6-816a-a466318410a6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:27.887471 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-673f1047-6e5d-46f6-816a-a466318410a6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:27.888450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-673f1047-6e5d-46f6-816a-a466318410a6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:28.055567 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-673f1047-6e5d-46f6-816a-a466318410a6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:28.063423 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-673f1047-6e5d-46f6-816a-a466318410a6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1321 microversion: 2.1 time: 0.189514 Feb 21 01:09:28.074488 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 27/62] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:27 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:28.351564 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-54b3ae02-276e-439c-9717-0ac69551b5e1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:28.352269 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-54b3ae02-276e-439c-9717-0ac69551b5e1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:28.360010 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-54b3ae02-276e-439c-9717-0ac69551b5e1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:28.360010 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-54b3ae02-276e-439c-9717-0ac69551b5e1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:28.361026 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-54b3ae02-276e-439c-9717-0ac69551b5e1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:28.361606 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-54b3ae02-276e-439c-9717-0ac69551b5e1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:28.554319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c6a25563-3c4d-4bba-82bf-78ab064c1835 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:28.554945 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c6a25563-3c4d-4bba-82bf-78ab064c1835 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:28.566157 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c6a25563-3c4d-4bba-82bf-78ab064c1835 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:28.568879 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c6a25563-3c4d-4bba-82bf-78ab064c1835 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:28.569898 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c6a25563-3c4d-4bba-82bf-78ab064c1835 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:28.570478 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c6a25563-3c4d-4bba-82bf-78ab064c1835 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:28.587047 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-54b3ae02-276e-439c-9717-0ac69551b5e1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:28.595817 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-54b3ae02-276e-439c-9717-0ac69551b5e1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1316 microversion: 2.1 time: 0.248664 Feb 21 01:09:28.596535 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 36/63] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:28 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:28.796643 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c6a25563-3c4d-4bba-82bf-78ab064c1835 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:28.804902 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c6a25563-3c4d-4bba-82bf-78ab064c1835 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1314 microversion: 2.1 time: 0.254422 Feb 21 01:09:28.815374 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 28/64] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:28 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:29.087244 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e1415930-3d75-413b-b46c-de40bb1c69cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:29.088273 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e1415930-3d75-413b-b46c-de40bb1c69cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:29.099068 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e1415930-3d75-413b-b46c-de40bb1c69cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:29.100381 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e1415930-3d75-413b-b46c-de40bb1c69cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:29.110172 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e1415930-3d75-413b-b46c-de40bb1c69cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:29.112422 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e1415930-3d75-413b-b46c-de40bb1c69cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:29.634675 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-da63d4fd-2d05-4507-99ae-6719b9e60e62 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:29.637955 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-da63d4fd-2d05-4507-99ae-6719b9e60e62 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:29.668466 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-da63d4fd-2d05-4507-99ae-6719b9e60e62 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:29.669306 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-da63d4fd-2d05-4507-99ae-6719b9e60e62 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:29.677304 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-da63d4fd-2d05-4507-99ae-6719b9e60e62 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:29.678531 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-da63d4fd-2d05-4507-99ae-6719b9e60e62 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:30.170807 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e1415930-3d75-413b-b46c-de40bb1c69cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:30.202562 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e1415930-3d75-413b-b46c-de40bb1c69cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1321 microversion: 2.1 time: 1.121085 Feb 21 01:09:30.228376 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 37/65] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:29 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1321 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:30.245201 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9d8f1d4f-e27e-42e0-b356-3161c15b2c6c tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:30.246305 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9d8f1d4f-e27e-42e0-b356-3161c15b2c6c tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:30.274909 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d8f1d4f-e27e-42e0-b356-3161c15b2c6c tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:30.281775 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d8f1d4f-e27e-42e0-b356-3161c15b2c6c tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:30.281775 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d8f1d4f-e27e-42e0-b356-3161c15b2c6c tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:30.281775 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d8f1d4f-e27e-42e0-b356-3161c15b2c6c tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:30.395882 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-da63d4fd-2d05-4507-99ae-6719b9e60e62 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:30.407644 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-da63d4fd-2d05-4507-99ae-6719b9e60e62 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1316 microversion: 2.1 time: 0.796522 Feb 21 01:09:30.439201 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 29/66] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:29 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1316 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:31.088580 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9d8f1d4f-e27e-42e0-b356-3161c15b2c6c tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:31.095949 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9d8f1d4f-e27e-42e0-b356-3161c15b2c6c tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1314 microversion: 2.1 time: 0.865659 Feb 21 01:09:31.105882 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 38/67] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:30 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1314 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:31.191533 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-88b6651e-7b37-4cbe-b875-536ee0a2cc88 req-3116ddbd-11ec-4aa5-8305-a965c5b91066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1beb65b4-c732-4d82-aebd-9e9e531ce358", "tag": "39c05458-94e5-4923-817e-c11c68084a56"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:31.192914 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:09:31.192914 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:09:31.209554 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-88b6651e-7b37-4cbe-b875-536ee0a2cc88 req-3116ddbd-11ec-4aa5-8305-a965c5b91066 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:31.210492 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-88b6651e-7b37-4cbe-b875-536ee0a2cc88 req-3116ddbd-11ec-4aa5-8305-a965c5b91066 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:31.232918 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-88b6651e-7b37-4cbe-b875-536ee0a2cc88 req-3116ddbd-11ec-4aa5-8305-a965c5b91066 service nova] Creating event network-changed:39c05458-94e5-4923-817e-c11c68084a56 for instance 1beb65b4-c732-4d82-aebd-9e9e531ce358 on hv-cinder-81322 Feb 21 01:09:31.248730 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-56eb57c8-147f-4d76-acf6-041157aa6203 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:31.250152 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-56eb57c8-147f-4d76-acf6-041157aa6203 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:31.263879 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-88b6651e-7b37-4cbe-b875-536ee0a2cc88 req-3116ddbd-11ec-4aa5-8305-a965c5b91066 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076799 Feb 21 01:09:31.267249 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 30/68] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:09:31.268405 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-56eb57c8-147f-4d76-acf6-041157aa6203 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:31.269212 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-56eb57c8-147f-4d76-acf6-041157aa6203 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:31.271742 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-56eb57c8-147f-4d76-acf6-041157aa6203 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:31.272807 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-56eb57c8-147f-4d76-acf6-041157aa6203 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:31.430015 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7afc593d-6e23-4b55-ac10-55596aa01f89 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:31.431161 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7afc593d-6e23-4b55-ac10-55596aa01f89 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:31.451014 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7afc593d-6e23-4b55-ac10-55596aa01f89 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:31.451884 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7afc593d-6e23-4b55-ac10-55596aa01f89 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:31.465854 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7afc593d-6e23-4b55-ac10-55596aa01f89 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:31.466674 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7afc593d-6e23-4b55-ac10-55596aa01f89 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:32.073072 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-56eb57c8-147f-4d76-acf6-041157aa6203 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:32.089481 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7afc593d-6e23-4b55-ac10-55596aa01f89 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:32.092247 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-56eb57c8-147f-4d76-acf6-041157aa6203 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1321 microversion: 2.1 time: 0.853454 Feb 21 01:09:32.095768 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 39/69] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:31 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1321 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:09:32.106808 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7afc593d-6e23-4b55-ac10-55596aa01f89 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1316 microversion: 2.1 time: 0.681676 Feb 21 01:09:32.109746 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 31/70] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:31 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1316 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:32.127044 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9db5348b-ca21-4866-a374-d7e74de559be tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:32.128195 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9db5348b-ca21-4866-a374-d7e74de559be tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:32.140635 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9db5348b-ca21-4866-a374-d7e74de559be tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:32.144514 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9db5348b-ca21-4866-a374-d7e74de559be tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:32.146611 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9db5348b-ca21-4866-a374-d7e74de559be tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:32.147334 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9db5348b-ca21-4866-a374-d7e74de559be tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:32.761211 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9db5348b-ca21-4866-a374-d7e74de559be tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:32.782869 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9db5348b-ca21-4866-a374-d7e74de559be tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1314 microversion: 2.1 time: 0.653942 Feb 21 01:09:32.796878 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 40/71] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:32 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:33.147074 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e7d6b408-bf30-4784-9a16-39dfe16fe55b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:33.168388 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e57ac9a2-8d18-443f-b34b-f2204c5f6d65 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:33.169032 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e7d6b408-bf30-4784-9a16-39dfe16fe55b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:33.169434 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e57ac9a2-8d18-443f-b34b-f2204c5f6d65 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:33.169434 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e57ac9a2-8d18-443f-b34b-f2204c5f6d65 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:33.169434 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e57ac9a2-8d18-443f-b34b-f2204c5f6d65 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:33.169434 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e57ac9a2-8d18-443f-b34b-f2204c5f6d65 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:33.170079 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e57ac9a2-8d18-443f-b34b-f2204c5f6d65 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:33.170169 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e7d6b408-bf30-4784-9a16-39dfe16fe55b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:33.170169 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e7d6b408-bf30-4784-9a16-39dfe16fe55b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:33.170169 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e7d6b408-bf30-4784-9a16-39dfe16fe55b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:33.170169 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e7d6b408-bf30-4784-9a16-39dfe16fe55b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:33.418115 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e57ac9a2-8d18-443f-b34b-f2204c5f6d65 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:33.427178 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e57ac9a2-8d18-443f-b34b-f2204c5f6d65 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1321 microversion: 2.1 time: 0.285144 Feb 21 01:09:33.427751 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 41/72] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:33 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:33.620989 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e7d6b408-bf30-4784-9a16-39dfe16fe55b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:33.639299 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e7d6b408-bf30-4784-9a16-39dfe16fe55b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1316 microversion: 2.1 time: 0.503570 Feb 21 01:09:33.640360 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 32/73] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:33 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1316 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:33.828372 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9cbd1f76-2b49-46f7-b89e-ec0090337e5b tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:33.828993 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9cbd1f76-2b49-46f7-b89e-ec0090337e5b tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:33.845463 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9cbd1f76-2b49-46f7-b89e-ec0090337e5b tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:33.846700 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9cbd1f76-2b49-46f7-b89e-ec0090337e5b tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:33.847825 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9cbd1f76-2b49-46f7-b89e-ec0090337e5b tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:33.849034 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9cbd1f76-2b49-46f7-b89e-ec0090337e5b tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:34.216139 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9cbd1f76-2b49-46f7-b89e-ec0090337e5b tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:34.228587 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9cbd1f76-2b49-46f7-b89e-ec0090337e5b tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1314 microversion: 2.1 time: 0.416199 Feb 21 01:09:34.238702 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 42/74] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:33 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:09:34.446228 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-49dd8399-aba1-412b-a6f4-862860720abb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:34.446936 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-49dd8399-aba1-412b-a6f4-862860720abb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:34.453022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-49dd8399-aba1-412b-a6f4-862860720abb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:34.453485 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-49dd8399-aba1-412b-a6f4-862860720abb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:34.454281 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-49dd8399-aba1-412b-a6f4-862860720abb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:34.454971 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-49dd8399-aba1-412b-a6f4-862860720abb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:34.666425 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-49dd8399-aba1-412b-a6f4-862860720abb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:34.667878 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f6167d1d-9288-4e53-835a-7cf316949679 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:34.668444 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f6167d1d-9288-4e53-835a-7cf316949679 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:34.674670 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-49dd8399-aba1-412b-a6f4-862860720abb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1321 microversion: 2.1 time: 0.232369 Feb 21 01:09:34.675152 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f6167d1d-9288-4e53-835a-7cf316949679 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:34.675268 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 33/75] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:34 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:09:34.676151 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f6167d1d-9288-4e53-835a-7cf316949679 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:34.677154 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f6167d1d-9288-4e53-835a-7cf316949679 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:34.677653 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f6167d1d-9288-4e53-835a-7cf316949679 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:34.839963 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f6167d1d-9288-4e53-835a-7cf316949679 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:34.848138 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f6167d1d-9288-4e53-835a-7cf316949679 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1316 microversion: 2.1 time: 0.186797 Feb 21 01:09:34.849007 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 43/76] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:34 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1316 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:35.251220 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-17b977a4-1065-49fc-870a-e12b0d527701 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:35.252471 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-17b977a4-1065-49fc-870a-e12b0d527701 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:35.264007 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-17b977a4-1065-49fc-870a-e12b0d527701 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:35.270211 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-17b977a4-1065-49fc-870a-e12b0d527701 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:35.270211 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-17b977a4-1065-49fc-870a-e12b0d527701 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:35.270211 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-17b977a4-1065-49fc-870a-e12b0d527701 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:35.476198 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-17b977a4-1065-49fc-870a-e12b0d527701 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:35.493132 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-17b977a4-1065-49fc-870a-e12b0d527701 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1314 microversion: 2.1 time: 0.248245 Feb 21 01:09:35.500888 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 34/77] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:35 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:35.695347 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7c3fba83-bd9e-4568-a53d-e9cb660ce2dd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:35.695347 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7c3fba83-bd9e-4568-a53d-e9cb660ce2dd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:35.703861 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7c3fba83-bd9e-4568-a53d-e9cb660ce2dd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:35.704452 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7c3fba83-bd9e-4568-a53d-e9cb660ce2dd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:35.705351 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7c3fba83-bd9e-4568-a53d-e9cb660ce2dd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:35.705905 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7c3fba83-bd9e-4568-a53d-e9cb660ce2dd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:35.866179 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9d393deb-fdef-47aa-9af4-91abfddf8cf9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:35.867264 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9d393deb-fdef-47aa-9af4-91abfddf8cf9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:35.876728 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9d393deb-fdef-47aa-9af4-91abfddf8cf9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:35.881938 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9d393deb-fdef-47aa-9af4-91abfddf8cf9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:35.882836 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9d393deb-fdef-47aa-9af4-91abfddf8cf9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:35.884979 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9d393deb-fdef-47aa-9af4-91abfddf8cf9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:35.935456 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7c3fba83-bd9e-4568-a53d-e9cb660ce2dd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:35.947146 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7c3fba83-bd9e-4568-a53d-e9cb660ce2dd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1321 microversion: 2.1 time: 0.258770 Feb 21 01:09:35.957674 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 44/78] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:35 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:36.063707 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9d393deb-fdef-47aa-9af4-91abfddf8cf9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:36.072095 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9d393deb-fdef-47aa-9af4-91abfddf8cf9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1316 microversion: 2.1 time: 0.210881 Feb 21 01:09:36.072717 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 35/79] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:35 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1316 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:36.519192 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8ad3e2d8-e808-42d6-958f-f5d17bf123b5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:36.519800 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8ad3e2d8-e808-42d6-958f-f5d17bf123b5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:36.530714 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8ad3e2d8-e808-42d6-958f-f5d17bf123b5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:36.531465 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8ad3e2d8-e808-42d6-958f-f5d17bf123b5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:36.533203 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8ad3e2d8-e808-42d6-958f-f5d17bf123b5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:36.533793 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8ad3e2d8-e808-42d6-958f-f5d17bf123b5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:36.743160 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8ad3e2d8-e808-42d6-958f-f5d17bf123b5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:36.757463 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8ad3e2d8-e808-42d6-958f-f5d17bf123b5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1314 microversion: 2.1 time: 0.242774 Feb 21 01:09:36.758600 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 45/80] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:36 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:36.970262 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ec3ef185-0296-4b4b-83e6-67005a36b07b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:36.975955 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ec3ef185-0296-4b4b-83e6-67005a36b07b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:36.986217 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec3ef185-0296-4b4b-83e6-67005a36b07b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:36.987332 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec3ef185-0296-4b4b-83e6-67005a36b07b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:36.988338 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec3ef185-0296-4b4b-83e6-67005a36b07b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:36.988795 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec3ef185-0296-4b4b-83e6-67005a36b07b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:37.090031 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9647b339-0216-4b64-b47d-5cf3a5e10d3b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:37.091310 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9647b339-0216-4b64-b47d-5cf3a5e10d3b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:37.102329 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9647b339-0216-4b64-b47d-5cf3a5e10d3b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:37.103533 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9647b339-0216-4b64-b47d-5cf3a5e10d3b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:37.105605 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9647b339-0216-4b64-b47d-5cf3a5e10d3b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:37.107105 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9647b339-0216-4b64-b47d-5cf3a5e10d3b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:37.379614 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ec3ef185-0296-4b4b-83e6-67005a36b07b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:37.398796 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ec3ef185-0296-4b4b-83e6-67005a36b07b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1321 microversion: 2.1 time: 0.436057 Feb 21 01:09:37.402759 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 36/81] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:36 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1321 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:37.466423 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9647b339-0216-4b64-b47d-5cf3a5e10d3b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:37.474880 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9647b339-0216-4b64-b47d-5cf3a5e10d3b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1316 microversion: 2.1 time: 0.388649 Feb 21 01:09:37.476357 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 46/82] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:37 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1316 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:09:37.779388 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c24a4c84-b474-445a-a646-b3e452336de5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:37.782144 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c24a4c84-b474-445a-a646-b3e452336de5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:37.805103 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c24a4c84-b474-445a-a646-b3e452336de5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:37.805539 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c24a4c84-b474-445a-a646-b3e452336de5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:37.806455 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c24a4c84-b474-445a-a646-b3e452336de5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:37.807899 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c24a4c84-b474-445a-a646-b3e452336de5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:38.169601 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c24a4c84-b474-445a-a646-b3e452336de5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:38.178448 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c24a4c84-b474-445a-a646-b3e452336de5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1314 microversion: 2.1 time: 0.407658 Feb 21 01:09:38.185641 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 37/83] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:37 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:38.432057 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-327e5914-b6e6-4443-93af-bd7b5eecf8c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:38.434167 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-327e5914-b6e6-4443-93af-bd7b5eecf8c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:38.446453 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-327e5914-b6e6-4443-93af-bd7b5eecf8c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:38.447014 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-327e5914-b6e6-4443-93af-bd7b5eecf8c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:38.447923 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-327e5914-b6e6-4443-93af-bd7b5eecf8c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:38.448679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-327e5914-b6e6-4443-93af-bd7b5eecf8c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:38.498016 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a48b5ec4-3a25-4110-883a-994b38ab395b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:38.498658 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a48b5ec4-3a25-4110-883a-994b38ab395b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:38.506237 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a48b5ec4-3a25-4110-883a-994b38ab395b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:38.506686 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a48b5ec4-3a25-4110-883a-994b38ab395b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:38.507525 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a48b5ec4-3a25-4110-883a-994b38ab395b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:38.507990 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a48b5ec4-3a25-4110-883a-994b38ab395b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:38.656799 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-327e5914-b6e6-4443-93af-bd7b5eecf8c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:38.665800 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-327e5914-b6e6-4443-93af-bd7b5eecf8c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1321 microversion: 2.1 time: 0.243828 Feb 21 01:09:38.666950 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 47/84] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:38 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:38.745879 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a48b5ec4-3a25-4110-883a-994b38ab395b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:38.754143 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a48b5ec4-3a25-4110-883a-994b38ab395b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1316 microversion: 2.1 time: 0.264729 Feb 21 01:09:38.755240 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 38/85] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:38 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:09:39.195937 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9c7c1958-c3e7-4107-82e2-7baf48961765 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:39.197101 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9c7c1958-c3e7-4107-82e2-7baf48961765 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:39.203716 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9c7c1958-c3e7-4107-82e2-7baf48961765 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:39.204200 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9c7c1958-c3e7-4107-82e2-7baf48961765 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:39.205021 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9c7c1958-c3e7-4107-82e2-7baf48961765 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:39.205543 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9c7c1958-c3e7-4107-82e2-7baf48961765 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:39.363155 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9c7c1958-c3e7-4107-82e2-7baf48961765 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:39.370889 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9c7c1958-c3e7-4107-82e2-7baf48961765 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1314 microversion: 2.1 time: 0.178716 Feb 21 01:09:39.371643 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 48/86] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:39 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:39.690000 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-04635202-d9ff-45fe-a644-e4b323e62aab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:39.690606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-04635202-d9ff-45fe-a644-e4b323e62aab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:39.697440 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-04635202-d9ff-45fe-a644-e4b323e62aab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:39.697873 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-04635202-d9ff-45fe-a644-e4b323e62aab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:39.698921 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-04635202-d9ff-45fe-a644-e4b323e62aab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:39.699356 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-04635202-d9ff-45fe-a644-e4b323e62aab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:39.776342 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ca7b155f-8fb5-4e86-9db4-a1aa533ed0ed tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:39.777422 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ca7b155f-8fb5-4e86-9db4-a1aa533ed0ed tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:39.789941 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ca7b155f-8fb5-4e86-9db4-a1aa533ed0ed tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:39.790271 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ca7b155f-8fb5-4e86-9db4-a1aa533ed0ed tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:39.794374 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ca7b155f-8fb5-4e86-9db4-a1aa533ed0ed tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:39.794374 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ca7b155f-8fb5-4e86-9db4-a1aa533ed0ed tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:39.890845 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-04635202-d9ff-45fe-a644-e4b323e62aab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:39.901720 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-04635202-d9ff-45fe-a644-e4b323e62aab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1321 microversion: 2.1 time: 0.216325 Feb 21 01:09:39.902915 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 39/87] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:39 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:09:40.045301 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ca7b155f-8fb5-4e86-9db4-a1aa533ed0ed tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:40.056716 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ca7b155f-8fb5-4e86-9db4-a1aa533ed0ed tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1316 microversion: 2.1 time: 0.286736 Feb 21 01:09:40.056716 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 49/88] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:39 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:09:40.405764 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5594555f-c903-48bd-85f3-93be8694bac9 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:40.405764 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5594555f-c903-48bd-85f3-93be8694bac9 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:40.405764 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5594555f-c903-48bd-85f3-93be8694bac9 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:40.405764 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5594555f-c903-48bd-85f3-93be8694bac9 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:40.406067 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5594555f-c903-48bd-85f3-93be8694bac9 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:40.406067 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5594555f-c903-48bd-85f3-93be8694bac9 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:40.591071 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5594555f-c903-48bd-85f3-93be8694bac9 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:40.614687 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5594555f-c903-48bd-85f3-93be8694bac9 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1314 microversion: 2.1 time: 0.215567 Feb 21 01:09:40.618506 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 40/89] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:40 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:40.922119 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8efdc2e2-cd36-46b0-9472-e5898df0a476 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:40.923239 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8efdc2e2-cd36-46b0-9472-e5898df0a476 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:40.938338 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8efdc2e2-cd36-46b0-9472-e5898df0a476 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:40.938832 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8efdc2e2-cd36-46b0-9472-e5898df0a476 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:40.939704 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8efdc2e2-cd36-46b0-9472-e5898df0a476 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:40.940437 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8efdc2e2-cd36-46b0-9472-e5898df0a476 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:41.111967 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8efdc2e2-cd36-46b0-9472-e5898df0a476 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:41.126435 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8efdc2e2-cd36-46b0-9472-e5898df0a476 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1321 microversion: 2.1 time: 0.209140 Feb 21 01:09:41.127030 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 41/90] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:40 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:41.139817 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2b0b2d47-e5cf-4506-a664-274c1af0bb33 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:41.140921 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2b0b2d47-e5cf-4506-a664-274c1af0bb33 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:41.147774 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-7227d0fa-a025-4bf0-816d-35b72e892e5d req-04ee7ac1-ebf6-4b12-a28c-1767fb0876fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f6bf82-ad85-4c8b-80b3-afcfe2b390ad", "name": "network-vif-plugged", "status": "completed", "tag": "7a2e0e55-f2bb-4209-af1c-69f2a613873a"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:41.150489 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b0b2d47-e5cf-4506-a664-274c1af0bb33 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:41.150917 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:09:41.150917 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:09:41.151121 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b0b2d47-e5cf-4506-a664-274c1af0bb33 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:41.151721 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b0b2d47-e5cf-4506-a664-274c1af0bb33 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:41.152181 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b0b2d47-e5cf-4506-a664-274c1af0bb33 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:41.162978 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-7227d0fa-a025-4bf0-816d-35b72e892e5d req-04ee7ac1-ebf6-4b12-a28c-1767fb0876fa service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:41.164118 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-7227d0fa-a025-4bf0-816d-35b72e892e5d req-04ee7ac1-ebf6-4b12-a28c-1767fb0876fa service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:41.180863 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-7227d0fa-a025-4bf0-816d-35b72e892e5d req-04ee7ac1-ebf6-4b12-a28c-1767fb0876fa service nova] Creating event network-vif-plugged:7a2e0e55-f2bb-4209-af1c-69f2a613873a for instance 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad on hv-cinder-81322 Feb 21 01:09:41.190562 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-7227d0fa-a025-4bf0-816d-35b72e892e5d req-04ee7ac1-ebf6-4b12-a28c-1767fb0876fa service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276116 Feb 21 01:09:41.191883 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 50/91] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:09:41.409264 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2b0b2d47-e5cf-4506-a664-274c1af0bb33 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:41.418624 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2b0b2d47-e5cf-4506-a664-274c1af0bb33 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1316 microversion: 2.1 time: 0.290545 Feb 21 01:09:41.419218 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 42/92] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:41 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1316 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:41.639679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d0c26d72-d273-4192-b016-a928c584a0c5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:41.640875 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d0c26d72-d273-4192-b016-a928c584a0c5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:41.653572 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d0c26d72-d273-4192-b016-a928c584a0c5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:41.661538 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d0c26d72-d273-4192-b016-a928c584a0c5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:41.661538 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d0c26d72-d273-4192-b016-a928c584a0c5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:41.661538 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d0c26d72-d273-4192-b016-a928c584a0c5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:42.029019 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d0c26d72-d273-4192-b016-a928c584a0c5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:42.038163 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d0c26d72-d273-4192-b016-a928c584a0c5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1314 microversion: 2.1 time: 0.405948 Feb 21 01:09:42.038992 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 51/93] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:41 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:42.152576 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6b7fc8d5-6025-470a-8bb8-b1908f06d676 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:42.154393 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6b7fc8d5-6025-470a-8bb8-b1908f06d676 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:42.191056 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b7fc8d5-6025-470a-8bb8-b1908f06d676 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:42.196850 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b7fc8d5-6025-470a-8bb8-b1908f06d676 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:42.199259 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b7fc8d5-6025-470a-8bb8-b1908f06d676 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:42.204461 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b7fc8d5-6025-470a-8bb8-b1908f06d676 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:42.439072 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4d926732-0b20-444a-aafc-cc134e79b46e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:42.439857 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4d926732-0b20-444a-aafc-cc134e79b46e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:42.449389 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4d926732-0b20-444a-aafc-cc134e79b46e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:42.450118 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4d926732-0b20-444a-aafc-cc134e79b46e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:42.451484 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4d926732-0b20-444a-aafc-cc134e79b46e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:42.452339 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4d926732-0b20-444a-aafc-cc134e79b46e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:42.491827 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6b7fc8d5-6025-470a-8bb8-b1908f06d676 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:42.526433 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6b7fc8d5-6025-470a-8bb8-b1908f06d676 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1321 microversion: 2.1 time: 0.386051 Feb 21 01:09:42.532064 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 43/94] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:42 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1321 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:42.717473 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4d926732-0b20-444a-aafc-cc134e79b46e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:42.728167 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4d926732-0b20-444a-aafc-cc134e79b46e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1316 microversion: 2.1 time: 0.292862 Feb 21 01:09:42.729054 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 52/95] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:42 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:09:43.055715 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3dc3b7b9-51c2-47d5-862f-3bb0144e4569 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:43.056392 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3dc3b7b9-51c2-47d5-862f-3bb0144e4569 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:43.062507 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3dc3b7b9-51c2-47d5-862f-3bb0144e4569 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:43.063104 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3dc3b7b9-51c2-47d5-862f-3bb0144e4569 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:43.063953 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3dc3b7b9-51c2-47d5-862f-3bb0144e4569 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:43.064427 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3dc3b7b9-51c2-47d5-862f-3bb0144e4569 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:43.233864 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-a496ae23-fc2a-4886-b533-8b21e22de8d3 req-486beaad-ee81-4d6e-887d-4d45bb8a21d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c2b10b2-e67d-4479-9f7a-0ce69607b1ab", "name": "network-vif-plugged", "status": "completed", "tag": "10c581fc-f817-48b4-9e2f-a1221c3603ea"}, {"server_uuid": "9aa6aec1-9bd9-4713-aec8-c472d32aac72", "name": "network-vif-plugged", "status": "completed", "tag": "6f9526d4-7752-4bd3-924b-5a3062434379"}, {"server_uuid": "1beb65b4-c732-4d82-aebd-9e9e531ce358", "name": "network-vif-plugged", "status": "completed", "tag": "39c05458-94e5-4923-817e-c11c68084a56"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:43.236014 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3dc3b7b9-51c2-47d5-862f-3bb0144e4569 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:43.237645 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:09:43.237645 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:09:43.244419 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3dc3b7b9-51c2-47d5-862f-3bb0144e4569 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1314 microversion: 2.1 time: 0.193582 Feb 21 01:09:43.250966 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 44/96] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:43 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:43.251331 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-a496ae23-fc2a-4886-b533-8b21e22de8d3 req-486beaad-ee81-4d6e-887d-4d45bb8a21d8 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:43.251331 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-a496ae23-fc2a-4886-b533-8b21e22de8d3 req-486beaad-ee81-4d6e-887d-4d45bb8a21d8 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:43.266957 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-a496ae23-fc2a-4886-b533-8b21e22de8d3 req-486beaad-ee81-4d6e-887d-4d45bb8a21d8 service nova] Creating event network-vif-plugged:10c581fc-f817-48b4-9e2f-a1221c3603ea for instance 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab on hv-cinder-81322 Feb 21 01:09:43.267679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-a496ae23-fc2a-4886-b533-8b21e22de8d3 req-486beaad-ee81-4d6e-887d-4d45bb8a21d8 service nova] Creating event network-vif-plugged:6f9526d4-7752-4bd3-924b-5a3062434379 for instance 9aa6aec1-9bd9-4713-aec8-c472d32aac72 on hv-cinder-81322 Feb 21 01:09:43.268376 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-a496ae23-fc2a-4886-b533-8b21e22de8d3 req-486beaad-ee81-4d6e-887d-4d45bb8a21d8 service nova] Creating event network-vif-plugged:39c05458-94e5-4923-817e-c11c68084a56 for instance 1beb65b4-c732-4d82-aebd-9e9e531ce358 on hv-cinder-81322 Feb 21 01:09:43.277970 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-a496ae23-fc2a-4886-b533-8b21e22de8d3 req-486beaad-ee81-4d6e-887d-4d45bb8a21d8 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.047771 Feb 21 01:09:43.278584 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 53/97] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:09:43.555619 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2b4f75a9-839a-4299-9e5f-689e90071a0f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:43.558476 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2b4f75a9-839a-4299-9e5f-689e90071a0f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:43.587527 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b4f75a9-839a-4299-9e5f-689e90071a0f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:43.589659 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b4f75a9-839a-4299-9e5f-689e90071a0f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:43.592695 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b4f75a9-839a-4299-9e5f-689e90071a0f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:43.594928 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b4f75a9-839a-4299-9e5f-689e90071a0f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:43.748744 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-47274cec-3916-48a7-9e38-2f8d9e7c767c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:43.749543 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-47274cec-3916-48a7-9e38-2f8d9e7c767c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:43.761200 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-47274cec-3916-48a7-9e38-2f8d9e7c767c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:43.762034 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-47274cec-3916-48a7-9e38-2f8d9e7c767c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:43.763064 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-47274cec-3916-48a7-9e38-2f8d9e7c767c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:43.766971 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-47274cec-3916-48a7-9e38-2f8d9e7c767c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:43.888441 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2b4f75a9-839a-4299-9e5f-689e90071a0f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:43.901739 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2b4f75a9-839a-4299-9e5f-689e90071a0f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1321 microversion: 2.1 time: 0.355395 Feb 21 01:09:43.902537 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 45/98] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:43 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:44.183473 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-47274cec-3916-48a7-9e38-2f8d9e7c767c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:44.195072 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-47274cec-3916-48a7-9e38-2f8d9e7c767c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1316 microversion: 2.1 time: 0.450084 Feb 21 01:09:44.195592 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 54/99] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:43 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1316 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:44.271610 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d3de3d8f-7833-4838-9a06-2e6d58749870 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:44.272347 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d3de3d8f-7833-4838-9a06-2e6d58749870 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:44.278566 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d3de3d8f-7833-4838-9a06-2e6d58749870 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:44.279013 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d3de3d8f-7833-4838-9a06-2e6d58749870 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:44.279801 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d3de3d8f-7833-4838-9a06-2e6d58749870 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:44.280294 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d3de3d8f-7833-4838-9a06-2e6d58749870 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:44.460259 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d3de3d8f-7833-4838-9a06-2e6d58749870 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:44.474478 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d3de3d8f-7833-4838-9a06-2e6d58749870 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1501 microversion: 2.1 time: 0.207059 Feb 21 01:09:44.475543 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 46/100] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:44 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1501 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:09:44.930166 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0c1671f9-630f-436d-9f00-6342bcb7a41d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:44.930926 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0c1671f9-630f-436d-9f00-6342bcb7a41d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:44.936549 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0c1671f9-630f-436d-9f00-6342bcb7a41d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:44.936991 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0c1671f9-630f-436d-9f00-6342bcb7a41d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:44.937868 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0c1671f9-630f-436d-9f00-6342bcb7a41d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:44.938303 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0c1671f9-630f-436d-9f00-6342bcb7a41d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:45.131041 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0c1671f9-630f-436d-9f00-6342bcb7a41d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:45.155206 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0c1671f9-630f-436d-9f00-6342bcb7a41d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1321 microversion: 2.1 time: 0.230090 Feb 21 01:09:45.156657 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 55/101] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:44 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:45.212589 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c312e486-f08a-4cd5-b983-3f40bb5d554c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:45.213482 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c312e486-f08a-4cd5-b983-3f40bb5d554c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:45.221571 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c312e486-f08a-4cd5-b983-3f40bb5d554c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:45.222015 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c312e486-f08a-4cd5-b983-3f40bb5d554c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:45.222813 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c312e486-f08a-4cd5-b983-3f40bb5d554c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:45.223869 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c312e486-f08a-4cd5-b983-3f40bb5d554c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:45.420016 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c312e486-f08a-4cd5-b983-3f40bb5d554c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:45.429630 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c312e486-f08a-4cd5-b983-3f40bb5d554c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1316 microversion: 2.1 time: 0.222156 Feb 21 01:09:45.430224 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 47/102] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:45 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1316 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:46.175211 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4291e42d-5d0f-4875-95e8-bb16dd7092a3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:46.176054 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4291e42d-5d0f-4875-95e8-bb16dd7092a3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:46.194202 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4291e42d-5d0f-4875-95e8-bb16dd7092a3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:46.196913 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4291e42d-5d0f-4875-95e8-bb16dd7092a3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:46.199768 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4291e42d-5d0f-4875-95e8-bb16dd7092a3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:46.203155 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4291e42d-5d0f-4875-95e8-bb16dd7092a3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:46.447658 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1282818e-e8a7-4287-9a8a-e2e7ae298bd0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:46.449215 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1282818e-e8a7-4287-9a8a-e2e7ae298bd0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:46.450771 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4291e42d-5d0f-4875-95e8-bb16dd7092a3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:46.460335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1282818e-e8a7-4287-9a8a-e2e7ae298bd0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:46.462315 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1282818e-e8a7-4287-9a8a-e2e7ae298bd0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:46.463906 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1282818e-e8a7-4287-9a8a-e2e7ae298bd0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:46.464549 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1282818e-e8a7-4287-9a8a-e2e7ae298bd0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:46.480147 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4291e42d-5d0f-4875-95e8-bb16dd7092a3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1514 microversion: 2.1 time: 0.306782 Feb 21 01:09:46.480147 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 56/103] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:46 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1514 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:46.498857 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c9a0caeb-2892-4bbd-8276-aadcbb7a335e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:46.499261 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c9a0caeb-2892-4bbd-8276-aadcbb7a335e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:46.515079 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c9a0caeb-2892-4bbd-8276-aadcbb7a335e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:46.515525 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c9a0caeb-2892-4bbd-8276-aadcbb7a335e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:46.516357 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c9a0caeb-2892-4bbd-8276-aadcbb7a335e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:46.516789 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c9a0caeb-2892-4bbd-8276-aadcbb7a335e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:46.646751 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.objects.instance [None req-c9a0caeb-2892-4bbd-8276-aadcbb7a335e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lazy-loading 'flavor' on Instance uuid 1beb65b4-c732-4d82-aebd-9e9e531ce358 {{(pid=117139) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:09:46.744278 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1282818e-e8a7-4287-9a8a-e2e7ae298bd0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:46.753044 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1282818e-e8a7-4287-9a8a-e2e7ae298bd0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 200 len: 1505 microversion: 2.1 time: 0.309335 Feb 21 01:09:46.759215 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 48/104] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:46 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:46.785523 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-157fffeb-21cf-4a61-a3f6-7b60b2ace569 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9133330-5c9d-4be5-9f6b-80d49d17a911"}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:46.789324 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-157fffeb-21cf-4a61-a3f6-7b60b2ace569 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:46.798445 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-157fffeb-21cf-4a61-a3f6-7b60b2ace569 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:46.799475 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-157fffeb-21cf-4a61-a3f6-7b60b2ace569 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:46.800599 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-157fffeb-21cf-4a61-a3f6-7b60b2ace569 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:46.801850 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-157fffeb-21cf-4a61-a3f6-7b60b2ace569 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:47.250894 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c9a0caeb-2892-4bbd-8276-aadcbb7a335e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "POST /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358/action" status: 200 len: 32 microversion: 2.1 time: 0.759539 Feb 21 01:09:47.252034 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 57/105] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Feb 21 01:09:46 2022] POST /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358/action => generated 32 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 01:09:47.269509 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d05dd88c-93cc-4f77-b40f-c9ddcd746532 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:47.271893 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d05dd88c-93cc-4f77-b40f-c9ddcd746532 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:47.280559 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d05dd88c-93cc-4f77-b40f-c9ddcd746532 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:47.281086 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d05dd88c-93cc-4f77-b40f-c9ddcd746532 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:47.281942 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d05dd88c-93cc-4f77-b40f-c9ddcd746532 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:47.282460 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d05dd88c-93cc-4f77-b40f-c9ddcd746532 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:47.534264 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d05dd88c-93cc-4f77-b40f-c9ddcd746532 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:47.542814 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d05dd88c-93cc-4f77-b40f-c9ddcd746532 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.284501 Feb 21 01:09:47.543791 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 58/106] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:47 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:48.566891 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8413ab59-be5a-4a20-8388-092b8294d1b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:48.569055 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8413ab59-be5a-4a20-8388-092b8294d1b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:48.582975 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8413ab59-be5a-4a20-8388-092b8294d1b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:48.584123 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8413ab59-be5a-4a20-8388-092b8294d1b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:48.585450 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8413ab59-be5a-4a20-8388-092b8294d1b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:48.586431 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8413ab59-be5a-4a20-8388-092b8294d1b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:48.778211 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8413ab59-be5a-4a20-8388-092b8294d1b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:48.779278 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8413ab59-be5a-4a20-8388-092b8294d1b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.221668 Feb 21 01:09:48.780087 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 59/107] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:48 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:09:48.893475 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-157fffeb-21cf-4a61-a3f6-7b60b2ace569 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "POST /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.119178 Feb 21 01:09:48.894245 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 49/108] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Feb 21 01:09:46 2022] POST /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad/os-volume_attachments => generated 194 bytes in 2134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:09:49.084711 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e5a12352-694c-41a0-8af9-e66751bcb816 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c88b186c-bcb2-4523-8702-d4721574a157"}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:49.086507 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e5a12352-694c-41a0-8af9-e66751bcb816 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:49.097056 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e5a12352-694c-41a0-8af9-e66751bcb816 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:49.099410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e5a12352-694c-41a0-8af9-e66751bcb816 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:49.100332 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e5a12352-694c-41a0-8af9-e66751bcb816 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:49.100973 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e5a12352-694c-41a0-8af9-e66751bcb816 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:49.799497 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-80fe54b0-244e-4e51-815b-6420c9e8e93d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:49.800236 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-80fe54b0-244e-4e51-815b-6420c9e8e93d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:49.807140 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-80fe54b0-244e-4e51-815b-6420c9e8e93d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:49.807581 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-80fe54b0-244e-4e51-815b-6420c9e8e93d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:49.808427 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-80fe54b0-244e-4e51-815b-6420c9e8e93d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:49.808856 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-80fe54b0-244e-4e51-815b-6420c9e8e93d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:49.983410 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-80fe54b0-244e-4e51-815b-6420c9e8e93d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:49.998711 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-80fe54b0-244e-4e51-815b-6420c9e8e93d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.203281 Feb 21 01:09:49.999999 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 50/109] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:49 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:09:50.332726 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e5a12352-694c-41a0-8af9-e66751bcb816 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "POST /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.254402 Feb 21 01:09:50.333758 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 60/110] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Feb 21 01:09:49 2022] POST /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72/os-volume_attachments => generated 194 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:09:51.018275 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5a3b8a8e-93fd-48ee-bd11-f9aa6cae008d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:51.019010 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5a3b8a8e-93fd-48ee-bd11-f9aa6cae008d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:51.027374 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5a3b8a8e-93fd-48ee-bd11-f9aa6cae008d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:51.027849 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5a3b8a8e-93fd-48ee-bd11-f9aa6cae008d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:51.028660 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5a3b8a8e-93fd-48ee-bd11-f9aa6cae008d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:51.029096 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5a3b8a8e-93fd-48ee-bd11-f9aa6cae008d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:51.215265 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5a3b8a8e-93fd-48ee-bd11-f9aa6cae008d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:51.241255 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5a3b8a8e-93fd-48ee-bd11-f9aa6cae008d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.228188 Feb 21 01:09:51.243104 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 51/111] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:51 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:52.264439 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4dd44be9-d808-4ea8-a46a-0d1f96818e9f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:52.267152 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4dd44be9-d808-4ea8-a46a-0d1f96818e9f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:52.280549 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4dd44be9-d808-4ea8-a46a-0d1f96818e9f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:52.281847 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4dd44be9-d808-4ea8-a46a-0d1f96818e9f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:52.283862 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4dd44be9-d808-4ea8-a46a-0d1f96818e9f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:52.284977 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4dd44be9-d808-4ea8-a46a-0d1f96818e9f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:52.623641 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4dd44be9-d808-4ea8-a46a-0d1f96818e9f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:52.637305 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4dd44be9-d808-4ea8-a46a-0d1f96818e9f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.380696 Feb 21 01:09:52.650477 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 61/112] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:52 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:53.666377 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-12748496-1a41-4578-81d3-46dccb163c79 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:53.667636 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-12748496-1a41-4578-81d3-46dccb163c79 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:53.674376 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-12748496-1a41-4578-81d3-46dccb163c79 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:53.675134 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-12748496-1a41-4578-81d3-46dccb163c79 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:53.676874 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-12748496-1a41-4578-81d3-46dccb163c79 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:53.677437 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-12748496-1a41-4578-81d3-46dccb163c79 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:53.824378 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-12748496-1a41-4578-81d3-46dccb163c79 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:53.833604 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-12748496-1a41-4578-81d3-46dccb163c79 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.170274 Feb 21 01:09:53.834156 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 52/113] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:53 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:54.851922 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c426309d-e1fa-4975-a5b0-2199f971af07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:54.895185 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c426309d-e1fa-4975-a5b0-2199f971af07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:54.895185 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c426309d-e1fa-4975-a5b0-2199f971af07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:54.895185 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c426309d-e1fa-4975-a5b0-2199f971af07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:54.895185 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c426309d-e1fa-4975-a5b0-2199f971af07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:54.895897 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c426309d-e1fa-4975-a5b0-2199f971af07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:55.031764 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c426309d-e1fa-4975-a5b0-2199f971af07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:55.043244 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c426309d-e1fa-4975-a5b0-2199f971af07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.196333 Feb 21 01:09:55.043915 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 62/114] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:54 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:56.068337 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-781d0fc4-589d-499c-9ccd-3fc1e1e886a8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:56.069418 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-781d0fc4-589d-499c-9ccd-3fc1e1e886a8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:56.090861 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-781d0fc4-589d-499c-9ccd-3fc1e1e886a8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:56.090861 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-781d0fc4-589d-499c-9ccd-3fc1e1e886a8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:56.090861 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-781d0fc4-589d-499c-9ccd-3fc1e1e886a8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:56.090861 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-781d0fc4-589d-499c-9ccd-3fc1e1e886a8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:56.391038 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-781d0fc4-589d-499c-9ccd-3fc1e1e886a8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:56.400188 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-781d0fc4-589d-499c-9ccd-3fc1e1e886a8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.341142 Feb 21 01:09:56.411157 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 53/115] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:56 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:57.418150 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c86afef8-81ae-4a9f-aa6e-2a1f68bbe157 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:57.418767 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c86afef8-81ae-4a9f-aa6e-2a1f68bbe157 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:57.430325 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c86afef8-81ae-4a9f-aa6e-2a1f68bbe157 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:57.430325 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c86afef8-81ae-4a9f-aa6e-2a1f68bbe157 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:57.430325 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c86afef8-81ae-4a9f-aa6e-2a1f68bbe157 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:57.430325 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c86afef8-81ae-4a9f-aa6e-2a1f68bbe157 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:57.608570 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c86afef8-81ae-4a9f-aa6e-2a1f68bbe157 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:57.640591 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c86afef8-81ae-4a9f-aa6e-2a1f68bbe157 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.226498 Feb 21 01:09:57.641632 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 63/116] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:57 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:58.661833 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a456ff27-36ff-49ad-80eb-137633bf495e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:58.662490 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a456ff27-36ff-49ad-80eb-137633bf495e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:58.670557 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a456ff27-36ff-49ad-80eb-137633bf495e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:58.672728 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a456ff27-36ff-49ad-80eb-137633bf495e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:58.674386 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a456ff27-36ff-49ad-80eb-137633bf495e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:58.676076 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a456ff27-36ff-49ad-80eb-137633bf495e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:58.876024 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a456ff27-36ff-49ad-80eb-137633bf495e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:58.885690 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a456ff27-36ff-49ad-80eb-137633bf495e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.229005 Feb 21 01:09:58.886768 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 54/117] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:58 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:59.908132 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9f022736-7350-4769-b644-843fc8476257 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:59.908938 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9f022736-7350-4769-b644-843fc8476257 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:59.916153 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9f022736-7350-4769-b644-843fc8476257 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:59.916603 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9f022736-7350-4769-b644-843fc8476257 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:59.917393 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9f022736-7350-4769-b644-843fc8476257 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:59.918043 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9f022736-7350-4769-b644-843fc8476257 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:59.921511 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-03de6ae3-4959-4153-8d11-3214ceb27cea tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:59.922466 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-03de6ae3-4959-4153-8d11-3214ceb27cea tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:59.935263 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-03de6ae3-4959-4153-8d11-3214ceb27cea tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:59.936709 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-03de6ae3-4959-4153-8d11-3214ceb27cea tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:59.938391 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-03de6ae3-4959-4153-8d11-3214ceb27cea tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:59.939164 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-03de6ae3-4959-4153-8d11-3214ceb27cea tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:00.016018 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-03de6ae3-4959-4153-8d11-3214ceb27cea tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Going to try to terminate instance {{(pid=117138) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:10:00.279633 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9f022736-7350-4769-b644-843fc8476257 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:00.290226 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9f022736-7350-4769-b644-843fc8476257 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.385913 Feb 21 01:10:00.291062 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 64/118] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:59 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:00.483887 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-03de6ae3-4959-4153-8d11-3214ceb27cea tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "DELETE /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 204 len: 0 microversion: 2.1 time: 0.571375 Feb 21 01:10:00.484680 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 55/119] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Feb 21 01:09:59 2022] DELETE /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:10:00.498309 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-35f8e143-bbfe-4f14-959b-ee22771d912f tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:00.499174 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-35f8e143-bbfe-4f14-959b-ee22771d912f tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:00.507067 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-35f8e143-bbfe-4f14-959b-ee22771d912f tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:00.507508 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-35f8e143-bbfe-4f14-959b-ee22771d912f tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:00.508372 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-35f8e143-bbfe-4f14-959b-ee22771d912f tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:00.508791 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-35f8e143-bbfe-4f14-959b-ee22771d912f tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:00.653215 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-35f8e143-bbfe-4f14-959b-ee22771d912f tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:00.662384 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-35f8e143-bbfe-4f14-959b-ee22771d912f tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1553 microversion: 2.1 time: 0.168207 Feb 21 01:10:00.663581 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 65/120] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:00 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:01.309031 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ede471d4-372e-4922-939f-2f47820ef790 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:01.309939 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ede471d4-372e-4922-939f-2f47820ef790 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:01.316860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ede471d4-372e-4922-939f-2f47820ef790 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:01.317606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ede471d4-372e-4922-939f-2f47820ef790 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:01.318283 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ede471d4-372e-4922-939f-2f47820ef790 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:01.318721 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ede471d4-372e-4922-939f-2f47820ef790 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:01.656509 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ede471d4-372e-4922-939f-2f47820ef790 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:01.664968 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ede471d4-372e-4922-939f-2f47820ef790 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.360435 Feb 21 01:10:01.665543 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 56/121] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:01 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:01.681020 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ae879620-5956-44e3-9d2b-53b875cfdbe8 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:01.681616 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ae879620-5956-44e3-9d2b-53b875cfdbe8 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:01.688083 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ae879620-5956-44e3-9d2b-53b875cfdbe8 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:01.688521 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ae879620-5956-44e3-9d2b-53b875cfdbe8 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:01.689296 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ae879620-5956-44e3-9d2b-53b875cfdbe8 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:01.689887 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ae879620-5956-44e3-9d2b-53b875cfdbe8 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:01.882066 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ae879620-5956-44e3-9d2b-53b875cfdbe8 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:01.893506 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ae879620-5956-44e3-9d2b-53b875cfdbe8 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1553 microversion: 2.1 time: 0.216345 Feb 21 01:10:01.910743 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 66/122] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:01 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1553 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:02.687217 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-80610bdc-57fc-4af0-8dea-9e7df5bc4333 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:02.688393 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-80610bdc-57fc-4af0-8dea-9e7df5bc4333 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:02.699360 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-80610bdc-57fc-4af0-8dea-9e7df5bc4333 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:02.701791 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-80610bdc-57fc-4af0-8dea-9e7df5bc4333 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:02.701791 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-80610bdc-57fc-4af0-8dea-9e7df5bc4333 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:02.702309 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-80610bdc-57fc-4af0-8dea-9e7df5bc4333 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:02.908612 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-80610bdc-57fc-4af0-8dea-9e7df5bc4333 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:02.914041 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e913d13e-cc4e-407c-949e-91149f13c41f tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:02.915642 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e913d13e-cc4e-407c-949e-91149f13c41f tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:02.929633 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e913d13e-cc4e-407c-949e-91149f13c41f tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:02.930412 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e913d13e-cc4e-407c-949e-91149f13c41f tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:02.931507 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e913d13e-cc4e-407c-949e-91149f13c41f tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:02.934605 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e913d13e-cc4e-407c-949e-91149f13c41f tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:02.937548 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-80610bdc-57fc-4af0-8dea-9e7df5bc4333 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.257769 Feb 21 01:10:02.938147 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 57/123] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:02 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:03.139717 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e913d13e-cc4e-407c-949e-91149f13c41f tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:03.150972 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e913d13e-cc4e-407c-949e-91149f13c41f tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1553 microversion: 2.1 time: 0.243758 Feb 21 01:10:03.152303 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 67/124] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:02 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1553 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:10:03.964734 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fa7837d4-18ff-4348-a4eb-79ac5b736fc6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:03.965468 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fa7837d4-18ff-4348-a4eb-79ac5b736fc6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:03.987910 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fa7837d4-18ff-4348-a4eb-79ac5b736fc6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:03.988600 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fa7837d4-18ff-4348-a4eb-79ac5b736fc6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:03.989577 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fa7837d4-18ff-4348-a4eb-79ac5b736fc6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:03.990152 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fa7837d4-18ff-4348-a4eb-79ac5b736fc6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:04.146745 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fa7837d4-18ff-4348-a4eb-79ac5b736fc6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:04.158275 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fa7837d4-18ff-4348-a4eb-79ac5b736fc6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.206034 Feb 21 01:10:04.167619 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 58/125] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:03 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:04.180897 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fd43a7f7-ef4c-4b7a-8762-8d4861e33719 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:04.182193 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fd43a7f7-ef4c-4b7a-8762-8d4861e33719 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:04.202117 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fd43a7f7-ef4c-4b7a-8762-8d4861e33719 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:04.202117 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fd43a7f7-ef4c-4b7a-8762-8d4861e33719 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:04.202117 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fd43a7f7-ef4c-4b7a-8762-8d4861e33719 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:04.202117 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fd43a7f7-ef4c-4b7a-8762-8d4861e33719 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:04.330085 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fd43a7f7-ef4c-4b7a-8762-8d4861e33719 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:04.340181 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-2f728e55-6072-41af-9971-fd1eb4fb7749 req-86a5df2b-644d-440c-a6f7-9c5ed92d2e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f6bf82-ad85-4c8b-80b3-afcfe2b390ad", "name": "network-vif-deleted", "tag": "7a2e0e55-f2bb-4209-af1c-69f2a613873a"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:10:04.342481 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:10:04.342481 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:10:04.349200 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-2f728e55-6072-41af-9971-fd1eb4fb7749 req-86a5df2b-644d-440c-a6f7-9c5ed92d2e4d service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:04.349636 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-2f728e55-6072-41af-9971-fd1eb4fb7749 req-86a5df2b-644d-440c-a6f7-9c5ed92d2e4d service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:04.354540 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-fd43a7f7-ef4c-4b7a-8762-8d4861e33719 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1511 microversion: 2.1 time: 0.178075 Feb 21 01:10:04.369887 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 68/126] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:04 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1511 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:04.370670 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-2f728e55-6072-41af-9971-fd1eb4fb7749 req-86a5df2b-644d-440c-a6f7-9c5ed92d2e4d service nova] Creating event network-vif-deleted:7a2e0e55-f2bb-4209-af1c-69f2a613873a for instance 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad on hv-cinder-81322 Feb 21 01:10:04.376744 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-2f728e55-6072-41af-9971-fd1eb4fb7749 req-86a5df2b-644d-440c-a6f7-9c5ed92d2e4d service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039749 Feb 21 01:10:04.377453 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 59/127] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:10:05.235450 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f5f78cd8-a2e7-4685-a699-ac09fb32b237 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:05.235450 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f5f78cd8-a2e7-4685-a699-ac09fb32b237 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:05.235450 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f5f78cd8-a2e7-4685-a699-ac09fb32b237 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:05.235450 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f5f78cd8-a2e7-4685-a699-ac09fb32b237 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:05.237055 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f5f78cd8-a2e7-4685-a699-ac09fb32b237 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:05.237055 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f5f78cd8-a2e7-4685-a699-ac09fb32b237 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:05.354895 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f5f78cd8-a2e7-4685-a699-ac09fb32b237 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:05.366574 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f5f78cd8-a2e7-4685-a699-ac09fb32b237 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.196033 Feb 21 01:10:05.367168 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 69/128] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:05 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:05.374077 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-565b7cc0-6bb7-4899-859f-9ec200c658cd tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:05.375631 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-565b7cc0-6bb7-4899-859f-9ec200c658cd tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:05.383561 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-565b7cc0-6bb7-4899-859f-9ec200c658cd tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:05.387820 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-565b7cc0-6bb7-4899-859f-9ec200c658cd tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:05.387820 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-565b7cc0-6bb7-4899-859f-9ec200c658cd tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:05.387820 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-565b7cc0-6bb7-4899-859f-9ec200c658cd tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:05.458670 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-565b7cc0-6bb7-4899-859f-9ec200c658cd tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dda2419e2242cc8102a08ad4c8c0b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784d5ee9775c49d6a4127a0bea10323c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:05.474841 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-565b7cc0-6bb7-4899-859f-9ec200c658cd tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 200 len: 1345 microversion: 2.1 time: 0.099068 Feb 21 01:10:05.474841 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 60/129] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:05 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 1345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:10:06.385531 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a627f5f0-615e-4883-9680-c3619fa243b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:06.386250 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a627f5f0-615e-4883-9680-c3619fa243b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:06.396599 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a627f5f0-615e-4883-9680-c3619fa243b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:06.399375 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a627f5f0-615e-4883-9680-c3619fa243b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:06.400381 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a627f5f0-615e-4883-9680-c3619fa243b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:06.401661 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a627f5f0-615e-4883-9680-c3619fa243b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:06.492506 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-db8aa19a-e55a-4097-a048-e22bb1ec1ce5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:06.493228 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-db8aa19a-e55a-4097-a048-e22bb1ec1ce5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:06.507787 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-db8aa19a-e55a-4097-a048-e22bb1ec1ce5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:06.512633 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-db8aa19a-e55a-4097-a048-e22bb1ec1ce5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:06.512633 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-db8aa19a-e55a-4097-a048-e22bb1ec1ce5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:06.512633 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-db8aa19a-e55a-4097-a048-e22bb1ec1ce5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:06.536637 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.wsgi [None req-db8aa19a-e55a-4097-a048-e22bb1ec1ce5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] HTTP exception thrown: Instance 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad could not be found. Feb 21 01:10:06.546257 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-db8aa19a-e55a-4097-a048-e22bb1ec1ce5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Returning 404 to user: Instance 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad could not be found. {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:10:06.546257 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-db8aa19a-e55a-4097-a048-e22bb1ec1ce5 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 404 len: 111 microversion: 2.1 time: 0.051666 Feb 21 01:10:06.546257 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 61/130] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:06 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 01:10:06.669463 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a627f5f0-615e-4883-9680-c3619fa243b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:06.678912 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a627f5f0-615e-4883-9680-c3619fa243b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.298092 Feb 21 01:10:06.688236 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 70/131] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:06 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:07.269957 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-123f3a2d-6898-4397-aad0-a70449be25fc tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:07.271252 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-123f3a2d-6898-4397-aad0-a70449be25fc tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:07.277840 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-123f3a2d-6898-4397-aad0-a70449be25fc tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:07.278579 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-123f3a2d-6898-4397-aad0-a70449be25fc tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:07.279640 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-123f3a2d-6898-4397-aad0-a70449be25fc tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:07.280175 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-123f3a2d-6898-4397-aad0-a70449be25fc tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:07.296313 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.wsgi [None req-123f3a2d-6898-4397-aad0-a70449be25fc tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] HTTP exception thrown: Instance 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad could not be found. Feb 21 01:10:07.297094 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-123f3a2d-6898-4397-aad0-a70449be25fc tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Returning 404 to user: Instance 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad could not be found. {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:10:07.297937 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-123f3a2d-6898-4397-aad0-a70449be25fc tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033305 Feb 21 01:10:07.298723 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 62/132] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:10:07 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 01:10:07.701325 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7cf1c03a-3833-42bf-bb9a-e190a671c302 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:07.703401 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7cf1c03a-3833-42bf-bb9a-e190a671c302 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:07.721064 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7cf1c03a-3833-42bf-bb9a-e190a671c302 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:07.726077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7cf1c03a-3833-42bf-bb9a-e190a671c302 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:07.727622 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7cf1c03a-3833-42bf-bb9a-e190a671c302 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:07.728100 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7cf1c03a-3833-42bf-bb9a-e190a671c302 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:08.117029 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7cf1c03a-3833-42bf-bb9a-e190a671c302 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:08.138818 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7cf1c03a-3833-42bf-bb9a-e190a671c302 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.442091 Feb 21 01:10:08.138818 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 71/133] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:07 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:09.154821 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9c60604e-9383-4075-9ec9-6ef1090b5a1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:09.155462 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9c60604e-9383-4075-9ec9-6ef1090b5a1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:09.170236 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9c60604e-9383-4075-9ec9-6ef1090b5a1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:09.170955 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9c60604e-9383-4075-9ec9-6ef1090b5a1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:09.171957 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9c60604e-9383-4075-9ec9-6ef1090b5a1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:09.173176 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9c60604e-9383-4075-9ec9-6ef1090b5a1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:09.249671 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-74685462-d664-4a3b-9714-fe5675185ef7 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:09.250497 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-74685462-d664-4a3b-9714-fe5675185ef7 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:09.262550 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-74685462-d664-4a3b-9714-fe5675185ef7 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:09.263370 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-74685462-d664-4a3b-9714-fe5675185ef7 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:09.267049 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-74685462-d664-4a3b-9714-fe5675185ef7 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:09.267780 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-74685462-d664-4a3b-9714-fe5675185ef7 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:09.293257 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-74685462-d664-4a3b-9714-fe5675185ef7 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] HTTP exception thrown: Instance 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad could not be found. Feb 21 01:10:09.294067 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-74685462-d664-4a3b-9714-fe5675185ef7 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Returning 404 to user: Instance 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad could not be found. {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:10:09.302364 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-74685462-d664-4a3b-9714-fe5675185ef7 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "DELETE /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 404 len: 111 microversion: 2.1 time: 0.050024 Feb 21 01:10:09.308442 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 72/134] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Feb 21 01:10:09 2022] DELETE /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:10:09.318665 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9bd36818-8bc1-4b00-8e32-00d25510e083 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:09.319277 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9bd36818-8bc1-4b00-8e32-00d25510e083 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] [instance: 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:09.332671 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9bd36818-8bc1-4b00-8e32-00d25510e083 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:09.333136 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9bd36818-8bc1-4b00-8e32-00d25510e083 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:09.333970 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9bd36818-8bc1-4b00-8e32-00d25510e083 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:09.334553 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9bd36818-8bc1-4b00-8e32-00d25510e083 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:09.355667 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-9bd36818-8bc1-4b00-8e32-00d25510e083 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] HTTP exception thrown: Instance 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad could not be found. Feb 21 01:10:09.363648 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9bd36818-8bc1-4b00-8e32-00d25510e083 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] Returning 404 to user: Instance 36f6bf82-ad85-4c8b-80b3-afcfe2b390ad could not be found. {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:10:09.363648 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9bd36818-8bc1-4b00-8e32-00d25510e083 tempest-DeleteServersTestJSON-996399753 tempest-DeleteServersTestJSON-996399753-project] 10.222.0.91 "GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad" status: 404 len: 111 microversion: 2.1 time: 0.043274 Feb 21 01:10:09.363648 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 73/135] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:09 2022] GET /compute/v2.1/servers/36f6bf82-ad85-4c8b-80b3-afcfe2b390ad => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:10:09.457216 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9c60604e-9383-4075-9ec9-6ef1090b5a1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:09.465379 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9c60604e-9383-4075-9ec9-6ef1090b5a1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.315421 Feb 21 01:10:09.466604 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 63/136] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:09 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:10.433814 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d32f3a89-f2fd-4128-9483-bffee48dda6e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1299001663", "imageRef": "9b96cc67-20b9-414f-8afb-039ff7953adc", "flavorRef": "452", "networks": [{"uuid": "8d88ddc9-10c8-4356-a5fc-74ca444968a9"}]}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:10:10.485116 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2a500151-ee71-47c1-97e6-7ab1a1809d24 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:10.486548 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2a500151-ee71-47c1-97e6-7ab1a1809d24 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:10.506154 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2a500151-ee71-47c1-97e6-7ab1a1809d24 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:10.506788 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2a500151-ee71-47c1-97e6-7ab1a1809d24 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:10.509874 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2a500151-ee71-47c1-97e6-7ab1a1809d24 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:10.510329 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2a500151-ee71-47c1-97e6-7ab1a1809d24 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:10.547356 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.network.neutron [None req-d32f3a89-f2fd-4128-9483-bffee48dda6e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] validate_networks() for [('8d88ddc9-10c8-4356-a5fc-74ca444968a9', None, None, None, None, None)] {{(pid=117139) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:10:10.740296 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2a500151-ee71-47c1-97e6-7ab1a1809d24 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:10.748734 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2a500151-ee71-47c1-97e6-7ab1a1809d24 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.269958 Feb 21 01:10:10.749426 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 64/137] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:10 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:10:11.040768 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-d32f3a89-f2fd-4128-9483-bffee48dda6e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Flavor limits 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:10:11.045873 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-d32f3a89-f2fd-4128-9483-bffee48dda6e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Image limits 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:10:11.046415 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-d32f3a89-f2fd-4128-9483-bffee48dda6e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Flavor pref 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:10:11.046833 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-d32f3a89-f2fd-4128-9483-bffee48dda6e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Image pref 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:10:11.047241 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-d32f3a89-f2fd-4128-9483-bffee48dda6e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:10:11.068792 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d32f3a89-f2fd-4128-9483-bffee48dda6e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:11.069637 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d32f3a89-f2fd-4128-9483-bffee48dda6e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:11.070436 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d32f3a89-f2fd-4128-9483-bffee48dda6e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:11.072285 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d32f3a89-f2fd-4128-9483-bffee48dda6e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:11.105630 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.quota [None req-d32f3a89-f2fd-4128-9483-bffee48dda6e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Getting quotas for project 24c1bf236b2f4eb1bffab124b7392ca5. Resources: {'ram', 'cores', 'instances'} {{(pid=117139) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:10:11.113750 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.quota [None req-d32f3a89-f2fd-4128-9483-bffee48dda6e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Getting quotas for user 70516383f3b14d5283462803cac26d8b and project 24c1bf236b2f4eb1bffab124b7392ca5. Resources: {'ram', 'cores', 'instances'} {{(pid=117139) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:10:11.135416 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d32f3a89-f2fd-4128-9483-bffee48dda6e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Going to run 1 instances... {{(pid=117139) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:10:11.138271 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d32f3a89-f2fd-4128-9483-bffee48dda6e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b96cc67-20b9-414f-8afb-039ff7953adc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117139) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:10:11.296750 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d32f3a89-f2fd-4128-9483-bffee48dda6e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.867384 Feb 21 01:10:11.297701 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 74/138] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Feb 21 01:10:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:10:11.309738 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-70f9c9ce-844c-43eb-a5c1-cde9a6273d57 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:11.313498 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-70f9c9ce-844c-43eb-a5c1-cde9a6273d57 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:11.388365 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-70f9c9ce-844c-43eb-a5c1-cde9a6273d57 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:11.395911 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-70f9c9ce-844c-43eb-a5c1-cde9a6273d57 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 200 len: 1218 microversion: 2.1 time: 0.089612 Feb 21 01:10:11.396492 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 65/139] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:11 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:11.776509 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-540431eb-bf0f-48b3-ab2d-55907d901e11 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:11.777758 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-540431eb-bf0f-48b3-ab2d-55907d901e11 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:11.787869 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-540431eb-bf0f-48b3-ab2d-55907d901e11 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:11.788887 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-540431eb-bf0f-48b3-ab2d-55907d901e11 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:11.789831 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-540431eb-bf0f-48b3-ab2d-55907d901e11 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:11.790257 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-540431eb-bf0f-48b3-ab2d-55907d901e11 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:11.988409 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-540431eb-bf0f-48b3-ab2d-55907d901e11 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:11.999055 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-540431eb-bf0f-48b3-ab2d-55907d901e11 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.227090 Feb 21 01:10:12.000106 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 75/140] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:11 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:12.417658 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c56e4558-1524-4b81-a2b2-68e371a4f2c3 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:12.417658 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c56e4558-1524-4b81-a2b2-68e371a4f2c3 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:12.492349 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c56e4558-1524-4b81-a2b2-68e371a4f2c3 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:12.500606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c56e4558-1524-4b81-a2b2-68e371a4f2c3 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 200 len: 1218 microversion: 2.1 time: 0.090212 Feb 21 01:10:12.501341 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 66/141] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:12 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:13.017244 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1b07c096-b96c-4ef1-bdaa-cae03543d139 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:13.018924 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1b07c096-b96c-4ef1-bdaa-cae03543d139 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:13.033813 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1b07c096-b96c-4ef1-bdaa-cae03543d139 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:13.035679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1b07c096-b96c-4ef1-bdaa-cae03543d139 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:13.038528 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1b07c096-b96c-4ef1-bdaa-cae03543d139 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:13.038528 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1b07c096-b96c-4ef1-bdaa-cae03543d139 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:13.252286 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1b07c096-b96c-4ef1-bdaa-cae03543d139 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:13.264075 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1b07c096-b96c-4ef1-bdaa-cae03543d139 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.249810 Feb 21 01:10:13.267827 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 76/142] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:13 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:13.519025 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-29b29404-9471-418e-9813-a3f6da42bff2 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:13.519025 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-29b29404-9471-418e-9813-a3f6da42bff2 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:13.533705 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-29b29404-9471-418e-9813-a3f6da42bff2 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:13.535185 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-29b29404-9471-418e-9813-a3f6da42bff2 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:13.536041 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-29b29404-9471-418e-9813-a3f6da42bff2 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:13.537061 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-29b29404-9471-418e-9813-a3f6da42bff2 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:13.615926 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-29b29404-9471-418e-9813-a3f6da42bff2 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:13.624909 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-29b29404-9471-418e-9813-a3f6da42bff2 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 200 len: 1270 microversion: 2.1 time: 0.110703 Feb 21 01:10:13.625484 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 67/143] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:13 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 1270 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:14.294034 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-18a5af4e-d1b8-4b05-b45b-762b49b38c92 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:14.295545 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-18a5af4e-d1b8-4b05-b45b-762b49b38c92 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:14.305384 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-18a5af4e-d1b8-4b05-b45b-762b49b38c92 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:14.306827 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-18a5af4e-d1b8-4b05-b45b-762b49b38c92 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:14.325090 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-18a5af4e-d1b8-4b05-b45b-762b49b38c92 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:14.325873 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-18a5af4e-d1b8-4b05-b45b-762b49b38c92 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:14.647520 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-735d8e63-5379-45b6-a2fa-5bb349788f5e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:14.648178 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-735d8e63-5379-45b6-a2fa-5bb349788f5e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:14.657091 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-735d8e63-5379-45b6-a2fa-5bb349788f5e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:14.657535 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-735d8e63-5379-45b6-a2fa-5bb349788f5e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:14.662257 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-735d8e63-5379-45b6-a2fa-5bb349788f5e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:14.662257 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-735d8e63-5379-45b6-a2fa-5bb349788f5e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:14.681556 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-18a5af4e-d1b8-4b05-b45b-762b49b38c92 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:14.689574 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-18a5af4e-d1b8-4b05-b45b-762b49b38c92 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.402225 Feb 21 01:10:14.691069 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 77/144] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:14 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:10:14.753533 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-735d8e63-5379-45b6-a2fa-5bb349788f5e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:14.761763 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-735d8e63-5379-45b6-a2fa-5bb349788f5e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 200 len: 1288 microversion: 2.1 time: 0.119248 Feb 21 01:10:14.762443 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 68/145] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:14 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 1288 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:15.711685 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1740e6b5-f11b-4147-9f5d-50c457eb28e1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:15.714095 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1740e6b5-f11b-4147-9f5d-50c457eb28e1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:15.721698 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1740e6b5-f11b-4147-9f5d-50c457eb28e1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:15.722355 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1740e6b5-f11b-4147-9f5d-50c457eb28e1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:15.723555 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1740e6b5-f11b-4147-9f5d-50c457eb28e1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:15.724393 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1740e6b5-f11b-4147-9f5d-50c457eb28e1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:15.787457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3a7f1662-d090-4d1a-956d-df3994d03d3c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:15.787457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3a7f1662-d090-4d1a-956d-df3994d03d3c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:15.790239 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3a7f1662-d090-4d1a-956d-df3994d03d3c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:15.790691 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3a7f1662-d090-4d1a-956d-df3994d03d3c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:15.791489 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3a7f1662-d090-4d1a-956d-df3994d03d3c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:15.791971 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3a7f1662-d090-4d1a-956d-df3994d03d3c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:16.015808 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3a7f1662-d090-4d1a-956d-df3994d03d3c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:16.023237 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3a7f1662-d090-4d1a-956d-df3994d03d3c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 200 len: 1318 microversion: 2.1 time: 0.245805 Feb 21 01:10:16.035620 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 69/146] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:15 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:16.125372 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1740e6b5-f11b-4147-9f5d-50c457eb28e1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:16.132942 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1740e6b5-f11b-4147-9f5d-50c457eb28e1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.430162 Feb 21 01:10:16.134074 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 78/147] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:15 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:17.050870 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ab0e9b00-db5b-4fd4-be6f-15bcb551d6d0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:17.053633 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ab0e9b00-db5b-4fd4-be6f-15bcb551d6d0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:17.063396 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ab0e9b00-db5b-4fd4-be6f-15bcb551d6d0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:17.064245 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ab0e9b00-db5b-4fd4-be6f-15bcb551d6d0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:17.065805 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ab0e9b00-db5b-4fd4-be6f-15bcb551d6d0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:17.066459 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ab0e9b00-db5b-4fd4-be6f-15bcb551d6d0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:17.151432 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-cd52b961-283b-491a-94fd-8c4e8359fad5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:17.152314 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-cd52b961-283b-491a-94fd-8c4e8359fad5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:17.172549 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cd52b961-283b-491a-94fd-8c4e8359fad5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:17.173249 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cd52b961-283b-491a-94fd-8c4e8359fad5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:17.174464 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cd52b961-283b-491a-94fd-8c4e8359fad5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:17.175733 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cd52b961-283b-491a-94fd-8c4e8359fad5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:17.296450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ab0e9b00-db5b-4fd4-be6f-15bcb551d6d0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:17.306434 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ab0e9b00-db5b-4fd4-be6f-15bcb551d6d0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 200 len: 1318 microversion: 2.1 time: 0.268273 Feb 21 01:10:17.319856 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 70/148] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:17 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:10:17.686611 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-cd52b961-283b-491a-94fd-8c4e8359fad5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:17.701110 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-cd52b961-283b-491a-94fd-8c4e8359fad5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.553251 Feb 21 01:10:17.708964 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 79/149] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:17 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:10:17.972060 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-7f0c955f-f13f-4830-9a6d-aac042a85c6d req-c7f0b033-81a3-4a0a-9065-7550304f8f02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7095a15-9df6-4743-a602-d5410ac101a6", "tag": "48787ba3-9f90-477e-8bb5-d81fc8b1d6a5"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:10:17.974274 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:10:17.974274 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:10:17.986819 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-7f0c955f-f13f-4830-9a6d-aac042a85c6d req-c7f0b033-81a3-4a0a-9065-7550304f8f02 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:17.990006 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-7f0c955f-f13f-4830-9a6d-aac042a85c6d req-c7f0b033-81a3-4a0a-9065-7550304f8f02 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:18.022780 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-7f0c955f-f13f-4830-9a6d-aac042a85c6d req-c7f0b033-81a3-4a0a-9065-7550304f8f02 service nova] Creating event network-changed:48787ba3-9f90-477e-8bb5-d81fc8b1d6a5 for instance b7095a15-9df6-4743-a602-d5410ac101a6 on hv-cinder-81322 Feb 21 01:10:18.033353 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-7f0c955f-f13f-4830-9a6d-aac042a85c6d req-c7f0b033-81a3-4a0a-9065-7550304f8f02 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066725 Feb 21 01:10:18.038431 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 71/150] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:10:18.326600 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2b3c064e-5eda-4171-8909-49eff83ecac7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:18.327228 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2b3c064e-5eda-4171-8909-49eff83ecac7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:18.333834 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2b3c064e-5eda-4171-8909-49eff83ecac7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:18.334269 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2b3c064e-5eda-4171-8909-49eff83ecac7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:18.335052 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2b3c064e-5eda-4171-8909-49eff83ecac7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:18.335477 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2b3c064e-5eda-4171-8909-49eff83ecac7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:18.720327 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6c16d1ba-64f9-4670-bf2d-59abb1ff3434 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:18.721404 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6c16d1ba-64f9-4670-bf2d-59abb1ff3434 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:18.728569 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6c16d1ba-64f9-4670-bf2d-59abb1ff3434 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:18.729623 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6c16d1ba-64f9-4670-bf2d-59abb1ff3434 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:18.730562 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6c16d1ba-64f9-4670-bf2d-59abb1ff3434 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:18.731180 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6c16d1ba-64f9-4670-bf2d-59abb1ff3434 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:18.886756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6c16d1ba-64f9-4670-bf2d-59abb1ff3434 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:18.894558 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6c16d1ba-64f9-4670-bf2d-59abb1ff3434 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.179011 Feb 21 01:10:18.895059 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 72/151] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:18 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:10:18.943410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2b3c064e-5eda-4171-8909-49eff83ecac7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:18.952106 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2b3c064e-5eda-4171-8909-49eff83ecac7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 200 len: 1318 microversion: 2.1 time: 0.628816 Feb 21 01:10:18.953287 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 80/152] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:18 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 1318 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:19.912123 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5756b24b-1696-44d3-bc1d-b2721343808b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:19.913614 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5756b24b-1696-44d3-bc1d-b2721343808b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:19.926074 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5756b24b-1696-44d3-bc1d-b2721343808b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:19.926302 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5756b24b-1696-44d3-bc1d-b2721343808b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:19.927221 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5756b24b-1696-44d3-bc1d-b2721343808b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:19.927858 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5756b24b-1696-44d3-bc1d-b2721343808b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:19.969977 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3501d106-a206-4fd3-a494-f08b0bb4e34f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:19.970780 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3501d106-a206-4fd3-a494-f08b0bb4e34f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:19.977915 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3501d106-a206-4fd3-a494-f08b0bb4e34f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:19.978356 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3501d106-a206-4fd3-a494-f08b0bb4e34f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:19.979276 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3501d106-a206-4fd3-a494-f08b0bb4e34f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:19.979803 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3501d106-a206-4fd3-a494-f08b0bb4e34f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:20.151716 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5756b24b-1696-44d3-bc1d-b2721343808b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:20.166628 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5756b24b-1696-44d3-bc1d-b2721343808b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.259895 Feb 21 01:10:20.172461 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 73/153] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:19 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:20.251617 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3501d106-a206-4fd3-a494-f08b0bb4e34f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:20.263016 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3501d106-a206-4fd3-a494-f08b0bb4e34f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 200 len: 1318 microversion: 2.1 time: 0.297182 Feb 21 01:10:20.263762 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 81/154] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:19 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:10:21.183747 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-96025d9d-339c-41c6-8593-9267445309c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:21.184976 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-96025d9d-339c-41c6-8593-9267445309c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:21.193956 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-96025d9d-339c-41c6-8593-9267445309c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:21.198747 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-96025d9d-339c-41c6-8593-9267445309c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:21.199530 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-96025d9d-339c-41c6-8593-9267445309c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:21.200776 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-96025d9d-339c-41c6-8593-9267445309c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:21.280960 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-74a87f0d-b925-43b1-92ea-5654ec43a997 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:21.281573 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-74a87f0d-b925-43b1-92ea-5654ec43a997 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:21.289656 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-74a87f0d-b925-43b1-92ea-5654ec43a997 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:21.290194 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-74a87f0d-b925-43b1-92ea-5654ec43a997 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:21.290984 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-74a87f0d-b925-43b1-92ea-5654ec43a997 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:21.292948 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-74a87f0d-b925-43b1-92ea-5654ec43a997 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:21.429136 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-96025d9d-339c-41c6-8593-9267445309c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:21.449029 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-96025d9d-339c-41c6-8593-9267445309c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.269069 Feb 21 01:10:21.449665 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 74/155] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:21 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:21.647909 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-74a87f0d-b925-43b1-92ea-5654ec43a997 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:21.660896 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-74a87f0d-b925-43b1-92ea-5654ec43a997 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 200 len: 1318 microversion: 2.1 time: 0.383750 Feb 21 01:10:21.664573 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 82/156] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:21 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:10:22.478155 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0272032a-59db-405a-b543-5f54ae25eec7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:22.478155 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0272032a-59db-405a-b543-5f54ae25eec7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:22.486260 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0272032a-59db-405a-b543-5f54ae25eec7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:22.487286 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0272032a-59db-405a-b543-5f54ae25eec7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:22.490355 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0272032a-59db-405a-b543-5f54ae25eec7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:22.491723 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0272032a-59db-405a-b543-5f54ae25eec7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:22.721967 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0272032a-59db-405a-b543-5f54ae25eec7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:22.738038 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0272032a-59db-405a-b543-5f54ae25eec7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.274439 Feb 21 01:10:22.739018 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 75/157] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:22 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:22.743888 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1ea2c763-4a8b-4e26-9c58-496710440993 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:22.757220 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1ea2c763-4a8b-4e26-9c58-496710440993 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:22.760151 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1ea2c763-4a8b-4e26-9c58-496710440993 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:22.760606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1ea2c763-4a8b-4e26-9c58-496710440993 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:22.761417 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1ea2c763-4a8b-4e26-9c58-496710440993 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:22.761851 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1ea2c763-4a8b-4e26-9c58-496710440993 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:22.941587 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1ea2c763-4a8b-4e26-9c58-496710440993 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:22.950485 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1ea2c763-4a8b-4e26-9c58-496710440993 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 200 len: 1318 microversion: 2.1 time: 0.210198 Feb 21 01:10:22.953143 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 76/158] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:22 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:23.052405 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-33365938-e45b-4e89-bb92-1fa374dee0de tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Action: 'create', calling method: .version_select at 0x7f4acf1f0f70>, body: {"keypair": {"name": "tempest-keypair-386680109"}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:10:23.101176 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.quota [None req-33365938-e45b-4e89-bb92-1fa374dee0de tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Getting quotas for project 8ef8a0b8828d4a38a7f8a9465fa9fbaf. Resources: {'key_pairs'} {{(pid=117139) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:10:23.110852 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.quota [None req-33365938-e45b-4e89-bb92-1fa374dee0de tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Getting quotas for user 5adf4837cc254e1a951dda183d795606 and project 8ef8a0b8828d4a38a7f8a9465fa9fbaf. Resources: {'key_pairs'} {{(pid=117139) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:10:23.492322 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.quota [None req-33365938-e45b-4e89-bb92-1fa374dee0de tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Getting quotas for project 8ef8a0b8828d4a38a7f8a9465fa9fbaf. Resources: {'key_pairs'} {{(pid=117139) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:10:23.496375 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.quota [None req-33365938-e45b-4e89-bb92-1fa374dee0de tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Getting quotas for user 5adf4837cc254e1a951dda183d795606 and project 8ef8a0b8828d4a38a7f8a9465fa9fbaf. Resources: {'key_pairs'} {{(pid=117139) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:10:23.517437 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-33365938-e45b-4e89-bb92-1fa374dee0de tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.926816 Feb 21 01:10:23.520228 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 83/159] 10.222.0.91 () {62 vars in 1198 bytes} [Mon Feb 21 01:10:22 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 930 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 21 01:10:23.756003 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a37f38c4-e54a-4caa-80e3-7b0ab24cede6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:23.756567 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a37f38c4-e54a-4caa-80e3-7b0ab24cede6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:23.764019 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a37f38c4-e54a-4caa-80e3-7b0ab24cede6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:23.764577 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a37f38c4-e54a-4caa-80e3-7b0ab24cede6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:23.765732 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a37f38c4-e54a-4caa-80e3-7b0ab24cede6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:23.766367 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a37f38c4-e54a-4caa-80e3-7b0ab24cede6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:23.977105 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-03b05739-d63c-46a6-8011-852d89fd20c5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:23.977708 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-03b05739-d63c-46a6-8011-852d89fd20c5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:23.992938 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-03b05739-d63c-46a6-8011-852d89fd20c5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:23.993443 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-03b05739-d63c-46a6-8011-852d89fd20c5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:23.994252 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-03b05739-d63c-46a6-8011-852d89fd20c5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:23.994680 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-03b05739-d63c-46a6-8011-852d89fd20c5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:24.171495 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a37f38c4-e54a-4caa-80e3-7b0ab24cede6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:24.183476 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a37f38c4-e54a-4caa-80e3-7b0ab24cede6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.431300 Feb 21 01:10:24.196521 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 77/160] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:23 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:24.461371 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-03b05739-d63c-46a6-8011-852d89fd20c5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:24.470239 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-03b05739-d63c-46a6-8011-852d89fd20c5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 200 len: 1318 microversion: 2.1 time: 0.496631 Feb 21 01:10:24.478330 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 84/161] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:23 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:25.201587 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2ceefa86-fecf-498a-bcb0-93a8cdba0f2f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:25.204243 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2ceefa86-fecf-498a-bcb0-93a8cdba0f2f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:25.211786 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2ceefa86-fecf-498a-bcb0-93a8cdba0f2f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:25.212613 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2ceefa86-fecf-498a-bcb0-93a8cdba0f2f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:25.213880 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2ceefa86-fecf-498a-bcb0-93a8cdba0f2f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:25.214548 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2ceefa86-fecf-498a-bcb0-93a8cdba0f2f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:25.453525 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2ceefa86-fecf-498a-bcb0-93a8cdba0f2f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:25.465967 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2ceefa86-fecf-498a-bcb0-93a8cdba0f2f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1520 microversion: 2.1 time: 0.267971 Feb 21 01:10:25.466563 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 78/162] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:25 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:25.487868 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-31b813ec-cf48-4f75-8bf0-9ae7a41ba9be tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:25.488465 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-31b813ec-cf48-4f75-8bf0-9ae7a41ba9be tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:25.498563 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-31b813ec-cf48-4f75-8bf0-9ae7a41ba9be tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:25.499196 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-31b813ec-cf48-4f75-8bf0-9ae7a41ba9be tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:25.500263 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-31b813ec-cf48-4f75-8bf0-9ae7a41ba9be tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:25.505058 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-31b813ec-cf48-4f75-8bf0-9ae7a41ba9be tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:25.890826 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-31b813ec-cf48-4f75-8bf0-9ae7a41ba9be tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:25.902083 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-31b813ec-cf48-4f75-8bf0-9ae7a41ba9be tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 200 len: 1318 microversion: 2.1 time: 0.418058 Feb 21 01:10:25.915941 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 85/163] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:25 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:26.485121 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f7e4b7b6-9088-4044-b278-433f69b51e77 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:26.485797 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f7e4b7b6-9088-4044-b278-433f69b51e77 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:26.492560 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f7e4b7b6-9088-4044-b278-433f69b51e77 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:26.493367 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f7e4b7b6-9088-4044-b278-433f69b51e77 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:26.494301 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f7e4b7b6-9088-4044-b278-433f69b51e77 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:26.494943 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f7e4b7b6-9088-4044-b278-433f69b51e77 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:26.920935 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-065552d3-77e3-42b5-884b-53a99a0479e1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:26.923441 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-065552d3-77e3-42b5-884b-53a99a0479e1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:26.934140 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-065552d3-77e3-42b5-884b-53a99a0479e1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:26.934634 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-065552d3-77e3-42b5-884b-53a99a0479e1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:26.935623 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-065552d3-77e3-42b5-884b-53a99a0479e1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:26.937228 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-065552d3-77e3-42b5-884b-53a99a0479e1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:27.240325 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-065552d3-77e3-42b5-884b-53a99a0479e1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:27.249216 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-065552d3-77e3-42b5-884b-53a99a0479e1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 200 len: 1318 microversion: 2.1 time: 0.332081 Feb 21 01:10:27.250535 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 86/164] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:26 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:27.540820 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f7e4b7b6-9088-4044-b278-433f69b51e77 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:27.567989 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f7e4b7b6-9088-4044-b278-433f69b51e77 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1500 microversion: 2.1 time: 1.087265 Feb 21 01:10:27.568851 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 79/165] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:26 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1500 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:27.589797 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ec62dc67-f8c3-40fa-b69b-afb8aaa40c4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:27.590598 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ec62dc67-f8c3-40fa-b69b-afb8aaa40c4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:27.618394 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec62dc67-f8c3-40fa-b69b-afb8aaa40c4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:27.618713 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec62dc67-f8c3-40fa-b69b-afb8aaa40c4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:27.619576 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec62dc67-f8c3-40fa-b69b-afb8aaa40c4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:27.620045 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec62dc67-f8c3-40fa-b69b-afb8aaa40c4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:27.919636 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ec62dc67-f8c3-40fa-b69b-afb8aaa40c4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:27.930896 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ec62dc67-f8c3-40fa-b69b-afb8aaa40c4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1515 microversion: 2.1 time: 0.347239 Feb 21 01:10:27.944579 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 87/166] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:27 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1515 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:28.267520 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-dba955fe-ac2b-45af-95d0-217793feeff1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:28.269206 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-dba955fe-ac2b-45af-95d0-217793feeff1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:28.292664 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dba955fe-ac2b-45af-95d0-217793feeff1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:28.293037 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dba955fe-ac2b-45af-95d0-217793feeff1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:28.294756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dba955fe-ac2b-45af-95d0-217793feeff1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:28.295181 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dba955fe-ac2b-45af-95d0-217793feeff1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:28.826785 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-dba955fe-ac2b-45af-95d0-217793feeff1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:28.863944 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-dba955fe-ac2b-45af-95d0-217793feeff1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 200 len: 1318 microversion: 2.1 time: 0.599451 Feb 21 01:10:28.868366 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 80/167] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:28 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 1318 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:29.118863 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-d172ef52-ff49-43d5-aaaa-292159f78e13 req-6d8776ad-b000-4649-9bbc-3b9e8858005d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7095a15-9df6-4743-a602-d5410ac101a6", "name": "network-vif-plugged", "status": "completed", "tag": "48787ba3-9f90-477e-8bb5-d81fc8b1d6a5"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:10:29.120548 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:10:29.120548 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:10:29.146601 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-d172ef52-ff49-43d5-aaaa-292159f78e13 req-6d8776ad-b000-4649-9bbc-3b9e8858005d service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:29.147383 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-d172ef52-ff49-43d5-aaaa-292159f78e13 req-6d8776ad-b000-4649-9bbc-3b9e8858005d service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:29.156397 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a754b85a-7f31-4ce0-bff5-6bb9e32fffb3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1875322972", "imageRef": "9b96cc67-20b9-414f-8afb-039ff7953adc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f0d0617-4e78-4e05-abc5-75ee47858c30"}], "security_groups": [{"name": "tempest-securitygroup--1430016131"}], "key_name": "tempest-keypair-386680109", "user_data": "}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:10:29.187059 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-d172ef52-ff49-43d5-aaaa-292159f78e13 req-6d8776ad-b000-4649-9bbc-3b9e8858005d service nova] Creating event network-vif-plugged:48787ba3-9f90-477e-8bb5-d81fc8b1d6a5 for instance b7095a15-9df6-4743-a602-d5410ac101a6 on hv-cinder-81322 Feb 21 01:10:29.200564 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-d172ef52-ff49-43d5-aaaa-292159f78e13 req-6d8776ad-b000-4649-9bbc-3b9e8858005d service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083648 Feb 21 01:10:29.265245 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 88/168] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:10:29.553091 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.network.neutron [None req-a754b85a-7f31-4ce0-bff5-6bb9e32fffb3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] validate_networks() for [('5f0d0617-4e78-4e05-abc5-75ee47858c30', None, None, None, None, None)] {{(pid=117138) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:10:29.884649 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2ee3faf2-0500-4fa6-97ee-5478e49698eb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:29.885800 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2ee3faf2-0500-4fa6-97ee-5478e49698eb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:29.895854 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2ee3faf2-0500-4fa6-97ee-5478e49698eb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:29.896631 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2ee3faf2-0500-4fa6-97ee-5478e49698eb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:29.897653 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2ee3faf2-0500-4fa6-97ee-5478e49698eb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:29.898265 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2ee3faf2-0500-4fa6-97ee-5478e49698eb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:30.159070 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2ee3faf2-0500-4fa6-97ee-5478e49698eb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:30.180757 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2ee3faf2-0500-4fa6-97ee-5478e49698eb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 200 len: 1318 microversion: 2.1 time: 0.300913 Feb 21 01:10:30.181340 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 89/169] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:29 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:10:30.212211 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7c6e363e-d49f-4a13-a1f9-5c758c4c23bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:10:30.212211 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7c6e363e-d49f-4a13-a1f9-5c758c4c23bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:30.226928 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7c6e363e-d49f-4a13-a1f9-5c758c4c23bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:30.227493 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7c6e363e-d49f-4a13-a1f9-5c758c4c23bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:30.228405 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7c6e363e-d49f-4a13-a1f9-5c758c4c23bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:30.229077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7c6e363e-d49f-4a13-a1f9-5c758c4c23bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:30.261831 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.objects.instance [None req-7c6e363e-d49f-4a13-a1f9-5c758c4c23bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lazy-loading 'flavor' on Instance uuid 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab {{(pid=117139) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:10:30.634562 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7c6e363e-d49f-4a13-a1f9-5c758c4c23bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "POST /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/action" status: 200 len: 32 microversion: 2.1 time: 0.429288 Feb 21 01:10:30.640041 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 90/170] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Feb 21 01:10:30 2022] POST /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/action => generated 32 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 21 01:10:30.646431 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-744d9683-d33e-4cf3-af86-caa2e5dd0a17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:30.651238 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-744d9683-d33e-4cf3-af86-caa2e5dd0a17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:30.664320 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-744d9683-d33e-4cf3-af86-caa2e5dd0a17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:30.664811 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-744d9683-d33e-4cf3-af86-caa2e5dd0a17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:30.667540 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-744d9683-d33e-4cf3-af86-caa2e5dd0a17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:30.668082 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-744d9683-d33e-4cf3-af86-caa2e5dd0a17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:31.010731 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-a754b85a-7f31-4ce0-bff5-6bb9e32fffb3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Flavor limits 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:10:31.011284 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-a754b85a-7f31-4ce0-bff5-6bb9e32fffb3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Image limits 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:10:31.011607 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-a754b85a-7f31-4ce0-bff5-6bb9e32fffb3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Flavor pref 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:10:31.012043 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-a754b85a-7f31-4ce0-bff5-6bb9e32fffb3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Image pref 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:10:31.012465 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-a754b85a-7f31-4ce0-bff5-6bb9e32fffb3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:10:31.032501 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a754b85a-7f31-4ce0-bff5-6bb9e32fffb3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:31.036258 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a754b85a-7f31-4ce0-bff5-6bb9e32fffb3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:31.037412 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a754b85a-7f31-4ce0-bff5-6bb9e32fffb3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:31.037687 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a754b85a-7f31-4ce0-bff5-6bb9e32fffb3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:31.102952 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-a754b85a-7f31-4ce0-bff5-6bb9e32fffb3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Getting quotas for project 8ef8a0b8828d4a38a7f8a9465fa9fbaf. Resources: {'ram', 'cores', 'instances'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:10:31.113305 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-a754b85a-7f31-4ce0-bff5-6bb9e32fffb3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Getting quotas for user 5adf4837cc254e1a951dda183d795606 and project 8ef8a0b8828d4a38a7f8a9465fa9fbaf. Resources: {'ram', 'cores', 'instances'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:10:31.146834 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a754b85a-7f31-4ce0-bff5-6bb9e32fffb3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Going to run 1 instances... {{(pid=117138) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:10:31.150011 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a754b85a-7f31-4ce0-bff5-6bb9e32fffb3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b96cc67-20b9-414f-8afb-039ff7953adc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117138) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:10:31.230139 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-744d9683-d33e-4cf3-af86-caa2e5dd0a17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:31.246991 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-744d9683-d33e-4cf3-af86-caa2e5dd0a17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.605525 Feb 21 01:10:31.253690 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 91/171] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:30 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:31.271693 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f78e5ded-6ec1-4cab-aeff-b8bd39f85304 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:31.274455 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f78e5ded-6ec1-4cab-aeff-b8bd39f85304 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:31.304382 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f78e5ded-6ec1-4cab-aeff-b8bd39f85304 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:31.305301 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f78e5ded-6ec1-4cab-aeff-b8bd39f85304 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:31.309742 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f78e5ded-6ec1-4cab-aeff-b8bd39f85304 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:31.310512 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f78e5ded-6ec1-4cab-aeff-b8bd39f85304 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:31.414422 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a754b85a-7f31-4ce0-bff5-6bb9e32fffb3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.262655 Feb 21 01:10:31.421886 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 81/172] 10.222.0.91 () {62 vars in 1187 bytes} [Mon Feb 21 01:10:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 2271 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Feb 21 01:10:31.449691 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-68fee7e5-5bfb-4275-b542-82405ee8182e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:31.451431 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-68fee7e5-5bfb-4275-b542-82405ee8182e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:31.708313 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-68fee7e5-5bfb-4275-b542-82405ee8182e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:31.715876 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-68fee7e5-5bfb-4275-b542-82405ee8182e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:31.717715 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-68fee7e5-5bfb-4275-b542-82405ee8182e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:31.719011 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-68fee7e5-5bfb-4275-b542-82405ee8182e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1281 microversion: 2.20 time: 0.290311 Feb 21 01:10:31.720193 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 82/173] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:31 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1281 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:10:31.873106 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f78e5ded-6ec1-4cab-aeff-b8bd39f85304 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:31.884771 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f78e5ded-6ec1-4cab-aeff-b8bd39f85304 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 200 len: 1507 microversion: 2.1 time: 0.629256 Feb 21 01:10:31.885358 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 92/174] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:31 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 1507 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:31.922940 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-12cca2cc-ce23-4917-b99b-fe5d0411ba15 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c88b186c-bcb2-4523-8702-d4721574a157"}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:10:31.924910 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-12cca2cc-ce23-4917-b99b-fe5d0411ba15 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:31.933224 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-12cca2cc-ce23-4917-b99b-fe5d0411ba15 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:31.934036 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-12cca2cc-ce23-4917-b99b-fe5d0411ba15 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:31.935358 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-12cca2cc-ce23-4917-b99b-fe5d0411ba15 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:31.942197 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-12cca2cc-ce23-4917-b99b-fe5d0411ba15 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:32.145755 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.wsgi [None req-12cca2cc-ce23-4917-b99b-fe5d0411ba15 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] HTTP exception thrown: Invalid volume: volume c88b186c-bcb2-4523-8702-d4721574a157 is already attached to instances: 9aa6aec1-9bd9-4713-aec8-c472d32aac72 Feb 21 01:10:32.145755 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-12cca2cc-ce23-4917-b99b-fe5d0411ba15 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Returning 400 to user: Invalid volume: volume c88b186c-bcb2-4523-8702-d4721574a157 is already attached to instances: 9aa6aec1-9bd9-4713-aec8-c472d32aac72 {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:10:32.145755 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-12cca2cc-ce23-4917-b99b-fe5d0411ba15 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "POST /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.246470 Feb 21 01:10:32.153514 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 83/175] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Feb 21 01:10:31 2022] POST /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6/os-volume_attachments => generated 174 bytes in 252 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:10:32.266458 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0c44f46e-1793-4397-96a8-80592926b21c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:32.266905 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0c44f46e-1793-4397-96a8-80592926b21c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:32.276180 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0c44f46e-1793-4397-96a8-80592926b21c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:32.283408 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0c44f46e-1793-4397-96a8-80592926b21c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:32.286365 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0c44f46e-1793-4397-96a8-80592926b21c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:32.289528 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0c44f46e-1793-4397-96a8-80592926b21c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:32.348716 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b680e255-40eb-41d7-a141-798d6abda79f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:32.349453 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b680e255-40eb-41d7-a141-798d6abda79f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:32.362844 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b680e255-40eb-41d7-a141-798d6abda79f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:32.365590 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b680e255-40eb-41d7-a141-798d6abda79f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:32.366757 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b680e255-40eb-41d7-a141-798d6abda79f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:32.367353 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b680e255-40eb-41d7-a141-798d6abda79f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:32.670942 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0c44f46e-1793-4397-96a8-80592926b21c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:32.680886 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.objects.instance [None req-b680e255-40eb-41d7-a141-798d6abda79f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lazy-loading 'services' on Instance uuid 9aa6aec1-9bd9-4713-aec8-c472d32aac72 {{(pid=117138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:10:32.682098 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0c44f46e-1793-4397-96a8-80592926b21c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.420084 Feb 21 01:10:32.684800 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 93/176] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:32 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:32.739794 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-658abf5e-5413-482b-ae06-52be0d8a07b2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:32.740800 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-658abf5e-5413-482b-ae06-52be0d8a07b2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:32.843501 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-658abf5e-5413-482b-ae06-52be0d8a07b2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:32.852688 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-658abf5e-5413-482b-ae06-52be0d8a07b2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:32.854803 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-658abf5e-5413-482b-ae06-52be0d8a07b2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:32.859727 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-658abf5e-5413-482b-ae06-52be0d8a07b2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1281 microversion: 2.20 time: 0.124854 Feb 21 01:10:32.873206 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 94/177] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:32 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1281 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:10:33.046092 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b680e255-40eb-41d7-a141-798d6abda79f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "DELETE /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72/os-volume_attachments/c88b186c-bcb2-4523-8702-d4721574a157" status: 202 len: 0 microversion: 2.1 time: 0.701127 Feb 21 01:10:33.046750 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 84/178] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Feb 21 01:10:32 2022] DELETE /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72/os-volume_attachments/c88b186c-bcb2-4523-8702-d4721574a157 => generated 0 bytes in 703 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:10:33.056108 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e8b94258-dae3-4587-89a1-072754eab2e5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:33.057296 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e8b94258-dae3-4587-89a1-072754eab2e5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:33.067072 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e8b94258-dae3-4587-89a1-072754eab2e5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:33.067486 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e8b94258-dae3-4587-89a1-072754eab2e5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:33.071561 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e8b94258-dae3-4587-89a1-072754eab2e5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:33.072386 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e8b94258-dae3-4587-89a1-072754eab2e5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:33.120763 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e8b94258-dae3-4587-89a1-072754eab2e5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069244 Feb 21 01:10:33.124864 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 95/179] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:10:33 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:10:33.703801 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8f1d75dd-bd7e-4f34-a126-8c71a883adad tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:33.704507 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8f1d75dd-bd7e-4f34-a126-8c71a883adad tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:33.722901 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8f1d75dd-bd7e-4f34-a126-8c71a883adad tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:33.723623 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8f1d75dd-bd7e-4f34-a126-8c71a883adad tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:33.736865 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8f1d75dd-bd7e-4f34-a126-8c71a883adad tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:33.737394 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8f1d75dd-bd7e-4f34-a126-8c71a883adad tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:33.879924 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9916106b-7d51-4d43-84fc-1f57eceeb5e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:33.880567 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9916106b-7d51-4d43-84fc-1f57eceeb5e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:33.889811 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9916106b-7d51-4d43-84fc-1f57eceeb5e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:33.890555 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9916106b-7d51-4d43-84fc-1f57eceeb5e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:33.891636 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9916106b-7d51-4d43-84fc-1f57eceeb5e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:33.892298 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9916106b-7d51-4d43-84fc-1f57eceeb5e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:33.982180 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9916106b-7d51-4d43-84fc-1f57eceeb5e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:33.998261 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9916106b-7d51-4d43-84fc-1f57eceeb5e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:34.000366 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9916106b-7d51-4d43-84fc-1f57eceeb5e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:34.001949 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9916106b-7d51-4d43-84fc-1f57eceeb5e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1333 microversion: 2.20 time: 0.127224 Feb 21 01:10:34.004086 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 96/180] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:33 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1333 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:10:34.135456 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0a91f31a-fb77-493c-9ef6-f863cbcf2deb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:34.136589 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0a91f31a-fb77-493c-9ef6-f863cbcf2deb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:34.145593 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a91f31a-fb77-493c-9ef6-f863cbcf2deb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:34.146175 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a91f31a-fb77-493c-9ef6-f863cbcf2deb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:34.147233 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a91f31a-fb77-493c-9ef6-f863cbcf2deb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:34.148140 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a91f31a-fb77-493c-9ef6-f863cbcf2deb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:34.202615 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0a91f31a-fb77-493c-9ef6-f863cbcf2deb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071982 Feb 21 01:10:34.210899 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 97/181] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:10:34 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:10:34.228313 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8f1d75dd-bd7e-4f34-a126-8c71a883adad tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:34.248390 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8f1d75dd-bd7e-4f34-a126-8c71a883adad tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.549371 Feb 21 01:10:34.261636 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 85/182] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:33 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:35.026647 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-891b0c7e-e378-45ad-bd15-6c96d4f404a1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:35.027270 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-891b0c7e-e378-45ad-bd15-6c96d4f404a1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:35.051040 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-891b0c7e-e378-45ad-bd15-6c96d4f404a1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:35.051494 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-891b0c7e-e378-45ad-bd15-6c96d4f404a1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:35.052339 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-891b0c7e-e378-45ad-bd15-6c96d4f404a1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:35.052773 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-891b0c7e-e378-45ad-bd15-6c96d4f404a1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:35.179109 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-891b0c7e-e378-45ad-bd15-6c96d4f404a1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:35.189923 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-891b0c7e-e378-45ad-bd15-6c96d4f404a1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:35.194077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-891b0c7e-e378-45ad-bd15-6c96d4f404a1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:35.197325 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-891b0c7e-e378-45ad-bd15-6c96d4f404a1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1339 microversion: 2.20 time: 0.179937 Feb 21 01:10:35.198441 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 98/183] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:35 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1339 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:10:35.233200 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cfb88e76-1ca1-4c69-ba44-22cebef53ef6 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:35.240670 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cfb88e76-1ca1-4c69-ba44-22cebef53ef6 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:35.266780 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cfb88e76-1ca1-4c69-ba44-22cebef53ef6 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:35.269014 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cfb88e76-1ca1-4c69-ba44-22cebef53ef6 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:35.270597 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7869c07f-4f1a-4e49-ba86-c0c003165317 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:35.277197 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7869c07f-4f1a-4e49-ba86-c0c003165317 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:35.277662 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cfb88e76-1ca1-4c69-ba44-22cebef53ef6 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:35.277662 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cfb88e76-1ca1-4c69-ba44-22cebef53ef6 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:35.285356 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7869c07f-4f1a-4e49-ba86-c0c003165317 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:35.287123 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7869c07f-4f1a-4e49-ba86-c0c003165317 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:35.290635 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7869c07f-4f1a-4e49-ba86-c0c003165317 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:35.291582 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7869c07f-4f1a-4e49-ba86-c0c003165317 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:35.354630 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cfb88e76-1ca1-4c69-ba44-22cebef53ef6 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.143639 Feb 21 01:10:35.361407 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 86/184] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:10:35 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72/os-volume_attachments => generated 25 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 01:10:35.599495 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7869c07f-4f1a-4e49-ba86-c0c003165317 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:35.607147 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7869c07f-4f1a-4e49-ba86-c0c003165317 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.342818 Feb 21 01:10:35.616696 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 99/185] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:35 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:10:35.817185 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ec866b68-e777-4e31-ac2a-1f658f946862 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-537648380", "imageRef": "9b96cc67-20b9-414f-8afb-039ff7953adc", "flavorRef": "452", "networks": [{"uuid": "8d88ddc9-10c8-4356-a5fc-74ca444968a9"}]}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:10:35.925453 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.network.neutron [None req-ec866b68-e777-4e31-ac2a-1f658f946862 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] validate_networks() for [('8d88ddc9-10c8-4356-a5fc-74ca444968a9', None, None, None, None, None)] {{(pid=117138) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:10:36.218466 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-900ab8d4-9cd2-4cfc-ac38-83fb897332c6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:36.219249 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-900ab8d4-9cd2-4cfc-ac38-83fb897332c6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:36.233945 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-900ab8d4-9cd2-4cfc-ac38-83fb897332c6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:36.234833 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-900ab8d4-9cd2-4cfc-ac38-83fb897332c6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:36.236625 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-900ab8d4-9cd2-4cfc-ac38-83fb897332c6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:36.237463 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-900ab8d4-9cd2-4cfc-ac38-83fb897332c6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:36.482174 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-ec866b68-e777-4e31-ac2a-1f658f946862 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Flavor limits 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:10:36.482782 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-ec866b68-e777-4e31-ac2a-1f658f946862 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Image limits 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:10:36.483724 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-ec866b68-e777-4e31-ac2a-1f658f946862 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Flavor pref 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:10:36.484205 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-ec866b68-e777-4e31-ac2a-1f658f946862 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Image pref 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:10:36.484626 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-ec866b68-e777-4e31-ac2a-1f658f946862 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:10:36.498995 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec866b68-e777-4e31-ac2a-1f658f946862 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:36.499611 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec866b68-e777-4e31-ac2a-1f658f946862 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:36.501027 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec866b68-e777-4e31-ac2a-1f658f946862 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:36.501833 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec866b68-e777-4e31-ac2a-1f658f946862 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:36.556664 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-ec866b68-e777-4e31-ac2a-1f658f946862 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Getting quotas for project 24c1bf236b2f4eb1bffab124b7392ca5. Resources: {'ram', 'cores', 'instances'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:10:36.569752 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-ec866b68-e777-4e31-ac2a-1f658f946862 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Getting quotas for user 70516383f3b14d5283462803cac26d8b and project 24c1bf236b2f4eb1bffab124b7392ca5. Resources: {'ram', 'cores', 'instances'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:10:36.592646 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ec866b68-e777-4e31-ac2a-1f658f946862 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Going to run 1 instances... {{(pid=117138) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:10:36.596205 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ec866b68-e777-4e31-ac2a-1f658f946862 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b96cc67-20b9-414f-8afb-039ff7953adc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117138) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:10:36.620787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-900ab8d4-9cd2-4cfc-ac38-83fb897332c6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:36.629965 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-900ab8d4-9cd2-4cfc-ac38-83fb897332c6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:36.632145 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-900ab8d4-9cd2-4cfc-ac38-83fb897332c6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:36.633516 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-900ab8d4-9cd2-4cfc-ac38-83fb897332c6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1407 microversion: 2.20 time: 0.420263 Feb 21 01:10:36.645192 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 100/186] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:36 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1407 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:10:36.653864 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3c1e030d-846f-4b56-af17-62dbd5c95094 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:36.654820 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3c1e030d-846f-4b56-af17-62dbd5c95094 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:36.663954 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3c1e030d-846f-4b56-af17-62dbd5c95094 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:36.664442 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3c1e030d-846f-4b56-af17-62dbd5c95094 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:36.665291 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3c1e030d-846f-4b56-af17-62dbd5c95094 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:36.665740 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3c1e030d-846f-4b56-af17-62dbd5c95094 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:36.748197 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ec866b68-e777-4e31-ac2a-1f658f946862 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.937080 Feb 21 01:10:36.749189 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 87/187] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Feb 21 01:10:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:10:36.759035 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6dce5c9d-5c9f-466d-a9cb-2339cc21e186 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:36.760076 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6dce5c9d-5c9f-466d-a9cb-2339cc21e186 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:36.918697 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6dce5c9d-5c9f-466d-a9cb-2339cc21e186 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:36.932378 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6dce5c9d-5c9f-466d-a9cb-2339cc21e186 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1217 microversion: 2.1 time: 0.172742 Feb 21 01:10:36.933609 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 88/188] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:36 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1217 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:37.012002 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3c1e030d-846f-4b56-af17-62dbd5c95094 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:37.024554 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3c1e030d-846f-4b56-af17-62dbd5c95094 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.376369 Feb 21 01:10:37.025380 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 101/189] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:36 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:37.653324 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-42cf239d-3add-43ff-aa2f-903e58a6cf16 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:37.654634 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-42cf239d-3add-43ff-aa2f-903e58a6cf16 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:37.667978 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-42cf239d-3add-43ff-aa2f-903e58a6cf16 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:37.668743 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-42cf239d-3add-43ff-aa2f-903e58a6cf16 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:37.671480 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-42cf239d-3add-43ff-aa2f-903e58a6cf16 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:37.672267 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-42cf239d-3add-43ff-aa2f-903e58a6cf16 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:37.930007 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-42cf239d-3add-43ff-aa2f-903e58a6cf16 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:37.941223 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-42cf239d-3add-43ff-aa2f-903e58a6cf16 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:37.942397 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-42cf239d-3add-43ff-aa2f-903e58a6cf16 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:37.946182 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-42cf239d-3add-43ff-aa2f-903e58a6cf16 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1407 microversion: 2.20 time: 0.298545 Feb 21 01:10:37.947373 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 89/190] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:37 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:10:37.949906 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-187ce6bb-017d-4cb8-baed-07b4c4573ba6 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:37.950584 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-187ce6bb-017d-4cb8-baed-07b4c4573ba6 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:37.958185 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-187ce6bb-017d-4cb8-baed-07b4c4573ba6 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:37.958942 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-187ce6bb-017d-4cb8-baed-07b4c4573ba6 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:37.959930 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-187ce6bb-017d-4cb8-baed-07b4c4573ba6 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:37.960544 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-187ce6bb-017d-4cb8-baed-07b4c4573ba6 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:38.036766 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-187ce6bb-017d-4cb8-baed-07b4c4573ba6 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:38.042645 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-bb7559bf-d7e8-44ec-adb7-18625ee0f0ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:38.043785 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-bb7559bf-d7e8-44ec-adb7-18625ee0f0ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:38.050533 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bb7559bf-d7e8-44ec-adb7-18625ee0f0ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:38.052269 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bb7559bf-d7e8-44ec-adb7-18625ee0f0ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:38.052410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-187ce6bb-017d-4cb8-baed-07b4c4573ba6 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1221 microversion: 2.1 time: 0.106161 Feb 21 01:10:38.053517 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bb7559bf-d7e8-44ec-adb7-18625ee0f0ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:38.062580 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 102/191] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:37 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1221 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:38.063642 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bb7559bf-d7e8-44ec-adb7-18625ee0f0ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:38.371108 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bb7559bf-d7e8-44ec-adb7-18625ee0f0ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:38.387053 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-bb7559bf-d7e8-44ec-adb7-18625ee0f0ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.347554 Feb 21 01:10:38.390155 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 90/192] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:38 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:10:38.977131 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b7613a5b-8cca-44b0-bf38-93cfd25936f2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:39.000951 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b7613a5b-8cca-44b0-bf38-93cfd25936f2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:39.030791 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b7613a5b-8cca-44b0-bf38-93cfd25936f2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:39.042818 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b7613a5b-8cca-44b0-bf38-93cfd25936f2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:39.042818 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b7613a5b-8cca-44b0-bf38-93cfd25936f2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:39.042818 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b7613a5b-8cca-44b0-bf38-93cfd25936f2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:39.072634 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a861d87e-a712-4b31-8b84-fb34b94e4ff9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:39.074452 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a861d87e-a712-4b31-8b84-fb34b94e4ff9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:39.112940 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a861d87e-a712-4b31-8b84-fb34b94e4ff9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:39.117606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a861d87e-a712-4b31-8b84-fb34b94e4ff9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:39.125564 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a861d87e-a712-4b31-8b84-fb34b94e4ff9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:39.126076 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a861d87e-a712-4b31-8b84-fb34b94e4ff9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:39.348824 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a861d87e-a712-4b31-8b84-fb34b94e4ff9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:39.357732 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a861d87e-a712-4b31-8b84-fb34b94e4ff9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1269 microversion: 2.1 time: 0.290756 Feb 21 01:10:39.362052 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 91/193] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:39 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1269 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:39.372544 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-dcd5c17f-e50a-4294-9be5-9276931c5bd5 req-f4b170f6-09f0-4868-ac39-3f3b1dfb9560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2aa103a-4f89-45a6-8c62-09282555e3b3", "tag": "17542d9a-ec16-46b0-907e-71f3f5221834"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:10:39.378709 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:10:39.378709 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:10:39.397186 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-dcd5c17f-e50a-4294-9be5-9276931c5bd5 req-f4b170f6-09f0-4868-ac39-3f3b1dfb9560 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:39.401235 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-dcd5c17f-e50a-4294-9be5-9276931c5bd5 req-f4b170f6-09f0-4868-ac39-3f3b1dfb9560 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:39.443347 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-dcd5c17f-e50a-4294-9be5-9276931c5bd5 req-f4b170f6-09f0-4868-ac39-3f3b1dfb9560 service nova] Creating event network-changed:17542d9a-ec16-46b0-907e-71f3f5221834 for instance e2aa103a-4f89-45a6-8c62-09282555e3b3 on hv-cinder-81322 Feb 21 01:10:39.449650 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-dcd5c17f-e50a-4294-9be5-9276931c5bd5 req-f4b170f6-09f0-4868-ac39-3f3b1dfb9560 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086168 Feb 21 01:10:39.450522 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 92/194] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:10:39.461389 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8dd2b6c5-53de-4d8e-9a20-8963785ecae5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:39.465182 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8dd2b6c5-53de-4d8e-9a20-8963785ecae5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:39.482482 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8dd2b6c5-53de-4d8e-9a20-8963785ecae5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:39.483167 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8dd2b6c5-53de-4d8e-9a20-8963785ecae5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:39.484206 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8dd2b6c5-53de-4d8e-9a20-8963785ecae5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:39.484788 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8dd2b6c5-53de-4d8e-9a20-8963785ecae5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:39.787278 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b7613a5b-8cca-44b0-bf38-93cfd25936f2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:39.809018 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b7613a5b-8cca-44b0-bf38-93cfd25936f2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:39.812022 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b7613a5b-8cca-44b0-bf38-93cfd25936f2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:39.813882 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b7613a5b-8cca-44b0-bf38-93cfd25936f2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1407 microversion: 2.20 time: 0.846152 Feb 21 01:10:39.815896 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 103/195] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:38 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1407 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:10:40.080604 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8dd2b6c5-53de-4d8e-9a20-8963785ecae5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:40.095349 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8dd2b6c5-53de-4d8e-9a20-8963785ecae5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.643283 Feb 21 01:10:40.098846 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 93/196] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:39 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:40.378501 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-df82c35b-57c2-40af-8ba7-bc7688ad90e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:40.379405 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-df82c35b-57c2-40af-8ba7-bc7688ad90e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:40.387164 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-df82c35b-57c2-40af-8ba7-bc7688ad90e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:40.387812 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-df82c35b-57c2-40af-8ba7-bc7688ad90e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:40.388724 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-df82c35b-57c2-40af-8ba7-bc7688ad90e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:40.389257 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-df82c35b-57c2-40af-8ba7-bc7688ad90e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:40.563576 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-df82c35b-57c2-40af-8ba7-bc7688ad90e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:40.563576 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-df82c35b-57c2-40af-8ba7-bc7688ad90e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1287 microversion: 2.1 time: 0.183456 Feb 21 01:10:40.563576 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 104/197] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:40 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1287 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:40.833092 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7f85ac75-a9fa-41d3-a7fd-b388d25676d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:40.837343 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7f85ac75-a9fa-41d3-a7fd-b388d25676d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:40.855355 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7f85ac75-a9fa-41d3-a7fd-b388d25676d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:40.856087 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7f85ac75-a9fa-41d3-a7fd-b388d25676d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:40.857239 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7f85ac75-a9fa-41d3-a7fd-b388d25676d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:40.858254 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7f85ac75-a9fa-41d3-a7fd-b388d25676d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:41.113614 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b684f240-a4cf-4518-b1eb-5071e3086840 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:41.116116 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b684f240-a4cf-4518-b1eb-5071e3086840 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:41.125259 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b684f240-a4cf-4518-b1eb-5071e3086840 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:41.127605 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b684f240-a4cf-4518-b1eb-5071e3086840 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:41.128705 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b684f240-a4cf-4518-b1eb-5071e3086840 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:41.129908 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b684f240-a4cf-4518-b1eb-5071e3086840 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:41.199483 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7f85ac75-a9fa-41d3-a7fd-b388d25676d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:41.213376 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7f85ac75-a9fa-41d3-a7fd-b388d25676d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:41.215397 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7f85ac75-a9fa-41d3-a7fd-b388d25676d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:41.217191 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7f85ac75-a9fa-41d3-a7fd-b388d25676d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1407 microversion: 2.20 time: 0.388654 Feb 21 01:10:41.231112 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 94/198] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:40 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:10:41.574526 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2ec67ac4-227d-4d9f-90f1-a98032addb5b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:41.575571 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2ec67ac4-227d-4d9f-90f1-a98032addb5b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:41.586985 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2ec67ac4-227d-4d9f-90f1-a98032addb5b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:41.587450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2ec67ac4-227d-4d9f-90f1-a98032addb5b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:41.588294 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2ec67ac4-227d-4d9f-90f1-a98032addb5b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:41.593183 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2ec67ac4-227d-4d9f-90f1-a98032addb5b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:41.674065 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b684f240-a4cf-4518-b1eb-5071e3086840 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:41.686554 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b684f240-a4cf-4518-b1eb-5071e3086840 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.576770 Feb 21 01:10:41.697452 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 105/199] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:41 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:41.936814 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2ec67ac4-227d-4d9f-90f1-a98032addb5b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:41.944776 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2ec67ac4-227d-4d9f-90f1-a98032addb5b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1317 microversion: 2.1 time: 0.374101 Feb 21 01:10:41.945351 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 95/200] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:41 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:10:42.237468 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b181523b-fe13-40a6-be85-057485736e99 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:42.238512 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b181523b-fe13-40a6-be85-057485736e99 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:42.245501 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b181523b-fe13-40a6-be85-057485736e99 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:42.248642 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b181523b-fe13-40a6-be85-057485736e99 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:42.248642 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b181523b-fe13-40a6-be85-057485736e99 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:42.248642 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b181523b-fe13-40a6-be85-057485736e99 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:42.439493 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b181523b-fe13-40a6-be85-057485736e99 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:42.448352 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b181523b-fe13-40a6-be85-057485736e99 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:42.450292 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b181523b-fe13-40a6-be85-057485736e99 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:42.451414 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b181523b-fe13-40a6-be85-057485736e99 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1407 microversion: 2.20 time: 0.219125 Feb 21 01:10:42.452194 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 106/201] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:42 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:10:42.704297 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-eacfa7dc-b873-4d2f-8601-c1b23987ec6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:42.705465 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-eacfa7dc-b873-4d2f-8601-c1b23987ec6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:42.711579 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eacfa7dc-b873-4d2f-8601-c1b23987ec6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:42.712068 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eacfa7dc-b873-4d2f-8601-c1b23987ec6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:42.713123 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eacfa7dc-b873-4d2f-8601-c1b23987ec6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:42.713557 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eacfa7dc-b873-4d2f-8601-c1b23987ec6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:42.962241 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0fee3cc0-3b53-40dd-98b0-d9e4d2676451 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:42.963066 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0fee3cc0-3b53-40dd-98b0-d9e4d2676451 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:42.969154 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0fee3cc0-3b53-40dd-98b0-d9e4d2676451 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:42.969653 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0fee3cc0-3b53-40dd-98b0-d9e4d2676451 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:42.971240 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0fee3cc0-3b53-40dd-98b0-d9e4d2676451 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:42.971774 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0fee3cc0-3b53-40dd-98b0-d9e4d2676451 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:42.979308 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-eacfa7dc-b873-4d2f-8601-c1b23987ec6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:42.989218 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-eacfa7dc-b873-4d2f-8601-c1b23987ec6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.288502 Feb 21 01:10:42.990210 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 96/202] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:42 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:43.192400 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0fee3cc0-3b53-40dd-98b0-d9e4d2676451 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:43.199970 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0fee3cc0-3b53-40dd-98b0-d9e4d2676451 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1317 microversion: 2.1 time: 0.242018 Feb 21 01:10:43.208350 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 107/203] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:42 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:10:43.469086 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-62283548-f2b0-4cdd-aac2-0332e5b49bd4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:43.469704 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-62283548-f2b0-4cdd-aac2-0332e5b49bd4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:43.481567 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-62283548-f2b0-4cdd-aac2-0332e5b49bd4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:43.486868 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-62283548-f2b0-4cdd-aac2-0332e5b49bd4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:43.492419 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-62283548-f2b0-4cdd-aac2-0332e5b49bd4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:43.493111 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-62283548-f2b0-4cdd-aac2-0332e5b49bd4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:43.826706 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-62283548-f2b0-4cdd-aac2-0332e5b49bd4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:43.872027 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-62283548-f2b0-4cdd-aac2-0332e5b49bd4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:43.875226 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-62283548-f2b0-4cdd-aac2-0332e5b49bd4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:43.876998 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-62283548-f2b0-4cdd-aac2-0332e5b49bd4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1407 microversion: 2.20 time: 0.411197 Feb 21 01:10:43.879990 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 97/204] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:43 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1407 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:10:44.006671 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e3701cbe-01d3-4dae-a17a-3ed57fde3e5f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:44.008839 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e3701cbe-01d3-4dae-a17a-3ed57fde3e5f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:44.019339 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e3701cbe-01d3-4dae-a17a-3ed57fde3e5f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:44.020045 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e3701cbe-01d3-4dae-a17a-3ed57fde3e5f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:44.021557 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e3701cbe-01d3-4dae-a17a-3ed57fde3e5f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:44.022475 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e3701cbe-01d3-4dae-a17a-3ed57fde3e5f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:44.227177 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a2e4f36e-6582-4944-b80d-792b134fdb3e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:44.227908 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a2e4f36e-6582-4944-b80d-792b134fdb3e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:44.235056 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a2e4f36e-6582-4944-b80d-792b134fdb3e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:44.235508 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a2e4f36e-6582-4944-b80d-792b134fdb3e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:44.237239 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a2e4f36e-6582-4944-b80d-792b134fdb3e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:44.237828 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a2e4f36e-6582-4944-b80d-792b134fdb3e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:44.364043 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e3701cbe-01d3-4dae-a17a-3ed57fde3e5f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:44.374672 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e3701cbe-01d3-4dae-a17a-3ed57fde3e5f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.371533 Feb 21 01:10:44.375270 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 108/205] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:44 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:44.626220 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a2e4f36e-6582-4944-b80d-792b134fdb3e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:44.639984 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a2e4f36e-6582-4944-b80d-792b134fdb3e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1317 microversion: 2.1 time: 0.424764 Feb 21 01:10:44.640836 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 98/206] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:44 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:44.899613 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8af9ac9d-ff93-4326-bd01-956d1351a6a0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:44.900255 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8af9ac9d-ff93-4326-bd01-956d1351a6a0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:44.914480 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8af9ac9d-ff93-4326-bd01-956d1351a6a0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:44.915037 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8af9ac9d-ff93-4326-bd01-956d1351a6a0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:44.915946 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8af9ac9d-ff93-4326-bd01-956d1351a6a0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:44.916578 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8af9ac9d-ff93-4326-bd01-956d1351a6a0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:45.348655 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8af9ac9d-ff93-4326-bd01-956d1351a6a0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:45.361920 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8af9ac9d-ff93-4326-bd01-956d1351a6a0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:45.363750 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8af9ac9d-ff93-4326-bd01-956d1351a6a0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:45.365887 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8af9ac9d-ff93-4326-bd01-956d1351a6a0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1407 microversion: 2.20 time: 0.469056 Feb 21 01:10:45.366461 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 109/207] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:44 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1407 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:10:45.373403 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-85760e1b-0ae8-4183-846a-e9db8a6e0af0 req-4219fd22-2c6e-4907-9105-cc4d5e459aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9", "tag": "a9b8b6b3-10bd-46a7-af49-ecb93114aab6"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:10:45.376008 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:10:45.376008 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:10:45.416350 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-85760e1b-0ae8-4183-846a-e9db8a6e0af0 req-4219fd22-2c6e-4907-9105-cc4d5e459aa8 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:45.417132 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-85760e1b-0ae8-4183-846a-e9db8a6e0af0 req-4219fd22-2c6e-4907-9105-cc4d5e459aa8 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:45.432582 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-85760e1b-0ae8-4183-846a-e9db8a6e0af0 req-4219fd22-2c6e-4907-9105-cc4d5e459aa8 service nova] Creating event network-changed:a9b8b6b3-10bd-46a7-af49-ecb93114aab6 for instance 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 on hv-cinder-81322 Feb 21 01:10:45.440538 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-85760e1b-0ae8-4183-846a-e9db8a6e0af0 req-4219fd22-2c6e-4907-9105-cc4d5e459aa8 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070356 Feb 21 01:10:45.440538 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 110/208] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:10:45.453525 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f5caccf3-a522-4bb2-b6b4-48872405432e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:45.453966 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f5caccf3-a522-4bb2-b6b4-48872405432e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:45.472125 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f5caccf3-a522-4bb2-b6b4-48872405432e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:45.474985 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f5caccf3-a522-4bb2-b6b4-48872405432e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:45.476096 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f5caccf3-a522-4bb2-b6b4-48872405432e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:45.476721 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f5caccf3-a522-4bb2-b6b4-48872405432e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:45.595998 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-025fb379-8561-4850-af24-e1c208a75078 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Action: 'create', calling method: .version_select at 0x7f4acf227310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-74044564"}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:10:45.622546 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-025fb379-8561-4850-af24-e1c208a75078 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Getting quotas for project 0c96b1f3aaed4700a792cf9d25aaaca3. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:10:45.628318 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-025fb379-8561-4850-af24-e1c208a75078 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Getting quotas for user 6f525569d9ed4d61926ddad83a270032 and project 0c96b1f3aaed4700a792cf9d25aaaca3. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:10:45.762965 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f5caccf3-a522-4bb2-b6b4-48872405432e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:45.774525 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f5caccf3-a522-4bb2-b6b4-48872405432e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.332944 Feb 21 01:10:45.775375 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 111/209] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:45 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:45.781178 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-96a0d6d4-4c18-4023-8b10-c6de8ce051fd tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:45.781990 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-96a0d6d4-4c18-4023-8b10-c6de8ce051fd tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:45.793009 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-96a0d6d4-4c18-4023-8b10-c6de8ce051fd tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:45.793489 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-96a0d6d4-4c18-4023-8b10-c6de8ce051fd tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:45.794326 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-96a0d6d4-4c18-4023-8b10-c6de8ce051fd tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:45.794759 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-96a0d6d4-4c18-4023-8b10-c6de8ce051fd tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:45.888935 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-025fb379-8561-4850-af24-e1c208a75078 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Getting quotas for project 0c96b1f3aaed4700a792cf9d25aaaca3. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:10:45.896961 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-025fb379-8561-4850-af24-e1c208a75078 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Getting quotas for user 6f525569d9ed4d61926ddad83a270032 and project 0c96b1f3aaed4700a792cf9d25aaaca3. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:10:45.913817 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-025fb379-8561-4850-af24-e1c208a75078 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.711498 Feb 21 01:10:45.914730 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 99/210] 10.222.0.91 () {60 vars in 1157 bytes} [Mon Feb 21 01:10:45 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:45.964233 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-96a0d6d4-4c18-4023-8b10-c6de8ce051fd tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:45.980652 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-96a0d6d4-4c18-4023-8b10-c6de8ce051fd tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1317 microversion: 2.1 time: 0.203033 Feb 21 01:10:45.981800 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 112/211] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:45 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:46.394073 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5ac47d5d-a304-4d62-9c4d-17cd704820ca tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:46.395552 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5ac47d5d-a304-4d62-9c4d-17cd704820ca tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:46.407561 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5ac47d5d-a304-4d62-9c4d-17cd704820ca tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:46.409740 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5ac47d5d-a304-4d62-9c4d-17cd704820ca tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:46.410968 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5ac47d5d-a304-4d62-9c4d-17cd704820ca tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:46.411649 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5ac47d5d-a304-4d62-9c4d-17cd704820ca tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:46.582373 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5ac47d5d-a304-4d62-9c4d-17cd704820ca tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:46.591732 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5ac47d5d-a304-4d62-9c4d-17cd704820ca tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:46.593525 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5ac47d5d-a304-4d62-9c4d-17cd704820ca tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:46.594851 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5ac47d5d-a304-4d62-9c4d-17cd704820ca tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1407 microversion: 2.20 time: 0.212868 Feb 21 01:10:46.596632 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 100/212] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:46 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:10:46.791674 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1fd33f7b-ab5a-43ef-a67e-381db21f4465 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:46.792598 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1fd33f7b-ab5a-43ef-a67e-381db21f4465 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:46.799766 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1fd33f7b-ab5a-43ef-a67e-381db21f4465 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:46.800669 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1fd33f7b-ab5a-43ef-a67e-381db21f4465 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:46.801290 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1fd33f7b-ab5a-43ef-a67e-381db21f4465 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:46.802924 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1fd33f7b-ab5a-43ef-a67e-381db21f4465 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:46.976475 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1fd33f7b-ab5a-43ef-a67e-381db21f4465 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:46.984571 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1fd33f7b-ab5a-43ef-a67e-381db21f4465 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.196798 Feb 21 01:10:46.985145 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 113/213] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:46 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:47.004908 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-22e6b293-19ff-4c55-a994-4e0f3f6c60b4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:47.011053 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-22e6b293-19ff-4c55-a994-4e0f3f6c60b4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:47.011886 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-22e6b293-19ff-4c55-a994-4e0f3f6c60b4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:47.012554 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-22e6b293-19ff-4c55-a994-4e0f3f6c60b4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:47.013627 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-22e6b293-19ff-4c55-a994-4e0f3f6c60b4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:47.014263 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-22e6b293-19ff-4c55-a994-4e0f3f6c60b4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:47.272704 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-22e6b293-19ff-4c55-a994-4e0f3f6c60b4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:47.282332 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-22e6b293-19ff-4c55-a994-4e0f3f6c60b4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1317 microversion: 2.1 time: 0.284373 Feb 21 01:10:47.283244 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 101/214] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:46 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:47.625255 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-13820d5f-392f-412e-bbe4-0cc17699666d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:47.626854 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-13820d5f-392f-412e-bbe4-0cc17699666d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:47.636288 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-13820d5f-392f-412e-bbe4-0cc17699666d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:47.637010 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-13820d5f-392f-412e-bbe4-0cc17699666d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:47.638354 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-13820d5f-392f-412e-bbe4-0cc17699666d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:47.639090 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-13820d5f-392f-412e-bbe4-0cc17699666d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:47.857533 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-13820d5f-392f-412e-bbe4-0cc17699666d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:47.868585 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-13820d5f-392f-412e-bbe4-0cc17699666d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:47.870134 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-13820d5f-392f-412e-bbe4-0cc17699666d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:47.871328 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-13820d5f-392f-412e-bbe4-0cc17699666d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1407 microversion: 2.20 time: 0.260542 Feb 21 01:10:47.875319 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 114/215] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:47 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:10:48.006625 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-20aa371c-4381-4f9f-b596-9320ab582945 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:48.008177 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-20aa371c-4381-4f9f-b596-9320ab582945 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:48.018664 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-20aa371c-4381-4f9f-b596-9320ab582945 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:48.019632 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-20aa371c-4381-4f9f-b596-9320ab582945 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:48.021106 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-20aa371c-4381-4f9f-b596-9320ab582945 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:48.022031 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-20aa371c-4381-4f9f-b596-9320ab582945 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:48.209503 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-20aa371c-4381-4f9f-b596-9320ab582945 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:48.224711 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-20aa371c-4381-4f9f-b596-9320ab582945 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.221919 Feb 21 01:10:48.225654 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 102/216] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:48 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:48.300461 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ff5e972e-9f4b-4938-99f1-5b6d23c89bf4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:48.301152 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ff5e972e-9f4b-4938-99f1-5b6d23c89bf4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:48.308130 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ff5e972e-9f4b-4938-99f1-5b6d23c89bf4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:48.308585 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ff5e972e-9f4b-4938-99f1-5b6d23c89bf4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:48.310185 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ff5e972e-9f4b-4938-99f1-5b6d23c89bf4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:48.310185 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ff5e972e-9f4b-4938-99f1-5b6d23c89bf4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:48.626520 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ff5e972e-9f4b-4938-99f1-5b6d23c89bf4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:48.635256 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ff5e972e-9f4b-4938-99f1-5b6d23c89bf4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1317 microversion: 2.1 time: 0.339007 Feb 21 01:10:48.646978 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 115/217] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:48 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:48.892732 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-73cd51e8-cac4-455a-91c8-1cd7b7eaa01f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:48.893477 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-73cd51e8-cac4-455a-91c8-1cd7b7eaa01f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:48.905379 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-73cd51e8-cac4-455a-91c8-1cd7b7eaa01f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:48.907945 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-73cd51e8-cac4-455a-91c8-1cd7b7eaa01f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:48.912351 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-73cd51e8-cac4-455a-91c8-1cd7b7eaa01f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:48.912884 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-73cd51e8-cac4-455a-91c8-1cd7b7eaa01f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:49.155054 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-73cd51e8-cac4-455a-91c8-1cd7b7eaa01f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:49.175386 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-73cd51e8-cac4-455a-91c8-1cd7b7eaa01f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:49.180443 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-73cd51e8-cac4-455a-91c8-1cd7b7eaa01f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:49.181816 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-73cd51e8-cac4-455a-91c8-1cd7b7eaa01f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1407 microversion: 2.20 time: 0.294390 Feb 21 01:10:49.182400 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 103/218] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:48 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1407 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:10:49.243102 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8fb53e69-7f03-473d-82e2-26432e67c959 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:49.243714 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8fb53e69-7f03-473d-82e2-26432e67c959 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:49.256594 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8fb53e69-7f03-473d-82e2-26432e67c959 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:49.257044 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8fb53e69-7f03-473d-82e2-26432e67c959 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:49.257834 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8fb53e69-7f03-473d-82e2-26432e67c959 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:49.260386 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8fb53e69-7f03-473d-82e2-26432e67c959 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:49.531811 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8fb53e69-7f03-473d-82e2-26432e67c959 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:49.542301 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8fb53e69-7f03-473d-82e2-26432e67c959 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.303430 Feb 21 01:10:49.543380 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 116/219] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:49 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:49.653726 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0b251d26-bcdd-4a93-a2ac-eb05a2a9b1d5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:49.654366 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0b251d26-bcdd-4a93-a2ac-eb05a2a9b1d5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:49.682722 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0b251d26-bcdd-4a93-a2ac-eb05a2a9b1d5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:49.682722 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0b251d26-bcdd-4a93-a2ac-eb05a2a9b1d5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:49.682722 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0b251d26-bcdd-4a93-a2ac-eb05a2a9b1d5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:49.682722 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0b251d26-bcdd-4a93-a2ac-eb05a2a9b1d5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:49.930223 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0b251d26-bcdd-4a93-a2ac-eb05a2a9b1d5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:49.937705 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0b251d26-bcdd-4a93-a2ac-eb05a2a9b1d5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1317 microversion: 2.1 time: 0.288170 Feb 21 01:10:49.938296 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 104/220] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:49 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:50.202627 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a172fea3-6208-47e2-ae98-8bd2ecc76955 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:50.203227 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a172fea3-6208-47e2-ae98-8bd2ecc76955 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:50.210339 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a172fea3-6208-47e2-ae98-8bd2ecc76955 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:50.211012 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a172fea3-6208-47e2-ae98-8bd2ecc76955 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:50.211798 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a172fea3-6208-47e2-ae98-8bd2ecc76955 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:50.212550 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a172fea3-6208-47e2-ae98-8bd2ecc76955 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:50.416623 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a172fea3-6208-47e2-ae98-8bd2ecc76955 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:50.427376 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a172fea3-6208-47e2-ae98-8bd2ecc76955 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:50.430819 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a172fea3-6208-47e2-ae98-8bd2ecc76955 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:50.432622 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a172fea3-6208-47e2-ae98-8bd2ecc76955 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1407 microversion: 2.20 time: 0.233288 Feb 21 01:10:50.449252 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 117/221] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:50 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:10:50.560200 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-341e2a17-786f-4610-9d1c-bd7c1078221b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:50.560808 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-341e2a17-786f-4610-9d1c-bd7c1078221b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:50.567762 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-341e2a17-786f-4610-9d1c-bd7c1078221b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:50.568233 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-341e2a17-786f-4610-9d1c-bd7c1078221b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:50.569095 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-341e2a17-786f-4610-9d1c-bd7c1078221b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:50.569493 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-341e2a17-786f-4610-9d1c-bd7c1078221b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:50.712019 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-341e2a17-786f-4610-9d1c-bd7c1078221b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:50.727380 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-341e2a17-786f-4610-9d1c-bd7c1078221b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.170927 Feb 21 01:10:50.728036 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 105/222] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:50 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:50.955960 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c91997c3-70b9-45fb-977e-52105d7f48cc tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:50.956579 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c91997c3-70b9-45fb-977e-52105d7f48cc tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:50.964810 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c91997c3-70b9-45fb-977e-52105d7f48cc tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:50.965464 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c91997c3-70b9-45fb-977e-52105d7f48cc tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:50.966564 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c91997c3-70b9-45fb-977e-52105d7f48cc tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:50.967263 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c91997c3-70b9-45fb-977e-52105d7f48cc tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:51.114579 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c91997c3-70b9-45fb-977e-52105d7f48cc tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:51.122263 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c91997c3-70b9-45fb-977e-52105d7f48cc tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1317 microversion: 2.1 time: 0.171528 Feb 21 01:10:51.123059 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 118/223] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:50 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:51.450792 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4d46ee9a-055d-4a80-8afc-e9041b5f507a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:51.451438 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4d46ee9a-055d-4a80-8afc-e9041b5f507a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:51.460427 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4d46ee9a-055d-4a80-8afc-e9041b5f507a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:51.460427 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4d46ee9a-055d-4a80-8afc-e9041b5f507a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:51.460427 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4d46ee9a-055d-4a80-8afc-e9041b5f507a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:51.460867 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4d46ee9a-055d-4a80-8afc-e9041b5f507a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:51.558064 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-8dd98bad-26d2-4fb3-84a0-d15208cf2804 req-190584b0-3a20-47a8-a0a7-d0a68edcd494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2aa103a-4f89-45a6-8c62-09282555e3b3", "name": "network-vif-plugged", "status": "completed", "tag": "17542d9a-ec16-46b0-907e-71f3f5221834"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:10:51.559653 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:10:51.559653 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:10:51.569083 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-8dd98bad-26d2-4fb3-84a0-d15208cf2804 req-190584b0-3a20-47a8-a0a7-d0a68edcd494 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:51.569542 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-8dd98bad-26d2-4fb3-84a0-d15208cf2804 req-190584b0-3a20-47a8-a0a7-d0a68edcd494 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:51.581912 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-8dd98bad-26d2-4fb3-84a0-d15208cf2804 req-190584b0-3a20-47a8-a0a7-d0a68edcd494 service nova] Creating event network-vif-plugged:17542d9a-ec16-46b0-907e-71f3f5221834 for instance e2aa103a-4f89-45a6-8c62-09282555e3b3 on hv-cinder-81322 Feb 21 01:10:51.587283 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-8dd98bad-26d2-4fb3-84a0-d15208cf2804 req-190584b0-3a20-47a8-a0a7-d0a68edcd494 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033462 Feb 21 01:10:51.587927 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 119/224] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:10:51.606458 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4d46ee9a-055d-4a80-8afc-e9041b5f507a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:51.614806 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4d46ee9a-055d-4a80-8afc-e9041b5f507a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:51.616444 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4d46ee9a-055d-4a80-8afc-e9041b5f507a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:51.617563 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4d46ee9a-055d-4a80-8afc-e9041b5f507a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1407 microversion: 2.20 time: 0.170806 Feb 21 01:10:51.618141 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 106/225] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:51 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:10:51.745333 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-72c3350b-07c5-40bf-bf70-4f5428612b4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:51.746570 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-72c3350b-07c5-40bf-bf70-4f5428612b4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:51.753391 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-72c3350b-07c5-40bf-bf70-4f5428612b4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:51.753840 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-72c3350b-07c5-40bf-bf70-4f5428612b4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:51.754638 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-72c3350b-07c5-40bf-bf70-4f5428612b4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:51.755069 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-72c3350b-07c5-40bf-bf70-4f5428612b4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:51.912765 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-72c3350b-07c5-40bf-bf70-4f5428612b4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:51.920227 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-72c3350b-07c5-40bf-bf70-4f5428612b4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.178777 Feb 21 01:10:51.920809 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 120/226] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:51 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:52.138926 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ae70672d-2929-47a6-b0f2-e036b037f35b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:52.139561 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ae70672d-2929-47a6-b0f2-e036b037f35b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:52.146336 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ae70672d-2929-47a6-b0f2-e036b037f35b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:52.146785 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ae70672d-2929-47a6-b0f2-e036b037f35b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:52.147574 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ae70672d-2929-47a6-b0f2-e036b037f35b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:52.148030 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ae70672d-2929-47a6-b0f2-e036b037f35b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:52.294283 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ae70672d-2929-47a6-b0f2-e036b037f35b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:52.302361 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ae70672d-2929-47a6-b0f2-e036b037f35b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1317 microversion: 2.1 time: 0.167253 Feb 21 01:10:52.302941 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 107/227] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:52 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:52.639574 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0a9e5147-54a8-48ec-8a8a-9733a0bdd147 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:52.640303 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0a9e5147-54a8-48ec-8a8a-9733a0bdd147 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:52.647013 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a9e5147-54a8-48ec-8a8a-9733a0bdd147 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:52.647444 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a9e5147-54a8-48ec-8a8a-9733a0bdd147 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:52.648240 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a9e5147-54a8-48ec-8a8a-9733a0bdd147 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:52.648667 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a9e5147-54a8-48ec-8a8a-9733a0bdd147 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:52.800982 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0a9e5147-54a8-48ec-8a8a-9733a0bdd147 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:52.810421 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0a9e5147-54a8-48ec-8a8a-9733a0bdd147 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:52.811933 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0a9e5147-54a8-48ec-8a8a-9733a0bdd147 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:52.813049 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0a9e5147-54a8-48ec-8a8a-9733a0bdd147 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1407 microversion: 2.20 time: 0.179955 Feb 21 01:10:52.813630 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 121/228] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:52 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:10:52.938039 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2fc1772e-c806-40d3-90ad-8966607fad8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:52.938798 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2fc1772e-c806-40d3-90ad-8966607fad8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:52.947004 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2fc1772e-c806-40d3-90ad-8966607fad8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:52.947463 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2fc1772e-c806-40d3-90ad-8966607fad8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:52.948309 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2fc1772e-c806-40d3-90ad-8966607fad8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:52.948748 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2fc1772e-c806-40d3-90ad-8966607fad8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:53.125103 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2fc1772e-c806-40d3-90ad-8966607fad8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:53.132857 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2fc1772e-c806-40d3-90ad-8966607fad8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.198432 Feb 21 01:10:53.133657 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 108/229] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:52 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:53.320594 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2f8833b6-282e-4588-9855-21fb50b6fd00 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:53.321205 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2f8833b6-282e-4588-9855-21fb50b6fd00 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:53.327187 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2f8833b6-282e-4588-9855-21fb50b6fd00 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:53.327633 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2f8833b6-282e-4588-9855-21fb50b6fd00 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:53.328452 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2f8833b6-282e-4588-9855-21fb50b6fd00 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:53.328875 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2f8833b6-282e-4588-9855-21fb50b6fd00 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:53.492113 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2f8833b6-282e-4588-9855-21fb50b6fd00 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:53.500203 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2f8833b6-282e-4588-9855-21fb50b6fd00 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1317 microversion: 2.1 time: 0.183451 Feb 21 01:10:53.500925 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 122/230] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:53 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:53.830742 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-bebc2bce-270e-4c06-8665-0f2bcd702e9a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:53.831361 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-bebc2bce-270e-4c06-8665-0f2bcd702e9a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:53.837331 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bebc2bce-270e-4c06-8665-0f2bcd702e9a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:53.837775 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bebc2bce-270e-4c06-8665-0f2bcd702e9a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:53.838579 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bebc2bce-270e-4c06-8665-0f2bcd702e9a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:53.839016 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bebc2bce-270e-4c06-8665-0f2bcd702e9a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:54.022458 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bebc2bce-270e-4c06-8665-0f2bcd702e9a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:54.034002 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bebc2bce-270e-4c06-8665-0f2bcd702e9a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:54.035683 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bebc2bce-270e-4c06-8665-0f2bcd702e9a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:54.037290 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-bebc2bce-270e-4c06-8665-0f2bcd702e9a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1407 microversion: 2.20 time: 0.210439 Feb 21 01:10:54.038354 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 109/231] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:53 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:10:54.152746 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7656b21a-363c-4052-850c-0097d6a8cd43 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:54.153365 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7656b21a-363c-4052-850c-0097d6a8cd43 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:54.160950 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7656b21a-363c-4052-850c-0097d6a8cd43 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:54.161392 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7656b21a-363c-4052-850c-0097d6a8cd43 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:54.162181 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7656b21a-363c-4052-850c-0097d6a8cd43 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:54.162611 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7656b21a-363c-4052-850c-0097d6a8cd43 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:54.310578 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7656b21a-363c-4052-850c-0097d6a8cd43 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:54.318823 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7656b21a-363c-4052-850c-0097d6a8cd43 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.169652 Feb 21 01:10:54.319412 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 123/232] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:54 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:54.520432 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b54b9d95-a17e-43b6-a796-81e8351db260 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:54.521443 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b54b9d95-a17e-43b6-a796-81e8351db260 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:54.531751 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b54b9d95-a17e-43b6-a796-81e8351db260 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:54.532461 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b54b9d95-a17e-43b6-a796-81e8351db260 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:54.534119 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b54b9d95-a17e-43b6-a796-81e8351db260 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:54.534840 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b54b9d95-a17e-43b6-a796-81e8351db260 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:54.701356 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b54b9d95-a17e-43b6-a796-81e8351db260 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:54.710003 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b54b9d95-a17e-43b6-a796-81e8351db260 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1317 microversion: 2.1 time: 0.195532 Feb 21 01:10:54.710589 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 110/233] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:54 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:55.062999 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c7d9f48c-3aed-47da-8c27-6b82a2606877 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:55.070051 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c7d9f48c-3aed-47da-8c27-6b82a2606877 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:55.091485 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c7d9f48c-3aed-47da-8c27-6b82a2606877 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:55.093081 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c7d9f48c-3aed-47da-8c27-6b82a2606877 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:55.095712 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c7d9f48c-3aed-47da-8c27-6b82a2606877 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:55.097140 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c7d9f48c-3aed-47da-8c27-6b82a2606877 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:55.336118 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-26f7960e-d222-4352-94b4-2252b86752fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:55.337359 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-26f7960e-d222-4352-94b4-2252b86752fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:55.346117 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-26f7960e-d222-4352-94b4-2252b86752fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:55.346903 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-26f7960e-d222-4352-94b4-2252b86752fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:55.347911 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-26f7960e-d222-4352-94b4-2252b86752fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:55.348504 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-26f7960e-d222-4352-94b4-2252b86752fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:55.368918 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c7d9f48c-3aed-47da-8c27-6b82a2606877 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:55.381443 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c7d9f48c-3aed-47da-8c27-6b82a2606877 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:55.383863 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c7d9f48c-3aed-47da-8c27-6b82a2606877 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:55.385262 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c7d9f48c-3aed-47da-8c27-6b82a2606877 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1407 microversion: 2.20 time: 0.333025 Feb 21 01:10:55.386221 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 124/234] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:55 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:10:55.547671 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-26f7960e-d222-4352-94b4-2252b86752fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:55.557957 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-26f7960e-d222-4352-94b4-2252b86752fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.225511 Feb 21 01:10:55.558896 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 111/235] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:55 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:10:55.729728 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c07d28be-8f5b-4806-8814-02b7159aacca tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:55.730521 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c07d28be-8f5b-4806-8814-02b7159aacca tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:55.740669 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c07d28be-8f5b-4806-8814-02b7159aacca tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:55.741113 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c07d28be-8f5b-4806-8814-02b7159aacca tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:55.741951 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c07d28be-8f5b-4806-8814-02b7159aacca tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:55.742379 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c07d28be-8f5b-4806-8814-02b7159aacca tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:55.991212 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c07d28be-8f5b-4806-8814-02b7159aacca tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:56.012005 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c07d28be-8f5b-4806-8814-02b7159aacca tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1317 microversion: 2.1 time: 0.277745 Feb 21 01:10:56.012005 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 125/236] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:55 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:56.410386 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0c56a7ba-32fe-40ea-b0e1-e68dc9050990 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:56.411073 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0c56a7ba-32fe-40ea-b0e1-e68dc9050990 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:56.418480 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c56a7ba-32fe-40ea-b0e1-e68dc9050990 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:56.418924 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c56a7ba-32fe-40ea-b0e1-e68dc9050990 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:56.419730 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c56a7ba-32fe-40ea-b0e1-e68dc9050990 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:56.420197 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c56a7ba-32fe-40ea-b0e1-e68dc9050990 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:56.578546 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6d9eaaa1-9f84-40ab-b07c-48df32def671 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:56.579253 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6d9eaaa1-9f84-40ab-b07c-48df32def671 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:56.589531 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6d9eaaa1-9f84-40ab-b07c-48df32def671 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:56.597077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6d9eaaa1-9f84-40ab-b07c-48df32def671 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:56.597077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6d9eaaa1-9f84-40ab-b07c-48df32def671 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:56.597077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6d9eaaa1-9f84-40ab-b07c-48df32def671 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:56.604047 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0c56a7ba-32fe-40ea-b0e1-e68dc9050990 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:56.613767 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0c56a7ba-32fe-40ea-b0e1-e68dc9050990 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:56.615568 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0c56a7ba-32fe-40ea-b0e1-e68dc9050990 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:56.617295 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0c56a7ba-32fe-40ea-b0e1-e68dc9050990 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1599 microversion: 2.20 time: 0.210858 Feb 21 01:10:56.619259 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 112/237] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:56 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:10:56.638001 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-68c82865-0eef-4f9d-9804-e7d92fa34871 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:56.638497 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-68c82865-0eef-4f9d-9804-e7d92fa34871 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:56.646577 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68c82865-0eef-4f9d-9804-e7d92fa34871 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:56.647014 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68c82865-0eef-4f9d-9804-e7d92fa34871 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:56.647908 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68c82865-0eef-4f9d-9804-e7d92fa34871 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:56.648348 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68c82865-0eef-4f9d-9804-e7d92fa34871 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:56.742149 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-68c82865-0eef-4f9d-9804-e7d92fa34871 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.107841 Feb 21 01:10:56.742842 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 113/238] 10.222.0.91 () {60 vars in 1315 bytes} [Mon Feb 21 01:10:56 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:10:56.763609 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-6d9eaaa1-9f84-40ab-b07c-48df32def671 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:56.771611 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6d9eaaa1-9f84-40ab-b07c-48df32def671 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.198763 Feb 21 01:10:56.772506 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 126/239] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:56 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:56.887770 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-cbe49db6-d026-46a8-8a2f-4870d77db744 req-801d3995-56c6-47b4-9193-a7eb84fd15d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9", "name": "network-vif-plugged", "status": "completed", "tag": "a9b8b6b3-10bd-46a7-af49-ecb93114aab6"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:10:56.889025 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:10:56.889025 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:10:56.905218 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-cbe49db6-d026-46a8-8a2f-4870d77db744 req-801d3995-56c6-47b4-9193-a7eb84fd15d1 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:56.905830 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-cbe49db6-d026-46a8-8a2f-4870d77db744 req-801d3995-56c6-47b4-9193-a7eb84fd15d1 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:56.918431 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-cbe49db6-d026-46a8-8a2f-4870d77db744 req-801d3995-56c6-47b4-9193-a7eb84fd15d1 service nova] Creating event network-vif-plugged:a9b8b6b3-10bd-46a7-af49-ecb93114aab6 for instance 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 on hv-cinder-81322 Feb 21 01:10:56.933881 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-cbe49db6-d026-46a8-8a2f-4870d77db744 req-801d3995-56c6-47b4-9193-a7eb84fd15d1 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050037 Feb 21 01:10:56.937514 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 114/240] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:10:57.018876 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f33db782-f1b4-4569-ad48-00ca3499ff3d tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:57.019940 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f33db782-f1b4-4569-ad48-00ca3499ff3d tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:57.026609 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f33db782-f1b4-4569-ad48-00ca3499ff3d tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:57.027326 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f33db782-f1b4-4569-ad48-00ca3499ff3d tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:57.028435 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f33db782-f1b4-4569-ad48-00ca3499ff3d tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:57.029046 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f33db782-f1b4-4569-ad48-00ca3499ff3d tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:57.205024 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f33db782-f1b4-4569-ad48-00ca3499ff3d tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:57.212281 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f33db782-f1b4-4569-ad48-00ca3499ff3d tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1317 microversion: 2.1 time: 0.197604 Feb 21 01:10:57.213301 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 127/241] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:57 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:57.790825 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3d06d6a1-39d1-4061-a392-fe5136360bfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:57.791603 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3d06d6a1-39d1-4061-a392-fe5136360bfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:57.799888 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3d06d6a1-39d1-4061-a392-fe5136360bfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:57.800659 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3d06d6a1-39d1-4061-a392-fe5136360bfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:57.801663 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3d06d6a1-39d1-4061-a392-fe5136360bfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:57.802274 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3d06d6a1-39d1-4061-a392-fe5136360bfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:58.230559 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-22e17235-08ad-4136-9b22-daff38e31164 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:58.231148 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-22e17235-08ad-4136-9b22-daff38e31164 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:58.239786 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-22e17235-08ad-4136-9b22-daff38e31164 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:58.240921 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-22e17235-08ad-4136-9b22-daff38e31164 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:58.241948 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-22e17235-08ad-4136-9b22-daff38e31164 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:58.243086 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-22e17235-08ad-4136-9b22-daff38e31164 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:58.273864 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3d06d6a1-39d1-4061-a392-fe5136360bfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:58.283334 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3d06d6a1-39d1-4061-a392-fe5136360bfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.496927 Feb 21 01:10:58.292900 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 115/242] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:57 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:58.396161 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-22e17235-08ad-4136-9b22-daff38e31164 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:58.404173 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-22e17235-08ad-4136-9b22-daff38e31164 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1317 microversion: 2.1 time: 0.177132 Feb 21 01:10:58.420679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 128/243] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:58 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:10:58.469859 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4147245c-fe26-4b98-81e7-eb806b27d6ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:58.471827 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4147245c-fe26-4b98-81e7-eb806b27d6ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:58.477942 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-efbf6197-da7d-47e4-a5b2-3b199f6d10a0 req-bdc749da-9ffd-43da-b51c-b1ca1d9db6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2aa103a-4f89-45a6-8c62-09282555e3b3", "tag": "17542d9a-ec16-46b0-907e-71f3f5221834"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:10:58.481316 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:10:58.481316 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:10:58.482052 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4147245c-fe26-4b98-81e7-eb806b27d6ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:58.482778 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4147245c-fe26-4b98-81e7-eb806b27d6ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:58.484157 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4147245c-fe26-4b98-81e7-eb806b27d6ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:58.484867 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4147245c-fe26-4b98-81e7-eb806b27d6ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:58.494028 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-efbf6197-da7d-47e4-a5b2-3b199f6d10a0 req-bdc749da-9ffd-43da-b51c-b1ca1d9db6b6 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:58.494922 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-efbf6197-da7d-47e4-a5b2-3b199f6d10a0 req-bdc749da-9ffd-43da-b51c-b1ca1d9db6b6 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:58.510865 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-efbf6197-da7d-47e4-a5b2-3b199f6d10a0 req-bdc749da-9ffd-43da-b51c-b1ca1d9db6b6 service nova] Creating event network-changed:17542d9a-ec16-46b0-907e-71f3f5221834 for instance e2aa103a-4f89-45a6-8c62-09282555e3b3 on hv-cinder-81322 Feb 21 01:10:58.519753 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-efbf6197-da7d-47e4-a5b2-3b199f6d10a0 req-bdc749da-9ffd-43da-b51c-b1ca1d9db6b6 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049584 Feb 21 01:10:58.526621 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 129/244] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:10:58.529589 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4147245c-fe26-4b98-81e7-eb806b27d6ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/ips" status: 200 len: 112 microversion: 2.20 time: 0.066257 Feb 21 01:10:58.530191 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 116/245] 10.222.0.91 () {60 vars in 1288 bytes} [Mon Feb 21 01:10:58 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/ips => generated 112 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:10:59.324901 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-49bc81fe-eb94-4cfb-b348-6687e101df30 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:59.324901 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-49bc81fe-eb94-4cfb-b348-6687e101df30 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:59.324901 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49bc81fe-eb94-4cfb-b348-6687e101df30 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:59.324901 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49bc81fe-eb94-4cfb-b348-6687e101df30 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:59.325544 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49bc81fe-eb94-4cfb-b348-6687e101df30 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:59.325544 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49bc81fe-eb94-4cfb-b348-6687e101df30 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:59.443804 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-437e7e09-36ae-42b9-87bc-456cb3a7b2e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:59.445122 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-437e7e09-36ae-42b9-87bc-456cb3a7b2e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:59.473290 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-437e7e09-36ae-42b9-87bc-456cb3a7b2e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:59.473746 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-437e7e09-36ae-42b9-87bc-456cb3a7b2e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:59.474544 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-437e7e09-36ae-42b9-87bc-456cb3a7b2e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:59.474987 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-437e7e09-36ae-42b9-87bc-456cb3a7b2e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:59.475274 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-49bc81fe-eb94-4cfb-b348-6687e101df30 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:59.484766 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-49bc81fe-eb94-4cfb-b348-6687e101df30 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.187955 Feb 21 01:10:59.485348 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 130/246] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:59 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:59.646154 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-437e7e09-36ae-42b9-87bc-456cb3a7b2e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:59.656462 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-437e7e09-36ae-42b9-87bc-456cb3a7b2e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1317 microversion: 2.1 time: 0.232656 Feb 21 01:10:59.657104 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 117/247] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:59 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:00.514385 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4f274b1b-e877-4a69-bc8a-86428d1066d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:00.516499 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4f274b1b-e877-4a69-bc8a-86428d1066d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:00.522493 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f274b1b-e877-4a69-bc8a-86428d1066d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:00.522949 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f274b1b-e877-4a69-bc8a-86428d1066d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:00.523734 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f274b1b-e877-4a69-bc8a-86428d1066d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:00.524197 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f274b1b-e877-4a69-bc8a-86428d1066d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:00.675694 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fd6594e9-425a-4f7f-9d77-8c939aec92e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:00.677135 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fd6594e9-425a-4f7f-9d77-8c939aec92e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:00.685090 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fd6594e9-425a-4f7f-9d77-8c939aec92e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:00.685308 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fd6594e9-425a-4f7f-9d77-8c939aec92e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:00.686486 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fd6594e9-425a-4f7f-9d77-8c939aec92e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:00.686917 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fd6594e9-425a-4f7f-9d77-8c939aec92e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:00.749790 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4f274b1b-e877-4a69-bc8a-86428d1066d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:00.759891 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4f274b1b-e877-4a69-bc8a-86428d1066d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1521 microversion: 2.1 time: 0.249019 Feb 21 01:11:00.760753 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 131/248] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:00 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:00.856544 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fd6594e9-425a-4f7f-9d77-8c939aec92e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:00.865803 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fd6594e9-425a-4f7f-9d77-8c939aec92e0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1317 microversion: 2.1 time: 0.193479 Feb 21 01:11:00.867065 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 118/249] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:00 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:01.777476 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-38ae4e98-8516-4237-8067-efb6300a6887 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:01.778117 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-38ae4e98-8516-4237-8067-efb6300a6887 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:01.785822 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-38ae4e98-8516-4237-8067-efb6300a6887 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:01.786278 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-38ae4e98-8516-4237-8067-efb6300a6887 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:01.790402 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-38ae4e98-8516-4237-8067-efb6300a6887 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:01.790402 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-38ae4e98-8516-4237-8067-efb6300a6887 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:01.885501 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-bf5ab5ee-6e27-46ed-9187-2f24b8d086ad tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:01.886120 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-bf5ab5ee-6e27-46ed-9187-2f24b8d086ad tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:01.897761 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bf5ab5ee-6e27-46ed-9187-2f24b8d086ad tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:01.898221 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bf5ab5ee-6e27-46ed-9187-2f24b8d086ad tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:01.899039 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bf5ab5ee-6e27-46ed-9187-2f24b8d086ad tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:01.899482 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bf5ab5ee-6e27-46ed-9187-2f24b8d086ad tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:01.950584 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-38ae4e98-8516-4237-8067-efb6300a6887 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:01.961165 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-38ae4e98-8516-4237-8067-efb6300a6887 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1501 microversion: 2.1 time: 0.187345 Feb 21 01:11:01.962399 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 132/250] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:01 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1501 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:01.982330 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-83af418a-7d01-4e77-946d-bffed80c7e92 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c204aee9-6a0c-4f8f-8ac5-ceca10075dfc"}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:01.984026 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-83af418a-7d01-4e77-946d-bffed80c7e92 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:01.993514 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83af418a-7d01-4e77-946d-bffed80c7e92 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:01.993962 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83af418a-7d01-4e77-946d-bffed80c7e92 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:01.994831 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83af418a-7d01-4e77-946d-bffed80c7e92 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:01.995292 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83af418a-7d01-4e77-946d-bffed80c7e92 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:02.022027 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-83af418a-7d01-4e77-946d-bffed80c7e92 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] HTTP exception thrown: Cannot 'attach_volume' instance 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab while it is in vm_state rescued Feb 21 01:11:02.022759 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-83af418a-7d01-4e77-946d-bffed80c7e92 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Returning 409 to user: Cannot 'attach_volume' instance 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab while it is in vm_state rescued {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:11:02.023604 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-83af418a-7d01-4e77-946d-bffed80c7e92 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "POST /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048758 Feb 21 01:11:02.024566 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 133/251] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Feb 21 01:11:01 2022] POST /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 21 01:11:02.033150 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-05277eba-9a36-412b-86eb-221448d49f39 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:02.034104 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-05277eba-9a36-412b-86eb-221448d49f39 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:02.040287 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-05277eba-9a36-412b-86eb-221448d49f39 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:02.040808 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-05277eba-9a36-412b-86eb-221448d49f39 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:02.041537 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-05277eba-9a36-412b-86eb-221448d49f39 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:02.041959 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-05277eba-9a36-412b-86eb-221448d49f39 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:02.092750 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bf5ab5ee-6e27-46ed-9187-2f24b8d086ad tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:02.102903 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-bf5ab5ee-6e27-46ed-9187-2f24b8d086ad tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1317 microversion: 2.1 time: 0.221088 Feb 21 01:11:02.103711 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 119/252] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:01 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:02.312383 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-05277eba-9a36-412b-86eb-221448d49f39 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "POST /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/action" status: 202 len: 0 microversion: 2.1 time: 0.278542 Feb 21 01:11:02.312383 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 134/253] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Feb 21 01:11:02 2022] POST /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 01:11:02.319070 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-bb2d3efc-68ce-47a0-bb2a-875020ab9832 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:02.319675 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-bb2d3efc-68ce-47a0-bb2a-875020ab9832 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:02.328104 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bb2d3efc-68ce-47a0-bb2a-875020ab9832 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:02.328569 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bb2d3efc-68ce-47a0-bb2a-875020ab9832 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:02.330021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bb2d3efc-68ce-47a0-bb2a-875020ab9832 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:02.330572 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bb2d3efc-68ce-47a0-bb2a-875020ab9832 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:02.484044 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bb2d3efc-68ce-47a0-bb2a-875020ab9832 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:02.491898 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-bb2d3efc-68ce-47a0-bb2a-875020ab9832 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1509 microversion: 2.1 time: 0.176369 Feb 21 01:11:02.492485 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 120/254] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:02 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:03.123183 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7ece5e63-dd25-46ce-b3ec-e6480e36fa65 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:03.124106 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7ece5e63-dd25-46ce-b3ec-e6480e36fa65 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:03.131781 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7ece5e63-dd25-46ce-b3ec-e6480e36fa65 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:03.132263 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7ece5e63-dd25-46ce-b3ec-e6480e36fa65 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:03.133052 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7ece5e63-dd25-46ce-b3ec-e6480e36fa65 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:03.133468 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7ece5e63-dd25-46ce-b3ec-e6480e36fa65 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:03.289590 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7ece5e63-dd25-46ce-b3ec-e6480e36fa65 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:03.297155 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7ece5e63-dd25-46ce-b3ec-e6480e36fa65 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1507 microversion: 2.1 time: 0.177902 Feb 21 01:11:03.297643 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 135/255] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:03 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:03.509573 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1736313f-bbac-49c2-9988-e344cef325f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:03.510238 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1736313f-bbac-49c2-9988-e344cef325f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:03.517126 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1736313f-bbac-49c2-9988-e344cef325f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:03.517625 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1736313f-bbac-49c2-9988-e344cef325f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:03.518593 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1736313f-bbac-49c2-9988-e344cef325f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:03.518994 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1736313f-bbac-49c2-9988-e344cef325f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:03.676787 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1736313f-bbac-49c2-9988-e344cef325f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:03.685368 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1736313f-bbac-49c2-9988-e344cef325f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1509 microversion: 2.1 time: 0.178161 Feb 21 01:11:03.685368 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 121/256] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:03 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:04.709321 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d50a256c-3487-45da-90a5-2e58aaa7510b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:04.709321 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d50a256c-3487-45da-90a5-2e58aaa7510b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:04.712014 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d50a256c-3487-45da-90a5-2e58aaa7510b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:04.712465 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d50a256c-3487-45da-90a5-2e58aaa7510b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:04.713262 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d50a256c-3487-45da-90a5-2e58aaa7510b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:04.713692 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d50a256c-3487-45da-90a5-2e58aaa7510b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:04.879904 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d50a256c-3487-45da-90a5-2e58aaa7510b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:04.888351 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d50a256c-3487-45da-90a5-2e58aaa7510b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1509 microversion: 2.1 time: 0.188399 Feb 21 01:11:04.888933 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 136/257] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:04 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:05.920396 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d59237d6-2112-4251-9384-7794561e23e1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:05.921011 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d59237d6-2112-4251-9384-7794561e23e1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:05.928468 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d59237d6-2112-4251-9384-7794561e23e1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:05.928913 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d59237d6-2112-4251-9384-7794561e23e1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:05.929947 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d59237d6-2112-4251-9384-7794561e23e1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:05.930372 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d59237d6-2112-4251-9384-7794561e23e1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:06.026613 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9544062f-d90a-4b6d-ace5-16a09d812cdd tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7486df01-6db7-405b-bf21-fbe239ecf066"}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:06.028373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9544062f-d90a-4b6d-ace5-16a09d812cdd tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:06.036870 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9544062f-d90a-4b6d-ace5-16a09d812cdd tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:06.037309 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9544062f-d90a-4b6d-ace5-16a09d812cdd tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:06.038346 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9544062f-d90a-4b6d-ace5-16a09d812cdd tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:06.038777 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9544062f-d90a-4b6d-ace5-16a09d812cdd tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:06.133846 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d59237d6-2112-4251-9384-7794561e23e1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:06.137309 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d59237d6-2112-4251-9384-7794561e23e1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1509 microversion: 2.1 time: 0.220780 Feb 21 01:11:06.137952 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 122/258] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:05 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1509 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:07.027311 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9544062f-d90a-4b6d-ace5-16a09d812cdd tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "POST /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.004604 Feb 21 01:11:07.028137 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 137/259] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Feb 21 01:11:06 2022] POST /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments => generated 194 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:11:07.165668 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-82c82b3c-1f29-4512-8c62-b0298be0561b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:07.166208 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-82c82b3c-1f29-4512-8c62-b0298be0561b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:07.173052 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-82c82b3c-1f29-4512-8c62-b0298be0561b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:07.173544 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-82c82b3c-1f29-4512-8c62-b0298be0561b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:07.174684 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-82c82b3c-1f29-4512-8c62-b0298be0561b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:07.175141 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-82c82b3c-1f29-4512-8c62-b0298be0561b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:07.394472 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-82c82b3c-1f29-4512-8c62-b0298be0561b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:07.408489 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-82c82b3c-1f29-4512-8c62-b0298be0561b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1509 microversion: 2.1 time: 0.246519 Feb 21 01:11:07.410024 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 123/260] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:07 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1509 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:08.437267 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1076f00f-5980-4522-b844-801273b53fe8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:08.438171 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1076f00f-5980-4522-b844-801273b53fe8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:08.445306 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1076f00f-5980-4522-b844-801273b53fe8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:08.445749 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1076f00f-5980-4522-b844-801273b53fe8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:08.446752 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1076f00f-5980-4522-b844-801273b53fe8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:08.447344 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1076f00f-5980-4522-b844-801273b53fe8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:08.711931 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1076f00f-5980-4522-b844-801273b53fe8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:08.722457 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1076f00f-5980-4522-b844-801273b53fe8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1515 microversion: 2.1 time: 0.289179 Feb 21 01:11:08.724261 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 138/261] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:08 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1515 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:10.813255 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4578bca0-28b7-4c3c-b132-ba10f4425d1c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:10.813255 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4578bca0-28b7-4c3c-b132-ba10f4425d1c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:10.823431 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4578bca0-28b7-4c3c-b132-ba10f4425d1c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:10.823431 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4578bca0-28b7-4c3c-b132-ba10f4425d1c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:10.823431 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4578bca0-28b7-4c3c-b132-ba10f4425d1c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:10.823431 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4578bca0-28b7-4c3c-b132-ba10f4425d1c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:11.063561 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4578bca0-28b7-4c3c-b132-ba10f4425d1c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:11.073811 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4578bca0-28b7-4c3c-b132-ba10f4425d1c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1515 microversion: 2.1 time: 0.265070 Feb 21 01:11:11.074450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 124/262] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:10 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1515 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:11.092853 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4b1ff5ba-39dc-4808-97da-1f53c3c2ac96 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d73b872e-c891-4c7f-8f9a-a7f9e52d11d3"}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:11.094790 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4b1ff5ba-39dc-4808-97da-1f53c3c2ac96 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:11.102781 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4b1ff5ba-39dc-4808-97da-1f53c3c2ac96 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:11.102781 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4b1ff5ba-39dc-4808-97da-1f53c3c2ac96 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:11.104204 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4b1ff5ba-39dc-4808-97da-1f53c3c2ac96 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:11.104764 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4b1ff5ba-39dc-4808-97da-1f53c3c2ac96 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:14.436140 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4b1ff5ba-39dc-4808-97da-1f53c3c2ac96 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "POST /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.348779 Feb 21 01:11:14.436978 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 139/263] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Feb 21 01:11:11 2022] POST /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 194 bytes in 3350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:11:15.869917 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fe23cb34-8973-43e2-9ae3-45a757bd65c9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7486df01-6db7-405b-bf21-fbe239ecf066"}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:15.872547 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fe23cb34-8973-43e2-9ae3-45a757bd65c9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:15.878964 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe23cb34-8973-43e2-9ae3-45a757bd65c9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:15.879405 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe23cb34-8973-43e2-9ae3-45a757bd65c9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:15.880241 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe23cb34-8973-43e2-9ae3-45a757bd65c9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:15.880839 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe23cb34-8973-43e2-9ae3-45a757bd65c9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:15.972981 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.wsgi [None req-fe23cb34-8973-43e2-9ae3-45a757bd65c9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] HTTP exception thrown: Invalid volume: volume 7486df01-6db7-405b-bf21-fbe239ecf066 is already attached to instances: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 Feb 21 01:11:15.974899 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fe23cb34-8973-43e2-9ae3-45a757bd65c9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Returning 400 to user: Invalid volume: volume 7486df01-6db7-405b-bf21-fbe239ecf066 is already attached to instances: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:11:15.974899 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fe23cb34-8973-43e2-9ae3-45a757bd65c9 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "POST /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108589 Feb 21 01:11:15.975252 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 125/264] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Feb 21 01:11:15 2022] POST /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 21 01:11:16.039099 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-55efac2f-430f-4353-aa5c-a4c2321f1e42 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:16.039762 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-55efac2f-430f-4353-aa5c-a4c2321f1e42 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:16.046598 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-55efac2f-430f-4353-aa5c-a4c2321f1e42 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:16.047043 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-55efac2f-430f-4353-aa5c-a4c2321f1e42 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:16.047906 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-55efac2f-430f-4353-aa5c-a4c2321f1e42 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:16.048958 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-55efac2f-430f-4353-aa5c-a4c2321f1e42 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:16.174288 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.objects.instance [None req-55efac2f-430f-4353-aa5c-a4c2321f1e42 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lazy-loading 'services' on Instance uuid 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 {{(pid=117139) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:11:16.476749 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-66987555-726d-4ad3-a949-ca24ccde4caf tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1699941642", "imageRef": "9b96cc67-20b9-414f-8afb-039ff7953adc", "flavorRef": "452"}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:16.531599 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.network.neutron [None req-66987555-726d-4ad3-a949-ca24ccde4caf tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] validate_networks() for None {{(pid=117138) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:11:16.533042 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-55efac2f-430f-4353-aa5c-a4c2321f1e42 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "DELETE /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments/7486df01-6db7-405b-bf21-fbe239ecf066" status: 202 len: 0 microversion: 2.1 time: 0.496941 Feb 21 01:11:16.533905 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 140/265] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Feb 21 01:11:16 2022] DELETE /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments/7486df01-6db7-405b-bf21-fbe239ecf066 => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:11:16.543882 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a129dace-3d16-4649-9247-9fcb9eb78ca1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:16.545030 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a129dace-3d16-4649-9247-9fcb9eb78ca1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:16.552400 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a129dace-3d16-4649-9247-9fcb9eb78ca1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:16.552841 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a129dace-3d16-4649-9247-9fcb9eb78ca1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:16.553633 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a129dace-3d16-4649-9247-9fcb9eb78ca1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:16.554065 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a129dace-3d16-4649-9247-9fcb9eb78ca1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:16.592416 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a129dace-3d16-4649-9247-9fcb9eb78ca1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052444 Feb 21 01:11:16.593242 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 141/266] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:11:16 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:11:16.855569 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-66987555-726d-4ad3-a949-ca24ccde4caf tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Flavor limits 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:11:16.856050 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-66987555-726d-4ad3-a949-ca24ccde4caf tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Image limits 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:11:16.856495 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-66987555-726d-4ad3-a949-ca24ccde4caf tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Flavor pref 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:11:16.856902 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-66987555-726d-4ad3-a949-ca24ccde4caf tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Image pref 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:11:16.857313 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-66987555-726d-4ad3-a949-ca24ccde4caf tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:11:16.866572 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-66987555-726d-4ad3-a949-ca24ccde4caf tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:16.867012 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-66987555-726d-4ad3-a949-ca24ccde4caf tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:16.867821 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-66987555-726d-4ad3-a949-ca24ccde4caf tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:16.868290 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-66987555-726d-4ad3-a949-ca24ccde4caf tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:16.889972 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-66987555-726d-4ad3-a949-ca24ccde4caf tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Getting quotas for project fed02e7fc81c4a36a0d5c87132d56dc5. Resources: {'ram', 'cores', 'instances'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:11:16.895064 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-66987555-726d-4ad3-a949-ca24ccde4caf tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Getting quotas for user 173a8e3cbc3b4926a213be2760dc9787 and project fed02e7fc81c4a36a0d5c87132d56dc5. Resources: {'ram', 'cores', 'instances'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:11:16.907969 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-66987555-726d-4ad3-a949-ca24ccde4caf tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Going to run 1 instances... {{(pid=117138) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:11:16.910461 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-66987555-726d-4ad3-a949-ca24ccde4caf tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b96cc67-20b9-414f-8afb-039ff7953adc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117138) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:11:17.059437 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-66987555-726d-4ad3-a949-ca24ccde4caf tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586323 Feb 21 01:11:17.060121 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 126/267] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Feb 21 01:11:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 21 01:11:17.070425 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0b7f424a-0636-473e-a532-0041fddfb65e tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:17.071064 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0b7f424a-0636-473e-a532-0041fddfb65e tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:17.130822 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0b7f424a-0636-473e-a532-0041fddfb65e tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173a8e3cbc3b4926a213be2760dc9787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed02e7fc81c4a36a0d5c87132d56dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:17.143249 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0b7f424a-0636-473e-a532-0041fddfb65e tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] 10.222.0.91 "GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc" status: 200 len: 1215 microversion: 2.1 time: 0.075941 Feb 21 01:11:17.144782 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 142/268] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:17 2022] GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:17.606728 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2fd25f40-f4dd-4fe0-896a-3e923085308e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:17.607782 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2fd25f40-f4dd-4fe0-896a-3e923085308e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:17.615580 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2fd25f40-f4dd-4fe0-896a-3e923085308e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:17.616064 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2fd25f40-f4dd-4fe0-896a-3e923085308e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:17.616876 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2fd25f40-f4dd-4fe0-896a-3e923085308e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:17.617555 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2fd25f40-f4dd-4fe0-896a-3e923085308e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:17.654421 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2fd25f40-f4dd-4fe0-896a-3e923085308e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051561 Feb 21 01:11:17.654995 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 127/269] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:11:17 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:11:18.050371 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f22fc19e-d9cf-4fc5-b509-6c612578e6b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-592284498", "imageRef": "9b96cc67-20b9-414f-8afb-039ff7953adc", "flavorRef": "452", "networks": [{"uuid": "ce8dae1f-c1c8-4a29-a9ef-ffb95022435c"}]}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:18.109981 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.network.neutron [None req-f22fc19e-d9cf-4fc5-b509-6c612578e6b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] validate_networks() for [('ce8dae1f-c1c8-4a29-a9ef-ffb95022435c', None, None, None, None, None)] {{(pid=117139) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:11:18.171287 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cf2056d1-6001-4153-948c-940c18b02af7 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:18.171941 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cf2056d1-6001-4153-948c-940c18b02af7 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:18.181279 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cf2056d1-6001-4153-948c-940c18b02af7 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:18.182111 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cf2056d1-6001-4153-948c-940c18b02af7 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:18.183515 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cf2056d1-6001-4153-948c-940c18b02af7 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:18.184303 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cf2056d1-6001-4153-948c-940c18b02af7 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:18.259887 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cf2056d1-6001-4153-948c-940c18b02af7 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173a8e3cbc3b4926a213be2760dc9787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed02e7fc81c4a36a0d5c87132d56dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:18.269151 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cf2056d1-6001-4153-948c-940c18b02af7 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] 10.222.0.91 "GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc" status: 200 len: 1219 microversion: 2.1 time: 0.102814 Feb 21 01:11:18.278805 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 128/270] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:18 2022] GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:18.492822 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-f22fc19e-d9cf-4fc5-b509-6c612578e6b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Flavor limits 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:11:18.493265 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-f22fc19e-d9cf-4fc5-b509-6c612578e6b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Image limits 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:11:18.493801 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-f22fc19e-d9cf-4fc5-b509-6c612578e6b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Flavor pref 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:11:18.494123 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-f22fc19e-d9cf-4fc5-b509-6c612578e6b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Image pref 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:11:18.494509 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-f22fc19e-d9cf-4fc5-b509-6c612578e6b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:11:18.503674 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f22fc19e-d9cf-4fc5-b509-6c612578e6b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:18.504140 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f22fc19e-d9cf-4fc5-b509-6c612578e6b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:18.504939 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f22fc19e-d9cf-4fc5-b509-6c612578e6b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:18.505364 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f22fc19e-d9cf-4fc5-b509-6c612578e6b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:18.522013 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.quota [None req-f22fc19e-d9cf-4fc5-b509-6c612578e6b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Getting quotas for project f92cb7cf852c4790bb51e02de8b46c41. Resources: {'ram', 'cores', 'instances'} {{(pid=117139) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:11:18.526231 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.quota [None req-f22fc19e-d9cf-4fc5-b509-6c612578e6b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Getting quotas for user eef05bfef54c43ca8d0099ee98986766 and project f92cb7cf852c4790bb51e02de8b46c41. Resources: {'ram', 'cores', 'instances'} {{(pid=117139) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:11:18.538773 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f22fc19e-d9cf-4fc5-b509-6c612578e6b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Going to run 1 instances... {{(pid=117139) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:11:18.541392 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f22fc19e-d9cf-4fc5-b509-6c612578e6b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b96cc67-20b9-414f-8afb-039ff7953adc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117139) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:11:18.664610 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f22fc19e-d9cf-4fc5-b509-6c612578e6b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618419 Feb 21 01:11:18.665505 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 143/271] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Feb 21 01:11:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:11:18.667407 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3f7f20f9-aae0-4f83-9213-56a34676da45 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:18.668414 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3f7f20f9-aae0-4f83-9213-56a34676da45 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:18.676376 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3f7f20f9-aae0-4f83-9213-56a34676da45 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:18.676887 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3f7f20f9-aae0-4f83-9213-56a34676da45 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:18.677789 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3f7f20f9-aae0-4f83-9213-56a34676da45 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:18.678044 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3f7f20f9-aae0-4f83-9213-56a34676da45 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:18.679322 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f1ae4233-c586-4f77-8180-116440343ab7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:18.680189 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f1ae4233-c586-4f77-8180-116440343ab7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:18.715643 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3f7f20f9-aae0-4f83-9213-56a34676da45 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052351 Feb 21 01:11:18.719972 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 129/272] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:11:18 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:11:18.748210 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f1ae4233-c586-4f77-8180-116440343ab7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:18.757239 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f1ae4233-c586-4f77-8180-116440343ab7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1218 microversion: 2.1 time: 0.082912 Feb 21 01:11:18.757813 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 144/273] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:18 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:19.286497 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a5dfdf74-9284-448c-bcca-6c724e53275c tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:19.287106 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a5dfdf74-9284-448c-bcca-6c724e53275c tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:19.293067 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a5dfdf74-9284-448c-bcca-6c724e53275c tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:19.293517 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a5dfdf74-9284-448c-bcca-6c724e53275c tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:19.294311 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a5dfdf74-9284-448c-bcca-6c724e53275c tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:19.294745 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a5dfdf74-9284-448c-bcca-6c724e53275c tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:19.363655 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a5dfdf74-9284-448c-bcca-6c724e53275c tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173a8e3cbc3b4926a213be2760dc9787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed02e7fc81c4a36a0d5c87132d56dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:19.371465 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a5dfdf74-9284-448c-bcca-6c724e53275c tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] 10.222.0.91 "GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc" status: 200 len: 1267 microversion: 2.1 time: 0.089545 Feb 21 01:11:19.372061 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 130/274] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:19 2022] GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:19.728451 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3b76e91a-a9cd-4db3-81eb-a9e979f6625a tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:19.729579 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3b76e91a-a9cd-4db3-81eb-a9e979f6625a tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:19.737565 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b76e91a-a9cd-4db3-81eb-a9e979f6625a tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:19.742293 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b76e91a-a9cd-4db3-81eb-a9e979f6625a tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:19.742293 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b76e91a-a9cd-4db3-81eb-a9e979f6625a tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:19.742293 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b76e91a-a9cd-4db3-81eb-a9e979f6625a tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:19.775690 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f9b4ad3f-78fd-4f4a-94b3-d4665241b952 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:19.777857 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f9b4ad3f-78fd-4f4a-94b3-d4665241b952 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:19.784277 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f9b4ad3f-78fd-4f4a-94b3-d4665241b952 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:19.785076 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f9b4ad3f-78fd-4f4a-94b3-d4665241b952 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:19.785234 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3b76e91a-a9cd-4db3-81eb-a9e979f6625a tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060169 Feb 21 01:11:19.786030 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 145/275] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:11:19 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:11:19.786169 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f9b4ad3f-78fd-4f4a-94b3-d4665241b952 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:19.786303 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f9b4ad3f-78fd-4f4a-94b3-d4665241b952 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:19.858270 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f9b4ad3f-78fd-4f4a-94b3-d4665241b952 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:19.873738 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f9b4ad3f-78fd-4f4a-94b3-d4665241b952 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1222 microversion: 2.1 time: 0.102533 Feb 21 01:11:19.885918 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 131/276] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:19 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:20.395035 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5db944c6-22e1-4718-bbdf-bed98fd8653b tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:20.395640 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5db944c6-22e1-4718-bbdf-bed98fd8653b tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:20.402491 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5db944c6-22e1-4718-bbdf-bed98fd8653b tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:20.402971 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5db944c6-22e1-4718-bbdf-bed98fd8653b tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:20.403781 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5db944c6-22e1-4718-bbdf-bed98fd8653b tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:20.404250 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5db944c6-22e1-4718-bbdf-bed98fd8653b tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:20.471031 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5db944c6-22e1-4718-bbdf-bed98fd8653b tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173a8e3cbc3b4926a213be2760dc9787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed02e7fc81c4a36a0d5c87132d56dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:20.479076 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5db944c6-22e1-4718-bbdf-bed98fd8653b tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] 10.222.0.91 "GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc" status: 200 len: 1273 microversion: 2.1 time: 0.089858 Feb 21 01:11:20.479723 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 146/277] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:20 2022] GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc => generated 1273 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:20.797026 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1e3147dc-baad-4257-9b3e-1819fc5e7c77 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:20.798275 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1e3147dc-baad-4257-9b3e-1819fc5e7c77 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:20.804883 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1e3147dc-baad-4257-9b3e-1819fc5e7c77 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:20.805292 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1e3147dc-baad-4257-9b3e-1819fc5e7c77 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:20.806823 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1e3147dc-baad-4257-9b3e-1819fc5e7c77 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:20.806823 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1e3147dc-baad-4257-9b3e-1819fc5e7c77 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:20.838956 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1e3147dc-baad-4257-9b3e-1819fc5e7c77 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045675 Feb 21 01:11:20.839528 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 132/278] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:11:20 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:11:20.891347 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-374a449b-8620-43a3-ae0d-34187b1b0f1d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:20.893786 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-374a449b-8620-43a3-ae0d-34187b1b0f1d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:20.901064 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-374a449b-8620-43a3-ae0d-34187b1b0f1d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:20.901790 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-374a449b-8620-43a3-ae0d-34187b1b0f1d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:20.902529 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-374a449b-8620-43a3-ae0d-34187b1b0f1d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:20.902955 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-374a449b-8620-43a3-ae0d-34187b1b0f1d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:21.013369 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-374a449b-8620-43a3-ae0d-34187b1b0f1d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:21.032204 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-374a449b-8620-43a3-ae0d-34187b1b0f1d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1270 microversion: 2.1 time: 0.144355 Feb 21 01:11:21.056649 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 147/279] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:20 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:21.148340 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b2c92749-e3e0-4ba1-98c6-d80ca07a625c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1849812840", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-74044564", "security_groups": [{"name": "tempest-secgroup-smoke-1124718028"}], "block_device_mapping_v2": [{"uuid": "3d76e451-45e3-48ae-b581-1709b58b8623", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "efea3425-6681-4069-adc6-8204b8ffe9c5"}]}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:21.285939 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.network.neutron [None req-b2c92749-e3e0-4ba1-98c6-d80ca07a625c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] validate_networks() for [('efea3425-6681-4069-adc6-8204b8ffe9c5', None, None, None, None, None)] {{(pid=117138) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:11:21.498142 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8d0b9eee-9487-4163-8736-65b60eef56e1 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:21.498817 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8d0b9eee-9487-4163-8736-65b60eef56e1 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:21.505890 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8d0b9eee-9487-4163-8736-65b60eef56e1 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:21.506338 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8d0b9eee-9487-4163-8736-65b60eef56e1 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:21.507175 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8d0b9eee-9487-4163-8736-65b60eef56e1 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:21.507594 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8d0b9eee-9487-4163-8736-65b60eef56e1 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:21.723037 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-b2c92749-e3e0-4ba1-98c6-d80ca07a625c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Flavor limits 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:11:21.723749 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-b2c92749-e3e0-4ba1-98c6-d80ca07a625c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Image limits 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:11:21.724329 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-b2c92749-e3e0-4ba1-98c6-d80ca07a625c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Flavor pref 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:11:21.728701 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-b2c92749-e3e0-4ba1-98c6-d80ca07a625c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Image pref 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:11:21.728701 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-b2c92749-e3e0-4ba1-98c6-d80ca07a625c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:11:21.740221 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b2c92749-e3e0-4ba1-98c6-d80ca07a625c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:21.740693 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b2c92749-e3e0-4ba1-98c6-d80ca07a625c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:21.741724 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b2c92749-e3e0-4ba1-98c6-d80ca07a625c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:21.742478 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b2c92749-e3e0-4ba1-98c6-d80ca07a625c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:21.774955 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-b2c92749-e3e0-4ba1-98c6-d80ca07a625c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Getting quotas for project 0c96b1f3aaed4700a792cf9d25aaaca3. Resources: {'ram', 'cores', 'instances'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:11:21.779461 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-b2c92749-e3e0-4ba1-98c6-d80ca07a625c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Getting quotas for user 6f525569d9ed4d61926ddad83a270032 and project 0c96b1f3aaed4700a792cf9d25aaaca3. Resources: {'ram', 'cores', 'instances'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:11:21.849131 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8d0b9eee-9487-4163-8736-65b60eef56e1 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173a8e3cbc3b4926a213be2760dc9787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed02e7fc81c4a36a0d5c87132d56dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:21.856594 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8d0b9eee-9487-4163-8736-65b60eef56e1 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] 10.222.0.91 "GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc" status: 200 len: 1315 microversion: 2.1 time: 0.363413 Feb 21 01:11:21.857382 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 148/280] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:21 2022] GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:21.866462 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b2c92749-e3e0-4ba1-98c6-d80ca07a625c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Going to run 1 instances... {{(pid=117138) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:11:21.868554 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b2c92749-e3e0-4ba1-98c6-d80ca07a625c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d76e451-45e3-48ae-b581-1709b58b8623',volume_size=None,volume_type=None)] {{(pid=117138) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:11:21.875743 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e2828393-568c-4121-a5df-322d94d3b17f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:21.877395 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e2828393-568c-4121-a5df-322d94d3b17f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:21.884594 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e2828393-568c-4121-a5df-322d94d3b17f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:21.885295 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e2828393-568c-4121-a5df-322d94d3b17f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:21.886156 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e2828393-568c-4121-a5df-322d94d3b17f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:21.886660 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e2828393-568c-4121-a5df-322d94d3b17f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:21.924750 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e2828393-568c-4121-a5df-322d94d3b17f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066103 Feb 21 01:11:21.925701 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 149/281] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:11:21 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:11:22.063092 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4ec5b044-ee52-4f04-9dce-ff87faecbd89 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:22.064722 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4ec5b044-ee52-4f04-9dce-ff87faecbd89 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:22.076616 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4ec5b044-ee52-4f04-9dce-ff87faecbd89 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:22.077037 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4ec5b044-ee52-4f04-9dce-ff87faecbd89 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:22.078205 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4ec5b044-ee52-4f04-9dce-ff87faecbd89 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:22.078850 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4ec5b044-ee52-4f04-9dce-ff87faecbd89 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:22.158240 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4ec5b044-ee52-4f04-9dce-ff87faecbd89 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:22.167546 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4ec5b044-ee52-4f04-9dce-ff87faecbd89 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1276 microversion: 2.1 time: 0.108375 Feb 21 01:11:22.178154 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 150/282] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:22 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1276 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:22.426431 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b2c92749-e3e0-4ba1-98c6-d80ca07a625c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.281721 Feb 21 01:11:22.431986 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 133/283] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Feb 21 01:11:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 21 01:11:22.437887 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-88a6ae56-be14-43ec-8b66-c4f0584ea4c2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:22.439322 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-88a6ae56-be14-43ec-8b66-c4f0584ea4c2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:22.510728 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-88a6ae56-be14-43ec-8b66-c4f0584ea4c2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:22.546979 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-88a6ae56-be14-43ec-8b66-c4f0584ea4c2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1093 microversion: 2.1 time: 0.112791 Feb 21 01:11:22.567506 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-531247d7-eda9-4e8d-9e50-0cf348f2d1ee req-e6aa6cc6-355c-4338-804b-7b5add7085bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8240cf93-680f-47f2-bfe5-0b3fcafb79fc", "tag": "51b4d095-281a-430c-b596-56994e39c1e0"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:22.569420 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:11:22.569420 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:11:22.575222 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 151/284] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:22 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1093 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:22.596392 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-531247d7-eda9-4e8d-9e50-0cf348f2d1ee req-e6aa6cc6-355c-4338-804b-7b5add7085bf service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:22.601212 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-531247d7-eda9-4e8d-9e50-0cf348f2d1ee req-e6aa6cc6-355c-4338-804b-7b5add7085bf service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:22.626407 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-531247d7-eda9-4e8d-9e50-0cf348f2d1ee req-e6aa6cc6-355c-4338-804b-7b5add7085bf service nova] Creating event network-changed:51b4d095-281a-430c-b596-56994e39c1e0 for instance 8240cf93-680f-47f2-bfe5-0b3fcafb79fc on hv-cinder-81322 Feb 21 01:11:22.657205 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-531247d7-eda9-4e8d-9e50-0cf348f2d1ee req-e6aa6cc6-355c-4338-804b-7b5add7085bf service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085388 Feb 21 01:11:22.665599 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 134/285] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:11:22.881911 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ea151956-c577-4f82-b00d-4482c1a74e6d tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:22.887649 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ea151956-c577-4f82-b00d-4482c1a74e6d tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:22.896241 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ea151956-c577-4f82-b00d-4482c1a74e6d tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:22.896677 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ea151956-c577-4f82-b00d-4482c1a74e6d tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:22.901730 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ea151956-c577-4f82-b00d-4482c1a74e6d tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:22.902171 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ea151956-c577-4f82-b00d-4482c1a74e6d tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:22.936377 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2ce8de28-c675-4056-bab5-097c009c99ac tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:22.938176 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2ce8de28-c675-4056-bab5-097c009c99ac tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:22.945814 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2ce8de28-c675-4056-bab5-097c009c99ac tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:22.946259 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2ce8de28-c675-4056-bab5-097c009c99ac tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:22.947082 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2ce8de28-c675-4056-bab5-097c009c99ac tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:22.947516 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2ce8de28-c675-4056-bab5-097c009c99ac tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:22.983254 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2ce8de28-c675-4056-bab5-097c009c99ac tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051455 Feb 21 01:11:22.983978 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 135/286] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:11:22 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:11:23.185255 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f49bfa84-9edb-4961-b832-4d45e856df53 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:23.189535 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f49bfa84-9edb-4961-b832-4d45e856df53 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:23.196507 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f49bfa84-9edb-4961-b832-4d45e856df53 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:23.197372 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f49bfa84-9edb-4961-b832-4d45e856df53 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:23.199170 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f49bfa84-9edb-4961-b832-4d45e856df53 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:23.200173 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f49bfa84-9edb-4961-b832-4d45e856df53 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:23.391029 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f49bfa84-9edb-4961-b832-4d45e856df53 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:23.400957 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f49bfa84-9edb-4961-b832-4d45e856df53 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1318 microversion: 2.1 time: 0.219360 Feb 21 01:11:23.401656 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 136/287] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:23 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:23.569918 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ea151956-c577-4f82-b00d-4482c1a74e6d tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173a8e3cbc3b4926a213be2760dc9787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed02e7fc81c4a36a0d5c87132d56dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:23.573816 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c302127b-b60b-4f73-bd4d-33b629ba3178 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:23.574911 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c302127b-b60b-4f73-bd4d-33b629ba3178 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:23.584520 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ea151956-c577-4f82-b00d-4482c1a74e6d tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] 10.222.0.91 "GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc" status: 200 len: 1315 microversion: 2.1 time: 0.711121 Feb 21 01:11:23.585116 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 152/288] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:22 2022] GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc => generated 1315 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:23.657120 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c302127b-b60b-4f73-bd4d-33b629ba3178 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:23.672246 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c302127b-b60b-4f73-bd4d-33b629ba3178 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1093 microversion: 2.1 time: 0.103082 Feb 21 01:11:23.674797 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 137/289] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:23 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1093 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:24.002338 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f1a8c04e-461a-464d-ba9e-cd796bd680ca tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:24.005463 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f1a8c04e-461a-464d-ba9e-cd796bd680ca tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:24.022469 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f1a8c04e-461a-464d-ba9e-cd796bd680ca tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:24.024207 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f1a8c04e-461a-464d-ba9e-cd796bd680ca tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:24.026180 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f1a8c04e-461a-464d-ba9e-cd796bd680ca tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:24.027342 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f1a8c04e-461a-464d-ba9e-cd796bd680ca tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:24.097764 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f1a8c04e-461a-464d-ba9e-cd796bd680ca tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103253 Feb 21 01:11:24.098539 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 153/290] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:11:23 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:11:24.442175 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6ce88432-af33-4a58-ac02-44ef502140d7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:24.442883 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6ce88432-af33-4a58-ac02-44ef502140d7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:24.454152 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-00b053ec-552e-4f47-ae67-c3522ab03f17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:24.462876 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-00b053ec-552e-4f47-ae67-c3522ab03f17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:24.471304 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6ce88432-af33-4a58-ac02-44ef502140d7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:24.475759 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-00b053ec-552e-4f47-ae67-c3522ab03f17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:24.476048 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6ce88432-af33-4a58-ac02-44ef502140d7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:24.476162 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-00b053ec-552e-4f47-ae67-c3522ab03f17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:24.476162 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-00b053ec-552e-4f47-ae67-c3522ab03f17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:24.476324 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6ce88432-af33-4a58-ac02-44ef502140d7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:24.476401 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-00b053ec-552e-4f47-ae67-c3522ab03f17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:24.476477 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6ce88432-af33-4a58-ac02-44ef502140d7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:24.509031 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.objects.instance [None req-00b053ec-552e-4f47-ae67-c3522ab03f17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lazy-loading 'flavor' on Instance uuid 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab {{(pid=117139) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:11:24.676218 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6ce88432-af33-4a58-ac02-44ef502140d7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:24.685275 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6ce88432-af33-4a58-ac02-44ef502140d7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1318 microversion: 2.1 time: 0.266912 Feb 21 01:11:24.691717 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 138/291] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:24 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:24.696885 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1c32f1e1-a603-4a35-a28a-d97c5fbdeb62 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:24.698228 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1c32f1e1-a603-4a35-a28a-d97c5fbdeb62 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:24.707144 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1c32f1e1-a603-4a35-a28a-d97c5fbdeb62 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:24.708304 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1c32f1e1-a603-4a35-a28a-d97c5fbdeb62 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:24.710659 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1c32f1e1-a603-4a35-a28a-d97c5fbdeb62 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:24.711410 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1c32f1e1-a603-4a35-a28a-d97c5fbdeb62 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:24.899495 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1c32f1e1-a603-4a35-a28a-d97c5fbdeb62 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173a8e3cbc3b4926a213be2760dc9787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed02e7fc81c4a36a0d5c87132d56dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:24.913942 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1c32f1e1-a603-4a35-a28a-d97c5fbdeb62 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] 10.222.0.91 "GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc" status: 200 len: 1315 microversion: 2.1 time: 0.220388 Feb 21 01:11:24.917331 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 139/292] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:24 2022] GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:24.927851 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-9e7cf41c-ccb3-47c5-acea-f93e50d15e83 req-e8c1e91a-89ef-41d1-9005-e532b9c06ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d1f7594-329f-44cb-a627-184aa02bd0fc", "tag": "9a617465-d24d-4c1a-b319-2adef58652a5"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:24.929579 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:11:24.929579 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:11:24.937877 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-9e7cf41c-ccb3-47c5-acea-f93e50d15e83 req-e8c1e91a-89ef-41d1-9005-e532b9c06ae9 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:24.938414 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-9e7cf41c-ccb3-47c5-acea-f93e50d15e83 req-e8c1e91a-89ef-41d1-9005-e532b9c06ae9 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:24.958358 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-9e7cf41c-ccb3-47c5-acea-f93e50d15e83 req-e8c1e91a-89ef-41d1-9005-e532b9c06ae9 service nova] Creating event network-changed:9a617465-d24d-4c1a-b319-2adef58652a5 for instance 9d1f7594-329f-44cb-a627-184aa02bd0fc on hv-cinder-81322 Feb 21 01:11:24.964163 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-9e7cf41c-ccb3-47c5-acea-f93e50d15e83 req-e8c1e91a-89ef-41d1-9005-e532b9c06ae9 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040970 Feb 21 01:11:24.964885 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 140/293] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:11:24.971636 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-aefcd94a-9d3a-4552-bcfa-4dee7c7f492a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:24.972388 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-aefcd94a-9d3a-4552-bcfa-4dee7c7f492a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:24.985508 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-aefcd94a-9d3a-4552-bcfa-4dee7c7f492a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:24.986892 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-aefcd94a-9d3a-4552-bcfa-4dee7c7f492a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:24.988145 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-aefcd94a-9d3a-4552-bcfa-4dee7c7f492a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:24.989022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-aefcd94a-9d3a-4552-bcfa-4dee7c7f492a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:24.999753 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-00b053ec-552e-4f47-ae67-c3522ab03f17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "POST /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/action" status: 200 len: 32 microversion: 2.1 time: 0.551200 Feb 21 01:11:25.001611 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 154/294] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Feb 21 01:11:24 2022] POST /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/action => generated 32 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 21 01:11:25.019359 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-157defe7-9103-4846-a16b-0074d5b6a9d4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:25.024646 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-157defe7-9103-4846-a16b-0074d5b6a9d4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:25.036949 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-157defe7-9103-4846-a16b-0074d5b6a9d4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:25.038061 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-157defe7-9103-4846-a16b-0074d5b6a9d4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:25.039086 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-157defe7-9103-4846-a16b-0074d5b6a9d4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:25.039685 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-157defe7-9103-4846-a16b-0074d5b6a9d4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:25.114028 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-aefcd94a-9d3a-4552-bcfa-4dee7c7f492a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:25.123311 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-aefcd94a-9d3a-4552-bcfa-4dee7c7f492a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1191 microversion: 2.1 time: 0.156113 Feb 21 01:11:25.124055 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 141/295] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:24 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1191 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:25.130416 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b4a5511d-2b62-43b5-99ff-b66b37248eff tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:25.131580 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b4a5511d-2b62-43b5-99ff-b66b37248eff tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:25.141522 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b4a5511d-2b62-43b5-99ff-b66b37248eff tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:25.143017 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b4a5511d-2b62-43b5-99ff-b66b37248eff tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:25.152392 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b4a5511d-2b62-43b5-99ff-b66b37248eff tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:25.152392 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b4a5511d-2b62-43b5-99ff-b66b37248eff tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:25.198613 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b4a5511d-2b62-43b5-99ff-b66b37248eff tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072876 Feb 21 01:11:25.203216 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 142/296] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:11:25 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:11:25.445591 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-157defe7-9103-4846-a16b-0074d5b6a9d4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:25.458259 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-157defe7-9103-4846-a16b-0074d5b6a9d4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.450552 Feb 21 01:11:25.459336 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 155/297] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:25 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:25.715167 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-202d1229-2b25-4bb7-8bda-eb55c47946c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:25.716408 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-202d1229-2b25-4bb7-8bda-eb55c47946c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:25.726084 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-202d1229-2b25-4bb7-8bda-eb55c47946c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:25.726885 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-202d1229-2b25-4bb7-8bda-eb55c47946c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:25.727915 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-202d1229-2b25-4bb7-8bda-eb55c47946c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:25.744009 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-202d1229-2b25-4bb7-8bda-eb55c47946c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:25.932968 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a220510d-30a9-4a8e-ab51-91eb70e7de28 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:26.046890 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a220510d-30a9-4a8e-ab51-91eb70e7de28 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:26.051058 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-202d1229-2b25-4bb7-8bda-eb55c47946c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:26.051926 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a220510d-30a9-4a8e-ab51-91eb70e7de28 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:26.051926 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a220510d-30a9-4a8e-ab51-91eb70e7de28 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:26.051926 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a220510d-30a9-4a8e-ab51-91eb70e7de28 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:26.051926 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a220510d-30a9-4a8e-ab51-91eb70e7de28 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:26.052285 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-202d1229-2b25-4bb7-8bda-eb55c47946c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1318 microversion: 2.1 time: 0.259983 Feb 21 01:11:26.052285 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 143/298] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:25 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:26.141262 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ca90313f-93e9-4d28-a575-9ef3d7ce39f9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:26.142143 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ca90313f-93e9-4d28-a575-9ef3d7ce39f9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:26.148775 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ca90313f-93e9-4d28-a575-9ef3d7ce39f9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:26.149415 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ca90313f-93e9-4d28-a575-9ef3d7ce39f9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:26.150237 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ca90313f-93e9-4d28-a575-9ef3d7ce39f9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:26.150673 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ca90313f-93e9-4d28-a575-9ef3d7ce39f9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:26.238536 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ca90313f-93e9-4d28-a575-9ef3d7ce39f9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:26.256977 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ca90313f-93e9-4d28-a575-9ef3d7ce39f9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1209 microversion: 2.1 time: 0.119256 Feb 21 01:11:26.257562 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 144/299] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:26 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1209 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:26.265415 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a220510d-30a9-4a8e-ab51-91eb70e7de28 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173a8e3cbc3b4926a213be2760dc9787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed02e7fc81c4a36a0d5c87132d56dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:26.279127 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a220510d-30a9-4a8e-ab51-91eb70e7de28 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] 10.222.0.91 "GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc" status: 200 len: 1315 microversion: 2.1 time: 0.345577 Feb 21 01:11:26.281575 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 156/300] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:25 2022] GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:26.281710 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-28887d99-9187-439c-99ee-6ab95d517d1f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:26.283398 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-28887d99-9187-439c-99ee-6ab95d517d1f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:26.293248 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-28887d99-9187-439c-99ee-6ab95d517d1f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:26.293248 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-28887d99-9187-439c-99ee-6ab95d517d1f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:26.293248 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-28887d99-9187-439c-99ee-6ab95d517d1f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:26.295213 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-28887d99-9187-439c-99ee-6ab95d517d1f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:26.332217 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-28887d99-9187-439c-99ee-6ab95d517d1f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073355 Feb 21 01:11:26.333129 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 145/301] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:11:26 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 01:11:26.478438 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0b5f43b2-e454-4672-aa0e-3d639bcc6c9c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:26.479279 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0b5f43b2-e454-4672-aa0e-3d639bcc6c9c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:26.487374 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0b5f43b2-e454-4672-aa0e-3d639bcc6c9c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:26.487862 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0b5f43b2-e454-4672-aa0e-3d639bcc6c9c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:26.488709 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0b5f43b2-e454-4672-aa0e-3d639bcc6c9c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:26.489146 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0b5f43b2-e454-4672-aa0e-3d639bcc6c9c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:26.517954 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a40a9be0-5b83-4148-a905-3865b2e522f1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-137646093", "imageRef": "9b96cc67-20b9-414f-8afb-039ff7953adc", "flavorRef": "452", "networks": [{"uuid": "8d88ddc9-10c8-4356-a5fc-74ca444968a9"}]}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:26.633980 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.network.neutron [None req-a40a9be0-5b83-4148-a905-3865b2e522f1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] validate_networks() for [('8d88ddc9-10c8-4356-a5fc-74ca444968a9', None, None, None, None, None)] {{(pid=117138) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:11:26.802921 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0b5f43b2-e454-4672-aa0e-3d639bcc6c9c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:26.820437 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0b5f43b2-e454-4672-aa0e-3d639bcc6c9c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.344609 Feb 21 01:11:26.844864 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 157/302] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:26 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:27.061470 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-adf08d81-1c2c-4542-9306-dad94ae54db6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:27.062759 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-adf08d81-1c2c-4542-9306-dad94ae54db6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:27.072949 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-adf08d81-1c2c-4542-9306-dad94ae54db6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:27.073362 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-adf08d81-1c2c-4542-9306-dad94ae54db6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:27.074215 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-adf08d81-1c2c-4542-9306-dad94ae54db6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:27.074689 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-adf08d81-1c2c-4542-9306-dad94ae54db6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:27.263797 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-adf08d81-1c2c-4542-9306-dad94ae54db6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:27.275669 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-adf08d81-1c2c-4542-9306-dad94ae54db6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1318 microversion: 2.1 time: 0.222116 Feb 21 01:11:27.276282 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 158/303] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:27 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:27.283366 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9de08e3e-43be-4f59-b375-08e50fecadcb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:27.284864 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9de08e3e-43be-4f59-b375-08e50fecadcb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:27.291024 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9de08e3e-43be-4f59-b375-08e50fecadcb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:27.291534 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9de08e3e-43be-4f59-b375-08e50fecadcb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:27.292354 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9de08e3e-43be-4f59-b375-08e50fecadcb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:27.305701 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9de08e3e-43be-4f59-b375-08e50fecadcb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:27.471577 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9de08e3e-43be-4f59-b375-08e50fecadcb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:27.485207 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9de08e3e-43be-4f59-b375-08e50fecadcb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1277 microversion: 2.1 time: 0.207412 Feb 21 01:11:27.487331 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 159/304] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:27 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1277 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:27.493776 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-78b41eb8-b5f4-406c-870c-154245d578a2 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:27.494600 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-78b41eb8-b5f4-406c-870c-154245d578a2 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:27.504202 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-78b41eb8-b5f4-406c-870c-154245d578a2 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:27.505335 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-78b41eb8-b5f4-406c-870c-154245d578a2 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:27.506528 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-78b41eb8-b5f4-406c-870c-154245d578a2 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:27.509077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-78b41eb8-b5f4-406c-870c-154245d578a2 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:27.528383 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-a40a9be0-5b83-4148-a905-3865b2e522f1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Flavor limits 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:11:27.529392 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-a40a9be0-5b83-4148-a905-3865b2e522f1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Image limits 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:11:27.530144 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-a40a9be0-5b83-4148-a905-3865b2e522f1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Flavor pref 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:11:27.530488 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-a40a9be0-5b83-4148-a905-3865b2e522f1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Image pref 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:11:27.531232 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-a40a9be0-5b83-4148-a905-3865b2e522f1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:11:27.544621 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a40a9be0-5b83-4148-a905-3865b2e522f1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:27.545401 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a40a9be0-5b83-4148-a905-3865b2e522f1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:27.546431 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a40a9be0-5b83-4148-a905-3865b2e522f1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:27.547057 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a40a9be0-5b83-4148-a905-3865b2e522f1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:27.568417 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-a40a9be0-5b83-4148-a905-3865b2e522f1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Getting quotas for project 24c1bf236b2f4eb1bffab124b7392ca5. Resources: {'ram', 'cores', 'instances'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:11:27.575853 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-a40a9be0-5b83-4148-a905-3865b2e522f1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Getting quotas for user 70516383f3b14d5283462803cac26d8b and project 24c1bf236b2f4eb1bffab124b7392ca5. Resources: {'ram', 'cores', 'instances'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:11:27.591101 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a40a9be0-5b83-4148-a905-3865b2e522f1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Going to run 1 instances... {{(pid=117138) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:11:27.595595 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a40a9be0-5b83-4148-a905-3865b2e522f1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b96cc67-20b9-414f-8afb-039ff7953adc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117138) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:11:27.701690 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-78b41eb8-b5f4-406c-870c-154245d578a2 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173a8e3cbc3b4926a213be2760dc9787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed02e7fc81c4a36a0d5c87132d56dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:27.708654 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-78b41eb8-b5f4-406c-870c-154245d578a2 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] 10.222.0.91 "GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc" status: 200 len: 1315 microversion: 2.1 time: 0.219943 Feb 21 01:11:27.709239 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 160/305] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:27 2022] GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:27.814145 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a40a9be0-5b83-4148-a905-3865b2e522f1 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.300061 Feb 21 01:11:27.814899 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 146/306] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Feb 21 01:11:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:11:27.825534 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2c79ba28-ba71-46ec-a6f6-134281df63a6 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:27.826452 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2c79ba28-ba71-46ec-a6f6-134281df63a6 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:27.846914 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-571b8106-ed09-45a1-9f5d-ca84da85a2ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:27.847525 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-571b8106-ed09-45a1-9f5d-ca84da85a2ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:27.878422 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-571b8106-ed09-45a1-9f5d-ca84da85a2ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:27.878849 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-571b8106-ed09-45a1-9f5d-ca84da85a2ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:27.879877 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-571b8106-ed09-45a1-9f5d-ca84da85a2ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:27.880495 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-571b8106-ed09-45a1-9f5d-ca84da85a2ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:27.941826 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2c79ba28-ba71-46ec-a6f6-134281df63a6 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:27.950211 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2c79ba28-ba71-46ec-a6f6-134281df63a6 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f" status: 200 len: 1217 microversion: 2.1 time: 0.128463 Feb 21 01:11:27.951766 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 161/307] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:27 2022] GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f => generated 1217 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:28.161965 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-571b8106-ed09-45a1-9f5d-ca84da85a2ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:28.170751 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-571b8106-ed09-45a1-9f5d-ca84da85a2ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.327875 Feb 21 01:11:28.181397 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 147/308] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:27 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:28.294175 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e29805a1-4f23-4469-8008-6834ac7ecc56 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:28.295009 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e29805a1-4f23-4469-8008-6834ac7ecc56 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:28.301363 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e29805a1-4f23-4469-8008-6834ac7ecc56 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:28.301876 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e29805a1-4f23-4469-8008-6834ac7ecc56 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:28.302724 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e29805a1-4f23-4469-8008-6834ac7ecc56 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:28.303227 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e29805a1-4f23-4469-8008-6834ac7ecc56 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:28.386954 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-4e375b96-488b-4727-b326-1988d2d04f61 req-b7c51968-671e-4a02-b4d7-611b4b17f771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f114c776-ca8f-4972-a0a7-3af4a2740a2e", "tag": "6f209b80-f946-4b10-9f3f-3eab83a2ef86"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:28.397328 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:11:28.397328 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:11:28.411105 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-4e375b96-488b-4727-b326-1988d2d04f61 req-b7c51968-671e-4a02-b4d7-611b4b17f771 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:28.412278 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-4e375b96-488b-4727-b326-1988d2d04f61 req-b7c51968-671e-4a02-b4d7-611b4b17f771 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:28.433249 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-4e375b96-488b-4727-b326-1988d2d04f61 req-b7c51968-671e-4a02-b4d7-611b4b17f771 service nova] Creating event network-changed:6f209b80-f946-4b10-9f3f-3eab83a2ef86 for instance f114c776-ca8f-4972-a0a7-3af4a2740a2e on hv-cinder-81322 Feb 21 01:11:28.440411 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-4e375b96-488b-4727-b326-1988d2d04f61 req-b7c51968-671e-4a02-b4d7-611b4b17f771 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056576 Feb 21 01:11:28.441153 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 148/309] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:11:28.508424 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1c11275d-c850-44b4-b9b0-b4f748e31e1b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:28.509113 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1c11275d-c850-44b4-b9b0-b4f748e31e1b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:28.518714 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1c11275d-c850-44b4-b9b0-b4f748e31e1b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:28.519759 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1c11275d-c850-44b4-b9b0-b4f748e31e1b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:28.520869 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1c11275d-c850-44b4-b9b0-b4f748e31e1b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:28.521451 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1c11275d-c850-44b4-b9b0-b4f748e31e1b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:28.535751 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e29805a1-4f23-4469-8008-6834ac7ecc56 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:28.545769 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e29805a1-4f23-4469-8008-6834ac7ecc56 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1318 microversion: 2.1 time: 0.255277 Feb 21 01:11:28.555934 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 162/310] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:28 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:28.734085 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3441a576-d8ef-4088-a0b0-f17da0bd690b tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:28.735052 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3441a576-d8ef-4088-a0b0-f17da0bd690b tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:28.744974 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3441a576-d8ef-4088-a0b0-f17da0bd690b tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:28.746384 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3441a576-d8ef-4088-a0b0-f17da0bd690b tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:28.747978 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3441a576-d8ef-4088-a0b0-f17da0bd690b tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:28.748804 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3441a576-d8ef-4088-a0b0-f17da0bd690b tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:28.939609 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3441a576-d8ef-4088-a0b0-f17da0bd690b tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173a8e3cbc3b4926a213be2760dc9787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed02e7fc81c4a36a0d5c87132d56dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:28.950245 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3441a576-d8ef-4088-a0b0-f17da0bd690b tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] 10.222.0.91 "GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc" status: 200 len: 1315 microversion: 2.1 time: 0.225676 Feb 21 01:11:28.951717 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 163/311] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:28 2022] GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:28.997530 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-dd01326a-4e74-480e-b354-d25f72662f10 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:28.998172 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-dd01326a-4e74-480e-b354-d25f72662f10 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:29.006238 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dd01326a-4e74-480e-b354-d25f72662f10 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:29.006903 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dd01326a-4e74-480e-b354-d25f72662f10 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:29.007716 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dd01326a-4e74-480e-b354-d25f72662f10 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:29.008191 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dd01326a-4e74-480e-b354-d25f72662f10 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:29.055636 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1c11275d-c850-44b4-b9b0-b4f748e31e1b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:29.078122 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1c11275d-c850-44b4-b9b0-b4f748e31e1b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1265 microversion: 2.1 time: 0.574259 Feb 21 01:11:29.078122 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 149/312] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:28 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1265 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:29.089781 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-511d3ff8-2332-4e82-8ec3-296340f8f30f req-683559b6-d146-4ca1-9e27-735d409367f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8240cf93-680f-47f2-bfe5-0b3fcafb79fc", "name": "network-vif-plugged", "status": "completed", "tag": "51b4d095-281a-430c-b596-56994e39c1e0"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:29.091463 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:11:29.091463 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:11:29.108362 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-511d3ff8-2332-4e82-8ec3-296340f8f30f req-683559b6-d146-4ca1-9e27-735d409367f4 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:29.108784 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-511d3ff8-2332-4e82-8ec3-296340f8f30f req-683559b6-d146-4ca1-9e27-735d409367f4 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:29.116617 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-dd01326a-4e74-480e-b354-d25f72662f10 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:29.124471 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-dd01326a-4e74-480e-b354-d25f72662f10 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f" status: 200 len: 1221 microversion: 2.1 time: 0.155880 Feb 21 01:11:29.127188 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 164/313] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:28 2022] GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f => generated 1221 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:29.128925 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-511d3ff8-2332-4e82-8ec3-296340f8f30f req-683559b6-d146-4ca1-9e27-735d409367f4 service nova] Creating event network-vif-plugged:51b4d095-281a-430c-b596-56994e39c1e0 for instance 8240cf93-680f-47f2-bfe5-0b3fcafb79fc on hv-cinder-81322 Feb 21 01:11:29.135171 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-511d3ff8-2332-4e82-8ec3-296340f8f30f req-683559b6-d146-4ca1-9e27-735d409367f4 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047820 Feb 21 01:11:29.135171 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 150/314] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:11:29.188300 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-49a8c45a-50cd-49f8-b916-d630a4b41d48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:29.188662 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-49a8c45a-50cd-49f8-b916-d630a4b41d48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:29.196455 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49a8c45a-50cd-49f8-b916-d630a4b41d48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:29.196455 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49a8c45a-50cd-49f8-b916-d630a4b41d48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:29.197108 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49a8c45a-50cd-49f8-b916-d630a4b41d48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:29.197737 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49a8c45a-50cd-49f8-b916-d630a4b41d48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:29.473752 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-49a8c45a-50cd-49f8-b916-d630a4b41d48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:29.482705 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-49a8c45a-50cd-49f8-b916-d630a4b41d48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.298606 Feb 21 01:11:29.483433 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 165/315] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:29 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:29.570548 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c66be13f-2cf5-4279-8020-af6bcbc8a033 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:29.572186 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c66be13f-2cf5-4279-8020-af6bcbc8a033 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:29.580274 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c66be13f-2cf5-4279-8020-af6bcbc8a033 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:29.580806 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c66be13f-2cf5-4279-8020-af6bcbc8a033 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:29.581594 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c66be13f-2cf5-4279-8020-af6bcbc8a033 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:29.582035 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c66be13f-2cf5-4279-8020-af6bcbc8a033 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:29.809047 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c66be13f-2cf5-4279-8020-af6bcbc8a033 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:29.817505 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c66be13f-2cf5-4279-8020-af6bcbc8a033 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1318 microversion: 2.1 time: 0.257265 Feb 21 01:11:29.818083 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 151/316] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:29 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:29.967561 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d4127b5a-31d4-4596-af04-ead06cb54cd9 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:29.968208 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d4127b5a-31d4-4596-af04-ead06cb54cd9 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:29.974731 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d4127b5a-31d4-4596-af04-ead06cb54cd9 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:29.977024 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d4127b5a-31d4-4596-af04-ead06cb54cd9 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:29.977692 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d4127b5a-31d4-4596-af04-ead06cb54cd9 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:29.978011 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d4127b5a-31d4-4596-af04-ead06cb54cd9 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:30.095481 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8beee4c3-dac6-4245-96d2-e307709e8dcf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:30.096777 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8beee4c3-dac6-4245-96d2-e307709e8dcf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:30.102855 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8beee4c3-dac6-4245-96d2-e307709e8dcf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:30.109652 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8beee4c3-dac6-4245-96d2-e307709e8dcf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:30.109652 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8beee4c3-dac6-4245-96d2-e307709e8dcf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:30.109652 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8beee4c3-dac6-4245-96d2-e307709e8dcf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:30.132579 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d4127b5a-31d4-4596-af04-ead06cb54cd9 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173a8e3cbc3b4926a213be2760dc9787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed02e7fc81c4a36a0d5c87132d56dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:30.140043 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d4127b5a-31d4-4596-af04-ead06cb54cd9 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] 10.222.0.91 "GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc" status: 200 len: 1315 microversion: 2.1 time: 0.176271 Feb 21 01:11:30.151751 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 166/317] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:29 2022] GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:30.151751 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6f3eb592-c0bc-4999-98df-edbccaff7e32 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:30.152004 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6f3eb592-c0bc-4999-98df-edbccaff7e32 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:30.158815 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6f3eb592-c0bc-4999-98df-edbccaff7e32 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:30.159485 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6f3eb592-c0bc-4999-98df-edbccaff7e32 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:30.160339 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6f3eb592-c0bc-4999-98df-edbccaff7e32 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:30.160767 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6f3eb592-c0bc-4999-98df-edbccaff7e32 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:30.225207 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-6f3eb592-c0bc-4999-98df-edbccaff7e32 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:30.233402 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6f3eb592-c0bc-4999-98df-edbccaff7e32 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f" status: 200 len: 1269 microversion: 2.1 time: 0.085917 Feb 21 01:11:30.234302 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 167/318] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:30 2022] GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f => generated 1269 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:30.256466 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8beee4c3-dac6-4245-96d2-e307709e8dcf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:30.264973 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8beee4c3-dac6-4245-96d2-e307709e8dcf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1265 microversion: 2.1 time: 0.174152 Feb 21 01:11:30.265557 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 152/319] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:30 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:30.503007 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-94ab8c37-0b91-4bc4-ba3c-d791ef6b882a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:30.503623 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-94ab8c37-0b91-4bc4-ba3c-d791ef6b882a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:30.510460 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-94ab8c37-0b91-4bc4-ba3c-d791ef6b882a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:30.510901 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-94ab8c37-0b91-4bc4-ba3c-d791ef6b882a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:30.511692 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-94ab8c37-0b91-4bc4-ba3c-d791ef6b882a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:30.512149 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-94ab8c37-0b91-4bc4-ba3c-d791ef6b882a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:30.673358 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-94ab8c37-0b91-4bc4-ba3c-d791ef6b882a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:30.684710 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-94ab8c37-0b91-4bc4-ba3c-d791ef6b882a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.186073 Feb 21 01:11:30.685312 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 168/320] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:30 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:30.834844 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-21c2e14d-c16e-475d-9e47-f1c6ce8fd888 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:30.835466 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-21c2e14d-c16e-475d-9e47-f1c6ce8fd888 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:30.845288 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-21c2e14d-c16e-475d-9e47-f1c6ce8fd888 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:30.846128 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-21c2e14d-c16e-475d-9e47-f1c6ce8fd888 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:30.849089 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-21c2e14d-c16e-475d-9e47-f1c6ce8fd888 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:30.850567 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-21c2e14d-c16e-475d-9e47-f1c6ce8fd888 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:31.118642 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-21c2e14d-c16e-475d-9e47-f1c6ce8fd888 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:31.131154 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-21c2e14d-c16e-475d-9e47-f1c6ce8fd888 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1318 microversion: 2.1 time: 0.300160 Feb 21 01:11:31.131754 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 153/321] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:30 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:31.158414 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-54182c1a-51e7-4aec-9d7d-53bf0c938b46 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:31.159290 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-54182c1a-51e7-4aec-9d7d-53bf0c938b46 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:31.160055 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-a0568a13-5f4a-441a-adc5-49a23267cd28 req-38503c20-6a60-4043-aeb5-de08dc60efc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d1f7594-329f-44cb-a627-184aa02bd0fc", "name": "network-vif-plugged", "status": "completed", "tag": "9a617465-d24d-4c1a-b319-2adef58652a5"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:31.164261 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:11:31.164261 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:11:31.165718 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-54182c1a-51e7-4aec-9d7d-53bf0c938b46 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:31.166140 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-54182c1a-51e7-4aec-9d7d-53bf0c938b46 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:31.166938 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-54182c1a-51e7-4aec-9d7d-53bf0c938b46 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:31.167365 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-54182c1a-51e7-4aec-9d7d-53bf0c938b46 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:31.182584 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-a0568a13-5f4a-441a-adc5-49a23267cd28 req-38503c20-6a60-4043-aeb5-de08dc60efc6 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:31.183464 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-a0568a13-5f4a-441a-adc5-49a23267cd28 req-38503c20-6a60-4043-aeb5-de08dc60efc6 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:31.197130 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-a0568a13-5f4a-441a-adc5-49a23267cd28 req-38503c20-6a60-4043-aeb5-de08dc60efc6 service nova] Creating event network-vif-plugged:9a617465-d24d-4c1a-b319-2adef58652a5 for instance 9d1f7594-329f-44cb-a627-184aa02bd0fc on hv-cinder-81322 Feb 21 01:11:31.202840 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-a0568a13-5f4a-441a-adc5-49a23267cd28 req-38503c20-6a60-4043-aeb5-de08dc60efc6 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052057 Feb 21 01:11:31.203866 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 169/322] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:11:31.260913 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fdcae16d-3a07-4d8b-b3cc-b0806f5fa9ab tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:31.262545 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fdcae16d-3a07-4d8b-b3cc-b0806f5fa9ab tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:31.276644 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fdcae16d-3a07-4d8b-b3cc-b0806f5fa9ab tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:31.278569 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fdcae16d-3a07-4d8b-b3cc-b0806f5fa9ab tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:31.281688 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fdcae16d-3a07-4d8b-b3cc-b0806f5fa9ab tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:31.284120 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fdcae16d-3a07-4d8b-b3cc-b0806f5fa9ab tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:31.389072 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fdcae16d-3a07-4d8b-b3cc-b0806f5fa9ab tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:31.397844 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-fdcae16d-3a07-4d8b-b3cc-b0806f5fa9ab tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f" status: 200 len: 1275 microversion: 2.1 time: 0.145111 Feb 21 01:11:31.398444 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 170/323] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:31 2022] GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f => generated 1275 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:31.403071 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-428afc06-0c19-4e0c-a132-d943be5ebdcf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:31.404033 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-428afc06-0c19-4e0c-a132-d943be5ebdcf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:31.429846 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-428afc06-0c19-4e0c-a132-d943be5ebdcf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:31.430642 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-428afc06-0c19-4e0c-a132-d943be5ebdcf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:31.432670 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-428afc06-0c19-4e0c-a132-d943be5ebdcf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:31.433371 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-428afc06-0c19-4e0c-a132-d943be5ebdcf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:31.476203 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-54182c1a-51e7-4aec-9d7d-53bf0c938b46 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173a8e3cbc3b4926a213be2760dc9787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed02e7fc81c4a36a0d5c87132d56dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:31.484492 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-54182c1a-51e7-4aec-9d7d-53bf0c938b46 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] 10.222.0.91 "GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc" status: 200 len: 1315 microversion: 2.1 time: 0.330332 Feb 21 01:11:31.486212 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 154/324] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:31 2022] GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:31.622659 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-428afc06-0c19-4e0c-a132-d943be5ebdcf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:31.636196 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-428afc06-0c19-4e0c-a132-d943be5ebdcf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1265 microversion: 2.1 time: 0.236092 Feb 21 01:11:31.637560 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 171/325] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:31 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:31.707107 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-026deb4e-a862-47e4-8cc2-6131bd021d94 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:31.708372 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-026deb4e-a862-47e4-8cc2-6131bd021d94 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:31.721690 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-026deb4e-a862-47e4-8cc2-6131bd021d94 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:31.722514 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-026deb4e-a862-47e4-8cc2-6131bd021d94 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:31.724046 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-026deb4e-a862-47e4-8cc2-6131bd021d94 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:31.724853 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-026deb4e-a862-47e4-8cc2-6131bd021d94 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:32.002211 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-026deb4e-a862-47e4-8cc2-6131bd021d94 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:32.011103 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-026deb4e-a862-47e4-8cc2-6131bd021d94 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.311752 Feb 21 01:11:32.015880 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 155/326] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:31 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:32.152256 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d362a7aa-74f1-4e3c-b321-3b19b88cdceb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:32.153692 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d362a7aa-74f1-4e3c-b321-3b19b88cdceb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:32.165805 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d362a7aa-74f1-4e3c-b321-3b19b88cdceb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:32.167515 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d362a7aa-74f1-4e3c-b321-3b19b88cdceb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:32.170309 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d362a7aa-74f1-4e3c-b321-3b19b88cdceb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:32.171785 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d362a7aa-74f1-4e3c-b321-3b19b88cdceb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:32.337382 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d362a7aa-74f1-4e3c-b321-3b19b88cdceb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:32.345642 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d362a7aa-74f1-4e3c-b321-3b19b88cdceb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1318 microversion: 2.1 time: 0.200192 Feb 21 01:11:32.346221 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 172/327] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:32 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:32.426537 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-398c0197-1e52-4e32-bbfc-e84c9b8e382b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:32.427168 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-398c0197-1e52-4e32-bbfc-e84c9b8e382b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:32.434997 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-398c0197-1e52-4e32-bbfc-e84c9b8e382b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:32.435645 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-398c0197-1e52-4e32-bbfc-e84c9b8e382b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:32.436666 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-398c0197-1e52-4e32-bbfc-e84c9b8e382b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:32.437245 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-398c0197-1e52-4e32-bbfc-e84c9b8e382b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:32.505742 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-309a2c0e-84ec-447a-ad5e-112f3a023df7 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:32.506567 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-309a2c0e-84ec-447a-ad5e-112f3a023df7 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:32.517490 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-309a2c0e-84ec-447a-ad5e-112f3a023df7 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:32.518407 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-309a2c0e-84ec-447a-ad5e-112f3a023df7 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:32.520362 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-309a2c0e-84ec-447a-ad5e-112f3a023df7 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:32.521167 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-309a2c0e-84ec-447a-ad5e-112f3a023df7 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:32.711148 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-398c0197-1e52-4e32-bbfc-e84c9b8e382b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:32.719308 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-398c0197-1e52-4e32-bbfc-e84c9b8e382b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f" status: 200 len: 1317 microversion: 2.1 time: 0.297019 Feb 21 01:11:32.719959 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 156/328] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:32 2022] GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:32.733011 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ec6ad09e-2c9c-4098-a891-52fff4118b75 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:32.734249 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ec6ad09e-2c9c-4098-a891-52fff4118b75 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:32.744867 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec6ad09e-2c9c-4098-a891-52fff4118b75 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:32.745316 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec6ad09e-2c9c-4098-a891-52fff4118b75 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:32.746168 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec6ad09e-2c9c-4098-a891-52fff4118b75 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:32.746588 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec6ad09e-2c9c-4098-a891-52fff4118b75 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:32.802311 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-309a2c0e-84ec-447a-ad5e-112f3a023df7 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173a8e3cbc3b4926a213be2760dc9787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed02e7fc81c4a36a0d5c87132d56dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:32.815376 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-309a2c0e-84ec-447a-ad5e-112f3a023df7 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] 10.222.0.91 "GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc" status: 200 len: 1465 microversion: 2.1 time: 0.311182 Feb 21 01:11:32.815376 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 173/329] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:32 2022] GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc => generated 1465 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:32.862002 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-57dedcfe-2c90-48c6-bdad-efec58ca132a tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:32.862499 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-57dedcfe-2c90-48c6-bdad-efec58ca132a tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:32.869538 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57dedcfe-2c90-48c6-bdad-efec58ca132a tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:32.870111 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57dedcfe-2c90-48c6-bdad-efec58ca132a tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:32.870925 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57dedcfe-2c90-48c6-bdad-efec58ca132a tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:32.871597 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57dedcfe-2c90-48c6-bdad-efec58ca132a tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:32.901855 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-57dedcfe-2c90-48c6-bdad-efec58ca132a tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] Going to try to terminate instance {{(pid=117139) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:11:32.959324 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ec6ad09e-2c9c-4098-a891-52fff4118b75 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:32.967564 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ec6ad09e-2c9c-4098-a891-52fff4118b75 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1265 microversion: 2.1 time: 0.245548 Feb 21 01:11:32.968186 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 157/330] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:32 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:33.036934 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-7be22557-cedc-46ce-9bf1-6b63f449ec15 req-f3d60d97-d6f6-4f93-b394-772cb42f2e84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "748a5623-7930-404e-9e68-e2c4f9439c0f", "tag": "34bd5660-c394-4cc0-ad67-5a45a2bc7853"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:33.039637 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:11:33.039637 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:11:33.049207 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-7be22557-cedc-46ce-9bf1-6b63f449ec15 req-f3d60d97-d6f6-4f93-b394-772cb42f2e84 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:33.049678 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-7be22557-cedc-46ce-9bf1-6b63f449ec15 req-f3d60d97-d6f6-4f93-b394-772cb42f2e84 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:33.062172 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-7be22557-cedc-46ce-9bf1-6b63f449ec15 req-f3d60d97-d6f6-4f93-b394-772cb42f2e84 service nova] Creating event network-changed:34bd5660-c394-4cc0-ad67-5a45a2bc7853 for instance 748a5623-7930-404e-9e68-e2c4f9439c0f on hv-cinder-81322 Feb 21 01:11:33.068409 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-7be22557-cedc-46ce-9bf1-6b63f449ec15 req-f3d60d97-d6f6-4f93-b394-772cb42f2e84 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038466 Feb 21 01:11:33.069015 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 158/331] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:11:33.074314 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5a654739-f1a9-4676-b3ab-32bb85055261 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:33.075096 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5a654739-f1a9-4676-b3ab-32bb85055261 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:33.084261 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5a654739-f1a9-4676-b3ab-32bb85055261 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:33.085084 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5a654739-f1a9-4676-b3ab-32bb85055261 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:33.085908 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5a654739-f1a9-4676-b3ab-32bb85055261 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:33.086342 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5a654739-f1a9-4676-b3ab-32bb85055261 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:33.358667 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5a654739-f1a9-4676-b3ab-32bb85055261 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:33.380778 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5a654739-f1a9-4676-b3ab-32bb85055261 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.309943 Feb 21 01:11:33.381189 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-57dedcfe-2c90-48c6-bdad-efec58ca132a tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] 10.222.0.91 "DELETE /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc" status: 204 len: 0 microversion: 2.1 time: 0.521863 Feb 21 01:11:33.381863 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 159/332] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:33 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:33.382554 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 174/333] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Feb 21 01:11:32 2022] DELETE /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:11:33.395858 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e5c37365-518e-4f5b-a56d-658f6aac372d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:33.396097 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-607657b7-cd61-416c-8d7c-4339683a11d8 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:33.397212 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e5c37365-518e-4f5b-a56d-658f6aac372d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:33.397351 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-607657b7-cd61-416c-8d7c-4339683a11d8 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:33.406000 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e5c37365-518e-4f5b-a56d-658f6aac372d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:33.406204 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-607657b7-cd61-416c-8d7c-4339683a11d8 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:33.406543 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e5c37365-518e-4f5b-a56d-658f6aac372d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:33.407774 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-607657b7-cd61-416c-8d7c-4339683a11d8 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:33.408369 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e5c37365-518e-4f5b-a56d-658f6aac372d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:33.408916 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-607657b7-cd61-416c-8d7c-4339683a11d8 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:33.409354 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-607657b7-cd61-416c-8d7c-4339683a11d8 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:33.410063 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e5c37365-518e-4f5b-a56d-658f6aac372d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:33.584252 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-607657b7-cd61-416c-8d7c-4339683a11d8 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173a8e3cbc3b4926a213be2760dc9787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed02e7fc81c4a36a0d5c87132d56dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:33.593872 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-607657b7-cd61-416c-8d7c-4339683a11d8 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] 10.222.0.91 "GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc" status: 200 len: 1471 microversion: 2.1 time: 0.204462 Feb 21 01:11:33.596894 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 175/334] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:33 2022] GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc => generated 1471 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:33.661854 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e5c37365-518e-4f5b-a56d-658f6aac372d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:33.671361 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e5c37365-518e-4f5b-a56d-658f6aac372d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1318 microversion: 2.1 time: 0.282094 Feb 21 01:11:33.672458 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 160/335] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:33 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:33.736953 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c4a3546d-cb06-46e9-9032-c4526da2a95a tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:33.737575 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c4a3546d-cb06-46e9-9032-c4526da2a95a tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:33.745277 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c4a3546d-cb06-46e9-9032-c4526da2a95a tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:33.746162 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c4a3546d-cb06-46e9-9032-c4526da2a95a tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:33.747273 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c4a3546d-cb06-46e9-9032-c4526da2a95a tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:33.747617 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c4a3546d-cb06-46e9-9032-c4526da2a95a tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:33.902956 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c4a3546d-cb06-46e9-9032-c4526da2a95a tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:33.912271 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c4a3546d-cb06-46e9-9032-c4526da2a95a tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f" status: 200 len: 1317 microversion: 2.1 time: 0.179479 Feb 21 01:11:33.912772 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 176/336] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:33 2022] GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:33.993426 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2b6da920-cf52-4afb-b375-056e880cea83 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:33.994593 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2b6da920-cf52-4afb-b375-056e880cea83 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:34.007868 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b6da920-cf52-4afb-b375-056e880cea83 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:34.008722 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b6da920-cf52-4afb-b375-056e880cea83 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:34.010314 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b6da920-cf52-4afb-b375-056e880cea83 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:34.011319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b6da920-cf52-4afb-b375-056e880cea83 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:34.202128 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2b6da920-cf52-4afb-b375-056e880cea83 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:34.211134 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2b6da920-cf52-4afb-b375-056e880cea83 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1265 microversion: 2.1 time: 0.225568 Feb 21 01:11:34.211748 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 161/337] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:33 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:34.399675 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f79d4b42-9b23-4539-a983-b5112d1b2f6a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:34.400338 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f79d4b42-9b23-4539-a983-b5112d1b2f6a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:34.406731 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f79d4b42-9b23-4539-a983-b5112d1b2f6a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:34.407391 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f79d4b42-9b23-4539-a983-b5112d1b2f6a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:34.409121 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f79d4b42-9b23-4539-a983-b5112d1b2f6a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:34.409680 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f79d4b42-9b23-4539-a983-b5112d1b2f6a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:34.593912 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f79d4b42-9b23-4539-a983-b5112d1b2f6a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:34.602095 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f79d4b42-9b23-4539-a983-b5112d1b2f6a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.206577 Feb 21 01:11:34.602681 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 177/338] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:34 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:34.617034 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5c603eb8-e07e-4dcb-b893-729823ea1110 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:34.618001 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5c603eb8-e07e-4dcb-b893-729823ea1110 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:34.628999 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c603eb8-e07e-4dcb-b893-729823ea1110 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:34.629792 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c603eb8-e07e-4dcb-b893-729823ea1110 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:34.631190 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c603eb8-e07e-4dcb-b893-729823ea1110 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:34.632019 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c603eb8-e07e-4dcb-b893-729823ea1110 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:34.689224 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e0970c21-c283-43b8-8a57-567b4f9ae9c1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:34.690949 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e0970c21-c283-43b8-8a57-567b4f9ae9c1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:34.697618 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e0970c21-c283-43b8-8a57-567b4f9ae9c1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:34.698068 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e0970c21-c283-43b8-8a57-567b4f9ae9c1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:34.698860 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e0970c21-c283-43b8-8a57-567b4f9ae9c1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:34.699296 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e0970c21-c283-43b8-8a57-567b4f9ae9c1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:34.816774 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5c603eb8-e07e-4dcb-b893-729823ea1110 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173a8e3cbc3b4926a213be2760dc9787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed02e7fc81c4a36a0d5c87132d56dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:34.825378 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5c603eb8-e07e-4dcb-b893-729823ea1110 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] 10.222.0.91 "GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc" status: 200 len: 1471 microversion: 2.1 time: 0.215875 Feb 21 01:11:34.825963 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 162/339] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:34 2022] GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc => generated 1471 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:34.882628 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e0970c21-c283-43b8-8a57-567b4f9ae9c1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:34.891122 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e0970c21-c283-43b8-8a57-567b4f9ae9c1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1508 microversion: 2.1 time: 0.206301 Feb 21 01:11:34.895887 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 178/340] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:34 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1508 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:34.931251 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e3c8a586-4ba8-4360-bd6b-715e231a4196 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:34.931887 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e3c8a586-4ba8-4360-bd6b-715e231a4196 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:34.938038 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e3c8a586-4ba8-4360-bd6b-715e231a4196 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:34.938561 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e3c8a586-4ba8-4360-bd6b-715e231a4196 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:34.939783 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e3c8a586-4ba8-4360-bd6b-715e231a4196 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:34.940262 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e3c8a586-4ba8-4360-bd6b-715e231a4196 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:35.087516 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e3c8a586-4ba8-4360-bd6b-715e231a4196 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:35.096409 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e3c8a586-4ba8-4360-bd6b-715e231a4196 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f" status: 200 len: 1317 microversion: 2.1 time: 0.168655 Feb 21 01:11:35.104006 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 163/341] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:34 2022] GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:35.227794 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3923453c-8adb-470c-aff4-39fa54b77c47 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:35.228447 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3923453c-8adb-470c-aff4-39fa54b77c47 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:35.234828 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3923453c-8adb-470c-aff4-39fa54b77c47 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:35.235278 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3923453c-8adb-470c-aff4-39fa54b77c47 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:35.237169 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3923453c-8adb-470c-aff4-39fa54b77c47 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:35.237612 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3923453c-8adb-470c-aff4-39fa54b77c47 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:35.396240 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3923453c-8adb-470c-aff4-39fa54b77c47 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:35.404258 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3923453c-8adb-470c-aff4-39fa54b77c47 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1265 microversion: 2.1 time: 0.179897 Feb 21 01:11:35.404833 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 179/342] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:35 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:35.621325 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a54351aa-1b33-44ef-a85e-6a4dc9dde617 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:35.621924 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a54351aa-1b33-44ef-a85e-6a4dc9dde617 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:35.628998 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a54351aa-1b33-44ef-a85e-6a4dc9dde617 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:35.629446 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a54351aa-1b33-44ef-a85e-6a4dc9dde617 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:35.630254 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a54351aa-1b33-44ef-a85e-6a4dc9dde617 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:35.630721 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a54351aa-1b33-44ef-a85e-6a4dc9dde617 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:35.787446 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a54351aa-1b33-44ef-a85e-6a4dc9dde617 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:35.796685 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a54351aa-1b33-44ef-a85e-6a4dc9dde617 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.179090 Feb 21 01:11:35.797519 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 164/343] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:35 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:35.851507 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-aa694d55-8fe7-41ef-9be8-34ad92606302 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:35.852264 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-aa694d55-8fe7-41ef-9be8-34ad92606302 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:35.859662 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aa694d55-8fe7-41ef-9be8-34ad92606302 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:35.860260 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aa694d55-8fe7-41ef-9be8-34ad92606302 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:35.861141 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aa694d55-8fe7-41ef-9be8-34ad92606302 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:35.861680 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aa694d55-8fe7-41ef-9be8-34ad92606302 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:36.016892 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-aa694d55-8fe7-41ef-9be8-34ad92606302 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173a8e3cbc3b4926a213be2760dc9787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed02e7fc81c4a36a0d5c87132d56dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:36.025410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-aa694d55-8fe7-41ef-9be8-34ad92606302 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] 10.222.0.91 "GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc" status: 200 len: 1471 microversion: 2.1 time: 0.178051 Feb 21 01:11:36.025982 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 180/344] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:35 2022] GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:36.114100 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b3a1e15b-3d25-4084-b125-781e45620b16 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:36.115599 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b3a1e15b-3d25-4084-b125-781e45620b16 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:36.129374 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b3a1e15b-3d25-4084-b125-781e45620b16 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:36.129374 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b3a1e15b-3d25-4084-b125-781e45620b16 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:36.129374 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b3a1e15b-3d25-4084-b125-781e45620b16 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:36.129374 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b3a1e15b-3d25-4084-b125-781e45620b16 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:36.424124 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-78a86f21-a30d-4ab5-a7e6-5ac05a1f7a56 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:36.424124 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-78a86f21-a30d-4ab5-a7e6-5ac05a1f7a56 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:36.430208 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-78a86f21-a30d-4ab5-a7e6-5ac05a1f7a56 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:36.430663 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-78a86f21-a30d-4ab5-a7e6-5ac05a1f7a56 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:36.431456 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-78a86f21-a30d-4ab5-a7e6-5ac05a1f7a56 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:36.431924 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-78a86f21-a30d-4ab5-a7e6-5ac05a1f7a56 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:36.695104 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-78a86f21-a30d-4ab5-a7e6-5ac05a1f7a56 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:36.708591 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b3a1e15b-3d25-4084-b125-781e45620b16 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:36.713192 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-78a86f21-a30d-4ab5-a7e6-5ac05a1f7a56 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1265 microversion: 2.1 time: 0.293247 Feb 21 01:11:36.713983 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 181/345] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:36 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:36.727647 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b3a1e15b-3d25-4084-b125-781e45620b16 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f" status: 200 len: 1317 microversion: 2.1 time: 0.617406 Feb 21 01:11:36.729228 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 165/346] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:36 2022] GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f => generated 1317 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:36.819036 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d033a62c-f496-4bad-88a5-4730494da836 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:36.819761 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d033a62c-f496-4bad-88a5-4730494da836 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:36.837700 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d033a62c-f496-4bad-88a5-4730494da836 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:36.838486 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d033a62c-f496-4bad-88a5-4730494da836 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:36.839787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d033a62c-f496-4bad-88a5-4730494da836 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:36.840263 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d033a62c-f496-4bad-88a5-4730494da836 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:37.023332 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d033a62c-f496-4bad-88a5-4730494da836 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:37.031905 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d033a62c-f496-4bad-88a5-4730494da836 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.221006 Feb 21 01:11:37.033345 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 182/347] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:36 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:37.048576 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-652880c9-2c8e-426e-bf88-b3f071941dac tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:37.050192 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-652880c9-2c8e-426e-bf88-b3f071941dac tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:37.058436 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-308c2c4c-8ef3-459b-be96-16b030bf4fd0 req-802aa9ea-ad11-47dc-b151-01a3359decd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8240cf93-680f-47f2-bfe5-0b3fcafb79fc", "name": "network-vif-deleted", "tag": "51b4d095-281a-430c-b596-56994e39c1e0"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:37.060108 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-652880c9-2c8e-426e-bf88-b3f071941dac tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:37.060572 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-652880c9-2c8e-426e-bf88-b3f071941dac tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:37.061374 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-652880c9-2c8e-426e-bf88-b3f071941dac tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:37.061770 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:11:37.061770 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:11:37.064089 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-652880c9-2c8e-426e-bf88-b3f071941dac tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:37.073032 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-308c2c4c-8ef3-459b-be96-16b030bf4fd0 req-802aa9ea-ad11-47dc-b151-01a3359decd1 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:37.073032 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-308c2c4c-8ef3-459b-be96-16b030bf4fd0 req-802aa9ea-ad11-47dc-b151-01a3359decd1 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:37.082717 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-308c2c4c-8ef3-459b-be96-16b030bf4fd0 req-802aa9ea-ad11-47dc-b151-01a3359decd1 service nova] Creating event network-vif-deleted:51b4d095-281a-430c-b596-56994e39c1e0 for instance 8240cf93-680f-47f2-bfe5-0b3fcafb79fc on hv-cinder-81322 Feb 21 01:11:37.089083 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-308c2c4c-8ef3-459b-be96-16b030bf4fd0 req-802aa9ea-ad11-47dc-b151-01a3359decd1 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034847 Feb 21 01:11:37.092744 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 183/348] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:11:37.141023 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-652880c9-2c8e-426e-bf88-b3f071941dac tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173a8e3cbc3b4926a213be2760dc9787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed02e7fc81c4a36a0d5c87132d56dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:37.149251 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-652880c9-2c8e-426e-bf88-b3f071941dac tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] 10.222.0.91 "GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc" status: 200 len: 1429 microversion: 2.1 time: 0.110519 Feb 21 01:11:37.149835 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 166/349] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:37 2022] GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc => generated 1429 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:37.730878 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e830d985-2ec6-4917-bea1-28daf87c78b8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:37.731636 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e830d985-2ec6-4917-bea1-28daf87c78b8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:37.738402 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e830d985-2ec6-4917-bea1-28daf87c78b8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:37.738852 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e830d985-2ec6-4917-bea1-28daf87c78b8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:37.739643 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e830d985-2ec6-4917-bea1-28daf87c78b8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:37.740099 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e830d985-2ec6-4917-bea1-28daf87c78b8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:37.748225 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e43d5996-df85-4c4d-94a7-c79784c2bfab tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:37.749394 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e43d5996-df85-4c4d-94a7-c79784c2bfab tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:37.760324 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e43d5996-df85-4c4d-94a7-c79784c2bfab tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:37.761147 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e43d5996-df85-4c4d-94a7-c79784c2bfab tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:37.762669 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e43d5996-df85-4c4d-94a7-c79784c2bfab tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:37.763484 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e43d5996-df85-4c4d-94a7-c79784c2bfab tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:37.943953 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e830d985-2ec6-4917-bea1-28daf87c78b8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:37.957141 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e830d985-2ec6-4917-bea1-28daf87c78b8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1265 microversion: 2.1 time: 0.229853 Feb 21 01:11:37.958616 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 184/350] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:37 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:38.001396 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e43d5996-df85-4c4d-94a7-c79784c2bfab tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:38.010893 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e43d5996-df85-4c4d-94a7-c79784c2bfab tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f" status: 200 len: 1317 microversion: 2.1 time: 0.268664 Feb 21 01:11:38.011768 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 167/351] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:37 2022] GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:38.051305 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2fb8cbbc-f96f-4a94-8551-993e673e856b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:38.051951 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2fb8cbbc-f96f-4a94-8551-993e673e856b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:38.058484 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2fb8cbbc-f96f-4a94-8551-993e673e856b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:38.058937 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2fb8cbbc-f96f-4a94-8551-993e673e856b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:38.060411 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2fb8cbbc-f96f-4a94-8551-993e673e856b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:38.060411 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2fb8cbbc-f96f-4a94-8551-993e673e856b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:38.167167 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-eb570864-c548-4852-914e-d26cf99b1cd9 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:38.168071 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-eb570864-c548-4852-914e-d26cf99b1cd9 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:38.177942 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eb570864-c548-4852-914e-d26cf99b1cd9 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:38.178640 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eb570864-c548-4852-914e-d26cf99b1cd9 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:38.181080 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eb570864-c548-4852-914e-d26cf99b1cd9 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:38.183211 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eb570864-c548-4852-914e-d26cf99b1cd9 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:38.220715 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2fb8cbbc-f96f-4a94-8551-993e673e856b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:38.229406 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eb570864-c548-4852-914e-d26cf99b1cd9 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:38.229978 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eb570864-c548-4852-914e-d26cf99b1cd9 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:38.230252 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2fb8cbbc-f96f-4a94-8551-993e673e856b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.183333 Feb 21 01:11:38.230396 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.objects.instance [None req-eb570864-c548-4852-914e-d26cf99b1cd9 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lazy-loading 'fault' on Instance uuid 8240cf93-680f-47f2-bfe5-0b3fcafb79fc {{(pid=117138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:11:38.230833 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 185/352] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:38 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:38.280217 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-eb570864-c548-4852-914e-d26cf99b1cd9 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173a8e3cbc3b4926a213be2760dc9787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed02e7fc81c4a36a0d5c87132d56dc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:38.289036 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-eb570864-c548-4852-914e-d26cf99b1cd9 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] 10.222.0.91 "GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc" status: 200 len: 1305 microversion: 2.1 time: 0.126074 Feb 21 01:11:38.293108 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 168/353] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:38 2022] GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc => generated 1305 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:38.974362 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9bc579cf-393f-46ce-877f-2d51a1233c12 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:38.975016 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9bc579cf-393f-46ce-877f-2d51a1233c12 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:38.998766 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9bc579cf-393f-46ce-877f-2d51a1233c12 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:38.999217 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9bc579cf-393f-46ce-877f-2d51a1233c12 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:39.000096 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9bc579cf-393f-46ce-877f-2d51a1233c12 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:39.000500 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9bc579cf-393f-46ce-877f-2d51a1233c12 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:39.029127 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c705d051-48ae-4228-8860-7ee921302d15 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:39.035238 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c705d051-48ae-4228-8860-7ee921302d15 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:39.045130 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c705d051-48ae-4228-8860-7ee921302d15 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:39.045130 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c705d051-48ae-4228-8860-7ee921302d15 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:39.045130 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c705d051-48ae-4228-8860-7ee921302d15 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:39.045130 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c705d051-48ae-4228-8860-7ee921302d15 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:39.222865 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9bc579cf-393f-46ce-877f-2d51a1233c12 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:39.230263 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9bc579cf-393f-46ce-877f-2d51a1233c12 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1265 microversion: 2.1 time: 0.259432 Feb 21 01:11:39.231062 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 186/354] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:38 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:39.236581 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-a744383d-cd81-4f55-babd-6c748e466904 req-551eb705-ba44-48fa-92be-98096fb5f285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "748a5623-7930-404e-9e68-e2c4f9439c0f", "name": "network-vif-plugged", "status": "completed", "tag": "34bd5660-c394-4cc0-ad67-5a45a2bc7853"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:39.238511 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:11:39.238511 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:11:39.243540 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c705d051-48ae-4228-8860-7ee921302d15 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:39.247598 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-a744383d-cd81-4f55-babd-6c748e466904 req-551eb705-ba44-48fa-92be-98096fb5f285 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:39.248250 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-a744383d-cd81-4f55-babd-6c748e466904 req-551eb705-ba44-48fa-92be-98096fb5f285 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:39.251315 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c705d051-48ae-4228-8860-7ee921302d15 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f" status: 200 len: 1317 microversion: 2.1 time: 0.226522 Feb 21 01:11:39.252117 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 169/355] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:39 2022] GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:39.256514 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-286f6448-bae0-4469-b996-f597c48a56de tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:39.257300 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-286f6448-bae0-4469-b996-f597c48a56de tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:39.263653 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-286f6448-bae0-4469-b996-f597c48a56de tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:39.264389 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-286f6448-bae0-4469-b996-f597c48a56de tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:39.265208 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-286f6448-bae0-4469-b996-f597c48a56de tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:39.265639 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-286f6448-bae0-4469-b996-f597c48a56de tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:39.265944 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-a744383d-cd81-4f55-babd-6c748e466904 req-551eb705-ba44-48fa-92be-98096fb5f285 service nova] Creating event network-vif-plugged:34bd5660-c394-4cc0-ad67-5a45a2bc7853 for instance 748a5623-7930-404e-9e68-e2c4f9439c0f on hv-cinder-81322 Feb 21 01:11:39.284328 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-a744383d-cd81-4f55-babd-6c748e466904 req-551eb705-ba44-48fa-92be-98096fb5f285 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046974 Feb 21 01:11:39.284328 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 187/356] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:11:39.306998 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-35a64ef4-4263-4ee3-8d70-e6d8d0076dc5 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:39.307612 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-35a64ef4-4263-4ee3-8d70-e6d8d0076dc5 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] [instance: 8240cf93-680f-47f2-bfe5-0b3fcafb79fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:39.315951 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-35a64ef4-4263-4ee3-8d70-e6d8d0076dc5 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:39.316406 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-35a64ef4-4263-4ee3-8d70-e6d8d0076dc5 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:39.317303 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-35a64ef4-4263-4ee3-8d70-e6d8d0076dc5 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:39.317825 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-35a64ef4-4263-4ee3-8d70-e6d8d0076dc5 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:39.332782 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-35a64ef4-4263-4ee3-8d70-e6d8d0076dc5 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] HTTP exception thrown: Instance 8240cf93-680f-47f2-bfe5-0b3fcafb79fc could not be found. Feb 21 01:11:39.333472 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-35a64ef4-4263-4ee3-8d70-e6d8d0076dc5 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] Returning 404 to user: Instance 8240cf93-680f-47f2-bfe5-0b3fcafb79fc could not be found. {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:11:39.334403 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-35a64ef4-4263-4ee3-8d70-e6d8d0076dc5 tempest-VolumesNegativeTest-1841277368 tempest-VolumesNegativeTest-1841277368-project] 10.222.0.91 "GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc" status: 404 len: 111 microversion: 2.1 time: 0.031573 Feb 21 01:11:39.335036 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 188/357] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:39 2022] GET /compute/v2.1/servers/8240cf93-680f-47f2-bfe5-0b3fcafb79fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:11:39.448326 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-286f6448-bae0-4469-b996-f597c48a56de tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:39.462902 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-286f6448-bae0-4469-b996-f597c48a56de tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.209731 Feb 21 01:11:39.463969 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 170/358] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:39 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:40.248132 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f7edd8b6-9d4a-45af-a8f6-9b4bf9814141 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:40.248774 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f7edd8b6-9d4a-45af-a8f6-9b4bf9814141 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:40.255936 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f7edd8b6-9d4a-45af-a8f6-9b4bf9814141 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:40.256398 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f7edd8b6-9d4a-45af-a8f6-9b4bf9814141 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:40.257191 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f7edd8b6-9d4a-45af-a8f6-9b4bf9814141 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:40.257619 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f7edd8b6-9d4a-45af-a8f6-9b4bf9814141 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:40.268390 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-04b60800-4a1f-43de-a87d-934a417b8ce7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:40.269001 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-04b60800-4a1f-43de-a87d-934a417b8ce7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:40.275655 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-04b60800-4a1f-43de-a87d-934a417b8ce7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:40.276141 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-04b60800-4a1f-43de-a87d-934a417b8ce7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:40.277166 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-04b60800-4a1f-43de-a87d-934a417b8ce7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:40.277771 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-04b60800-4a1f-43de-a87d-934a417b8ce7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:40.439308 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f7edd8b6-9d4a-45af-a8f6-9b4bf9814141 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:40.442279 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-04b60800-4a1f-43de-a87d-934a417b8ce7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:40.446905 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f7edd8b6-9d4a-45af-a8f6-9b4bf9814141 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1265 microversion: 2.1 time: 0.203190 Feb 21 01:11:40.447575 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 189/359] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:40 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:40.449649 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-04b60800-4a1f-43de-a87d-934a417b8ce7 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f" status: 200 len: 1317 microversion: 2.1 time: 0.185963 Feb 21 01:11:40.450261 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 171/360] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:40 2022] GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:40.492088 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-13a10756-e40b-4ba3-a94a-c61d2387e1d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:40.493106 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-13a10756-e40b-4ba3-a94a-c61d2387e1d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:40.501146 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-13a10756-e40b-4ba3-a94a-c61d2387e1d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:40.501650 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-13a10756-e40b-4ba3-a94a-c61d2387e1d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:40.502604 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-13a10756-e40b-4ba3-a94a-c61d2387e1d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:40.503041 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-13a10756-e40b-4ba3-a94a-c61d2387e1d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:40.710597 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-13a10756-e40b-4ba3-a94a-c61d2387e1d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:40.719162 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-13a10756-e40b-4ba3-a94a-c61d2387e1d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.233617 Feb 21 01:11:40.720540 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 190/361] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:40 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:41.463592 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d970bb0a-25ea-444d-8828-e69061f72066 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:41.464251 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d970bb0a-25ea-444d-8828-e69061f72066 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:41.466252 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1613f912-d0f4-40d1-b032-0b1ba50aee5e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:41.466858 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1613f912-d0f4-40d1-b032-0b1ba50aee5e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:41.471758 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d970bb0a-25ea-444d-8828-e69061f72066 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:41.472375 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d970bb0a-25ea-444d-8828-e69061f72066 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:41.473171 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d970bb0a-25ea-444d-8828-e69061f72066 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:41.473611 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d970bb0a-25ea-444d-8828-e69061f72066 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:41.474034 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1613f912-d0f4-40d1-b032-0b1ba50aee5e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:41.474487 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1613f912-d0f4-40d1-b032-0b1ba50aee5e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:41.475268 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1613f912-d0f4-40d1-b032-0b1ba50aee5e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:41.475755 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1613f912-d0f4-40d1-b032-0b1ba50aee5e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:41.644605 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d970bb0a-25ea-444d-8828-e69061f72066 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:41.651996 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d970bb0a-25ea-444d-8828-e69061f72066 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1265 microversion: 2.1 time: 0.191930 Feb 21 01:11:41.652570 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 172/362] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:41 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:41.670458 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1613f912-d0f4-40d1-b032-0b1ba50aee5e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:41.678460 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1613f912-d0f4-40d1-b032-0b1ba50aee5e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f" status: 200 len: 1507 microversion: 2.1 time: 0.215847 Feb 21 01:11:41.679250 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 191/363] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:41 2022] GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:41.740014 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-97464164-f6ef-4ffd-8bdd-b2e4c1dc0635 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:41.740768 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-97464164-f6ef-4ffd-8bdd-b2e4c1dc0635 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:41.746767 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-97464164-f6ef-4ffd-8bdd-b2e4c1dc0635 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:41.747337 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-97464164-f6ef-4ffd-8bdd-b2e4c1dc0635 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:41.748263 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-97464164-f6ef-4ffd-8bdd-b2e4c1dc0635 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:41.748775 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-97464164-f6ef-4ffd-8bdd-b2e4c1dc0635 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:41.917969 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-97464164-f6ef-4ffd-8bdd-b2e4c1dc0635 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:41.927186 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-97464164-f6ef-4ffd-8bdd-b2e4c1dc0635 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.192518 Feb 21 01:11:41.931874 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 173/364] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:41 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:42.669419 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a5f521b5-b66b-48d1-812c-a033cce89bb4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:42.670051 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a5f521b5-b66b-48d1-812c-a033cce89bb4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:42.678331 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a5f521b5-b66b-48d1-812c-a033cce89bb4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:42.678331 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a5f521b5-b66b-48d1-812c-a033cce89bb4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:42.679030 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a5f521b5-b66b-48d1-812c-a033cce89bb4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:42.679462 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a5f521b5-b66b-48d1-812c-a033cce89bb4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:42.846669 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a5f521b5-b66b-48d1-812c-a033cce89bb4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:42.854712 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a5f521b5-b66b-48d1-812c-a033cce89bb4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1265 microversion: 2.1 time: 0.189095 Feb 21 01:11:42.855787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 192/365] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:42 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:42.945038 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e66d2f38-a148-4ed4-bf07-088cc84cdd88 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:42.945883 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e66d2f38-a148-4ed4-bf07-088cc84cdd88 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:42.958505 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e66d2f38-a148-4ed4-bf07-088cc84cdd88 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:42.958505 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e66d2f38-a148-4ed4-bf07-088cc84cdd88 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:42.959696 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e66d2f38-a148-4ed4-bf07-088cc84cdd88 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:42.960530 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e66d2f38-a148-4ed4-bf07-088cc84cdd88 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:42.972289 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-c9ff177d-0d5d-4300-8995-760e4dfd7bf8 req-38ab0d10-1efc-4741-bbf2-07babc37b257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f114c776-ca8f-4972-a0a7-3af4a2740a2e", "name": "network-vif-plugged", "status": "completed", "tag": "6f209b80-f946-4b10-9f3f-3eab83a2ef86"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:42.975876 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:11:42.975876 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:11:42.984197 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-c9ff177d-0d5d-4300-8995-760e4dfd7bf8 req-38ab0d10-1efc-4741-bbf2-07babc37b257 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:42.984942 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-c9ff177d-0d5d-4300-8995-760e4dfd7bf8 req-38ab0d10-1efc-4741-bbf2-07babc37b257 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:43.005209 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-c9ff177d-0d5d-4300-8995-760e4dfd7bf8 req-38ab0d10-1efc-4741-bbf2-07babc37b257 service nova] Creating event network-vif-plugged:6f209b80-f946-4b10-9f3f-3eab83a2ef86 for instance f114c776-ca8f-4972-a0a7-3af4a2740a2e on hv-cinder-81322 Feb 21 01:11:43.011348 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-c9ff177d-0d5d-4300-8995-760e4dfd7bf8 req-38ab0d10-1efc-4741-bbf2-07babc37b257 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042987 Feb 21 01:11:43.024753 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 193/366] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:11:43.139080 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e66d2f38-a148-4ed4-bf07-088cc84cdd88 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:43.148444 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e66d2f38-a148-4ed4-bf07-088cc84cdd88 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.207196 Feb 21 01:11:43.149335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 174/367] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:42 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:43.397802 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c43147a0-58b2-4409-8d33-7cd007fddc8c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45a6bf29-5bbc-4337-b274-3fee38707ff7"}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:43.398988 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c43147a0-58b2-4409-8d33-7cd007fddc8c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:43.405787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c43147a0-58b2-4409-8d33-7cd007fddc8c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:43.406259 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c43147a0-58b2-4409-8d33-7cd007fddc8c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:43.407205 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c43147a0-58b2-4409-8d33-7cd007fddc8c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:43.408058 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c43147a0-58b2-4409-8d33-7cd007fddc8c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:43.874161 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-491c97e2-7715-4d92-9a23-4f4be06af4c7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:43.874161 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-491c97e2-7715-4d92-9a23-4f4be06af4c7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:43.878866 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-491c97e2-7715-4d92-9a23-4f4be06af4c7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:43.879317 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-491c97e2-7715-4d92-9a23-4f4be06af4c7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:43.880127 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-491c97e2-7715-4d92-9a23-4f4be06af4c7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:43.880556 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-491c97e2-7715-4d92-9a23-4f4be06af4c7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:44.026782 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-491c97e2-7715-4d92-9a23-4f4be06af4c7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:44.035018 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-491c97e2-7715-4d92-9a23-4f4be06af4c7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1265 microversion: 2.1 time: 0.167289 Feb 21 01:11:44.035585 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 175/368] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:43 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:44.168208 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a3a6becf-6955-4f38-83bf-090947fab704 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:44.169779 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a3a6becf-6955-4f38-83bf-090947fab704 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:44.176630 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a3a6becf-6955-4f38-83bf-090947fab704 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:44.177077 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a3a6becf-6955-4f38-83bf-090947fab704 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:44.177865 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a3a6becf-6955-4f38-83bf-090947fab704 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:44.178303 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a3a6becf-6955-4f38-83bf-090947fab704 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:44.341425 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a3a6becf-6955-4f38-83bf-090947fab704 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:44.350030 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c43147a0-58b2-4409-8d33-7cd007fddc8c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "POST /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.955990 Feb 21 01:11:44.350640 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 194/369] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Feb 21 01:11:43 2022] POST /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f/os-volume_attachments => generated 194 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:11:44.351775 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a3a6becf-6955-4f38-83bf-090947fab704 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.188340 Feb 21 01:11:44.354557 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 176/370] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:44 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:45.052976 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ad09be34-9b13-473d-b98a-6f3a48c45794 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:45.053660 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ad09be34-9b13-473d-b98a-6f3a48c45794 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:45.060336 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad09be34-9b13-473d-b98a-6f3a48c45794 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:45.060782 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad09be34-9b13-473d-b98a-6f3a48c45794 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:45.061564 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad09be34-9b13-473d-b98a-6f3a48c45794 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:45.061995 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad09be34-9b13-473d-b98a-6f3a48c45794 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:45.213170 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ad09be34-9b13-473d-b98a-6f3a48c45794 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:45.223161 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ad09be34-9b13-473d-b98a-6f3a48c45794 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1265 microversion: 2.1 time: 0.174057 Feb 21 01:11:45.223858 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 195/371] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:45 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:45.377970 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e9f0e1d9-d0ed-4ead-830a-45a6b0cb0221 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:45.378746 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e9f0e1d9-d0ed-4ead-830a-45a6b0cb0221 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:45.389968 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e9f0e1d9-d0ed-4ead-830a-45a6b0cb0221 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:45.390410 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e9f0e1d9-d0ed-4ead-830a-45a6b0cb0221 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:45.391244 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e9f0e1d9-d0ed-4ead-830a-45a6b0cb0221 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:45.392354 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e9f0e1d9-d0ed-4ead-830a-45a6b0cb0221 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:45.573518 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e9f0e1d9-d0ed-4ead-830a-45a6b0cb0221 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:45.583804 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e9f0e1d9-d0ed-4ead-830a-45a6b0cb0221 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.209841 Feb 21 01:11:45.592505 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 177/372] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:45 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:46.241178 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-db4a480f-6bcb-449d-b194-ea571913a87d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:46.244636 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-db4a480f-6bcb-449d-b194-ea571913a87d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:46.248479 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db4a480f-6bcb-449d-b194-ea571913a87d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:46.248928 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db4a480f-6bcb-449d-b194-ea571913a87d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:46.249869 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db4a480f-6bcb-449d-b194-ea571913a87d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:46.250364 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db4a480f-6bcb-449d-b194-ea571913a87d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:46.403166 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-db4a480f-6bcb-449d-b194-ea571913a87d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:46.412854 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-db4a480f-6bcb-449d-b194-ea571913a87d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1451 microversion: 2.1 time: 0.175565 Feb 21 01:11:46.413426 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 196/373] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:46 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1451 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:46.429922 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a483e0c4-7bc9-40e3-a7d2-8fe0bef47c75 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:46.430531 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a483e0c4-7bc9-40e3-a7d2-8fe0bef47c75 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:46.436727 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a483e0c4-7bc9-40e3-a7d2-8fe0bef47c75 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:46.437172 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a483e0c4-7bc9-40e3-a7d2-8fe0bef47c75 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:46.437943 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a483e0c4-7bc9-40e3-a7d2-8fe0bef47c75 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:46.438374 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a483e0c4-7bc9-40e3-a7d2-8fe0bef47c75 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:46.594448 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a483e0c4-7bc9-40e3-a7d2-8fe0bef47c75 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:46.601872 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8af6a126-29dd-4dad-ae26-53b3e761269e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:46.602240 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a483e0c4-7bc9-40e3-a7d2-8fe0bef47c75 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1451 microversion: 2.1 time: 0.176021 Feb 21 01:11:46.602478 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8af6a126-29dd-4dad-ae26-53b3e761269e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:46.602799 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 178/374] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:46 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1451 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:46.608515 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8af6a126-29dd-4dad-ae26-53b3e761269e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:46.608999 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8af6a126-29dd-4dad-ae26-53b3e761269e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:46.609778 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8af6a126-29dd-4dad-ae26-53b3e761269e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:46.610209 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8af6a126-29dd-4dad-ae26-53b3e761269e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:46.755103 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8af6a126-29dd-4dad-ae26-53b3e761269e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:46.764308 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8af6a126-29dd-4dad-ae26-53b3e761269e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.166215 Feb 21 01:11:46.764875 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 197/375] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:46 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:47.781561 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1ef7f69e-5d28-47bf-a9bc-74c4af153d19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:47.782312 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1ef7f69e-5d28-47bf-a9bc-74c4af153d19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:47.788914 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1ef7f69e-5d28-47bf-a9bc-74c4af153d19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:47.789341 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1ef7f69e-5d28-47bf-a9bc-74c4af153d19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:47.790140 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1ef7f69e-5d28-47bf-a9bc-74c4af153d19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:47.790572 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1ef7f69e-5d28-47bf-a9bc-74c4af153d19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:47.944330 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1ef7f69e-5d28-47bf-a9bc-74c4af153d19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:47.953955 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1ef7f69e-5d28-47bf-a9bc-74c4af153d19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.175318 Feb 21 01:11:47.955876 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 179/376] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:47 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:48.973388 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b0643a8c-e2ab-47a6-9fb3-34c33d0aa3a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:48.974001 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b0643a8c-e2ab-47a6-9fb3-34c33d0aa3a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:48.980455 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b0643a8c-e2ab-47a6-9fb3-34c33d0aa3a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:48.980908 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b0643a8c-e2ab-47a6-9fb3-34c33d0aa3a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:48.981726 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b0643a8c-e2ab-47a6-9fb3-34c33d0aa3a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:48.982162 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b0643a8c-e2ab-47a6-9fb3-34c33d0aa3a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:49.256650 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b0643a8c-e2ab-47a6-9fb3-34c33d0aa3a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:49.264672 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b0643a8c-e2ab-47a6-9fb3-34c33d0aa3a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.295574 Feb 21 01:11:49.265247 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 198/377] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:48 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:49.506732 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-3ab6464c-d82d-4d48-9502-b78247e9a1b7 req-c3cd370f-3098-4a90-9d57-dc6fe7bb18e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f114c776-ca8f-4972-a0a7-3af4a2740a2e", "tag": "6f209b80-f946-4b10-9f3f-3eab83a2ef86"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:49.508395 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:11:49.508395 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:11:49.515860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-3ab6464c-d82d-4d48-9502-b78247e9a1b7 req-c3cd370f-3098-4a90-9d57-dc6fe7bb18e3 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:49.516325 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-3ab6464c-d82d-4d48-9502-b78247e9a1b7 req-c3cd370f-3098-4a90-9d57-dc6fe7bb18e3 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:49.528796 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-3ab6464c-d82d-4d48-9502-b78247e9a1b7 req-c3cd370f-3098-4a90-9d57-dc6fe7bb18e3 service nova] Creating event network-changed:6f209b80-f946-4b10-9f3f-3eab83a2ef86 for instance f114c776-ca8f-4972-a0a7-3af4a2740a2e on hv-cinder-81322 Feb 21 01:11:49.534086 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-3ab6464c-d82d-4d48-9502-b78247e9a1b7 req-c3cd370f-3098-4a90-9d57-dc6fe7bb18e3 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030972 Feb 21 01:11:49.534684 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 180/378] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:11:50.283038 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-89b5dd51-81d8-4b6f-8a22-4c2dd4b78fe3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:50.284637 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-89b5dd51-81d8-4b6f-8a22-4c2dd4b78fe3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:50.291594 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-89b5dd51-81d8-4b6f-8a22-4c2dd4b78fe3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:50.292076 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-89b5dd51-81d8-4b6f-8a22-4c2dd4b78fe3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:50.292883 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-89b5dd51-81d8-4b6f-8a22-4c2dd4b78fe3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:50.293331 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-89b5dd51-81d8-4b6f-8a22-4c2dd4b78fe3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:50.450073 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-89b5dd51-81d8-4b6f-8a22-4c2dd4b78fe3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:50.461734 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-89b5dd51-81d8-4b6f-8a22-4c2dd4b78fe3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.182250 Feb 21 01:11:50.462849 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 199/379] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:50 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:51.482913 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-326819e6-421c-428f-bd19-85abe046319d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:51.483871 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-326819e6-421c-428f-bd19-85abe046319d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:51.490883 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-326819e6-421c-428f-bd19-85abe046319d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:51.491327 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-326819e6-421c-428f-bd19-85abe046319d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:51.492178 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-326819e6-421c-428f-bd19-85abe046319d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:51.492617 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-326819e6-421c-428f-bd19-85abe046319d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:51.652410 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-326819e6-421c-428f-bd19-85abe046319d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:51.661506 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-326819e6-421c-428f-bd19-85abe046319d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.184062 Feb 21 01:11:51.662089 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 181/380] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:51 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:52.678511 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ad593ed9-dabf-4f61-a77e-1f300e157204 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:52.679264 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ad593ed9-dabf-4f61-a77e-1f300e157204 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:52.686116 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad593ed9-dabf-4f61-a77e-1f300e157204 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:52.686607 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad593ed9-dabf-4f61-a77e-1f300e157204 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:52.687412 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad593ed9-dabf-4f61-a77e-1f300e157204 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:52.687860 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad593ed9-dabf-4f61-a77e-1f300e157204 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:52.841216 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ad593ed9-dabf-4f61-a77e-1f300e157204 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:52.850067 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ad593ed9-dabf-4f61-a77e-1f300e157204 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.175576 Feb 21 01:11:52.850632 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 200/381] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:52 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:53.125894 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4104f9b2-3b63-40f1-ad21-d8c520d2316e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:53.127259 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4104f9b2-3b63-40f1-ad21-d8c520d2316e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:53.133559 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4104f9b2-3b63-40f1-ad21-d8c520d2316e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:53.134017 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4104f9b2-3b63-40f1-ad21-d8c520d2316e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:53.134814 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4104f9b2-3b63-40f1-ad21-d8c520d2316e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:53.135288 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4104f9b2-3b63-40f1-ad21-d8c520d2316e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:53.221123 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.objects.instance [None req-4104f9b2-3b63-40f1-ad21-d8c520d2316e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lazy-loading 'services' on Instance uuid 748a5623-7930-404e-9e68-e2c4f9439c0f {{(pid=117138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:11:53.507766 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4104f9b2-3b63-40f1-ad21-d8c520d2316e tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "DELETE /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f/os-volume_attachments/45a6bf29-5bbc-4337-b274-3fee38707ff7" status: 202 len: 0 microversion: 2.1 time: 0.385522 Feb 21 01:11:53.508387 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 182/382] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Feb 21 01:11:53 2022] DELETE /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f/os-volume_attachments/45a6bf29-5bbc-4337-b274-3fee38707ff7 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:11:53.518347 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-260ee81e-3e97-48c3-bb12-dd3806f40db0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:53.519592 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-260ee81e-3e97-48c3-bb12-dd3806f40db0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:53.526119 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-260ee81e-3e97-48c3-bb12-dd3806f40db0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:53.526569 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-260ee81e-3e97-48c3-bb12-dd3806f40db0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:53.527375 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-260ee81e-3e97-48c3-bb12-dd3806f40db0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:53.527806 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-260ee81e-3e97-48c3-bb12-dd3806f40db0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:53.559300 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-260ee81e-3e97-48c3-bb12-dd3806f40db0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046427 Feb 21 01:11:53.559887 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 201/383] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:11:53 2022] GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:11:53.867952 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ea75df23-ffd9-4f12-9544-a9d39be39967 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:53.868668 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ea75df23-ffd9-4f12-9544-a9d39be39967 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:53.875067 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ea75df23-ffd9-4f12-9544-a9d39be39967 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:53.875516 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ea75df23-ffd9-4f12-9544-a9d39be39967 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:53.876362 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ea75df23-ffd9-4f12-9544-a9d39be39967 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:53.877457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ea75df23-ffd9-4f12-9544-a9d39be39967 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:54.026284 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ea75df23-ffd9-4f12-9544-a9d39be39967 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:54.036867 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ea75df23-ffd9-4f12-9544-a9d39be39967 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.172980 Feb 21 01:11:54.037496 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 183/384] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:53 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:54.572237 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3dcb9d6d-d85e-4b2e-97d8-cf66f185add5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:54.573235 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3dcb9d6d-d85e-4b2e-97d8-cf66f185add5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:54.580409 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3dcb9d6d-d85e-4b2e-97d8-cf66f185add5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:54.581347 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3dcb9d6d-d85e-4b2e-97d8-cf66f185add5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:54.582177 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3dcb9d6d-d85e-4b2e-97d8-cf66f185add5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:54.582605 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3dcb9d6d-d85e-4b2e-97d8-cf66f185add5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:54.614914 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3dcb9d6d-d85e-4b2e-97d8-cf66f185add5 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047976 Feb 21 01:11:54.615486 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 202/385] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:11:54 2022] GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:11:55.054707 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7cb7508f-1962-49f2-a23f-1b582a3152c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:55.055412 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7cb7508f-1962-49f2-a23f-1b582a3152c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:55.061450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7cb7508f-1962-49f2-a23f-1b582a3152c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:55.061888 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7cb7508f-1962-49f2-a23f-1b582a3152c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:55.062674 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7cb7508f-1962-49f2-a23f-1b582a3152c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:55.063102 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7cb7508f-1962-49f2-a23f-1b582a3152c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:55.222835 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7cb7508f-1962-49f2-a23f-1b582a3152c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:55.231209 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7cb7508f-1962-49f2-a23f-1b582a3152c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.180847 Feb 21 01:11:55.235083 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 184/386] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:55 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:55.625529 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4513a6aa-9df9-4104-b847-3fd50a44ee65 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:55.626439 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4513a6aa-9df9-4104-b847-3fd50a44ee65 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:55.634292 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4513a6aa-9df9-4104-b847-3fd50a44ee65 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:55.634743 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4513a6aa-9df9-4104-b847-3fd50a44ee65 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:55.639668 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4513a6aa-9df9-4104-b847-3fd50a44ee65 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:55.639668 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4513a6aa-9df9-4104-b847-3fd50a44ee65 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:55.667664 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4513a6aa-9df9-4104-b847-3fd50a44ee65 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045818 Feb 21 01:11:55.668269 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 203/387] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:11:55 2022] GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 01:11:56.249198 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b6b640a0-5c05-4b4a-8f7e-f7700708c689 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:56.249949 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b6b640a0-5c05-4b4a-8f7e-f7700708c689 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:56.257707 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b6b640a0-5c05-4b4a-8f7e-f7700708c689 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:56.258179 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b6b640a0-5c05-4b4a-8f7e-f7700708c689 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:56.259171 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b6b640a0-5c05-4b4a-8f7e-f7700708c689 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:56.259646 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b6b640a0-5c05-4b4a-8f7e-f7700708c689 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:56.405600 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b6b640a0-5c05-4b4a-8f7e-f7700708c689 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:56.415576 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b6b640a0-5c05-4b4a-8f7e-f7700708c689 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.170109 Feb 21 01:11:56.416471 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 185/388] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:56 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:56.997366 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9dc9fbcc-3c85-4fe1-ad7c-bcdf08c53265 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:56.998053 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9dc9fbcc-3c85-4fe1-ad7c-bcdf08c53265 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:57.005966 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9dc9fbcc-3c85-4fe1-ad7c-bcdf08c53265 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:57.006435 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9dc9fbcc-3c85-4fe1-ad7c-bcdf08c53265 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:57.007246 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9dc9fbcc-3c85-4fe1-ad7c-bcdf08c53265 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:57.007673 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9dc9fbcc-3c85-4fe1-ad7c-bcdf08c53265 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:57.037683 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9dc9fbcc-3c85-4fe1-ad7c-bcdf08c53265 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Going to try to terminate instance {{(pid=117139) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:11:57.389754 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9dc9fbcc-3c85-4fe1-ad7c-bcdf08c53265 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "DELETE /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f" status: 204 len: 0 microversion: 2.1 time: 0.396053 Feb 21 01:11:57.390353 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 204/389] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Feb 21 01:11:56 2022] DELETE /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:11:57.399301 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0b324d68-7bdd-40f3-a81b-133ea793c6b2 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:57.399928 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0b324d68-7bdd-40f3-a81b-133ea793c6b2 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:57.406295 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0b324d68-7bdd-40f3-a81b-133ea793c6b2 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:57.406736 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0b324d68-7bdd-40f3-a81b-133ea793c6b2 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:57.407517 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0b324d68-7bdd-40f3-a81b-133ea793c6b2 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:57.407988 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0b324d68-7bdd-40f3-a81b-133ea793c6b2 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:57.435266 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-75f38ebe-fb34-4544-a2c9-ee3b614cae46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:57.436087 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-75f38ebe-fb34-4544-a2c9-ee3b614cae46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:57.444810 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-75f38ebe-fb34-4544-a2c9-ee3b614cae46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:57.445478 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-75f38ebe-fb34-4544-a2c9-ee3b614cae46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:57.446174 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-75f38ebe-fb34-4544-a2c9-ee3b614cae46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:57.446611 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-75f38ebe-fb34-4544-a2c9-ee3b614cae46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:57.583769 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0b324d68-7bdd-40f3-a81b-133ea793c6b2 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:57.593022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0b324d68-7bdd-40f3-a81b-133ea793c6b2 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f" status: 200 len: 1513 microversion: 2.1 time: 0.197301 Feb 21 01:11:57.593778 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 186/390] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:57 2022] GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:57.633248 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-75f38ebe-fb34-4544-a2c9-ee3b614cae46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:57.643011 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-75f38ebe-fb34-4544-a2c9-ee3b614cae46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.212503 Feb 21 01:11:57.645821 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 205/391] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:57 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:58.613155 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2aecd2a9-c790-4d0d-ad4c-e19a0c141568 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:58.614157 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2aecd2a9-c790-4d0d-ad4c-e19a0c141568 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:58.620925 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2aecd2a9-c790-4d0d-ad4c-e19a0c141568 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:58.621374 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2aecd2a9-c790-4d0d-ad4c-e19a0c141568 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:58.622173 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2aecd2a9-c790-4d0d-ad4c-e19a0c141568 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:58.622609 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2aecd2a9-c790-4d0d-ad4c-e19a0c141568 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:58.673819 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1e8fb409-dea2-47e2-9be5-02697ee9367c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:58.676167 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1e8fb409-dea2-47e2-9be5-02697ee9367c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:58.689892 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e8fb409-dea2-47e2-9be5-02697ee9367c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:58.690700 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e8fb409-dea2-47e2-9be5-02697ee9367c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:58.692207 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e8fb409-dea2-47e2-9be5-02697ee9367c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:58.693346 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e8fb409-dea2-47e2-9be5-02697ee9367c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:58.822540 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2aecd2a9-c790-4d0d-ad4c-e19a0c141568 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:58.834280 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2aecd2a9-c790-4d0d-ad4c-e19a0c141568 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f" status: 200 len: 1513 microversion: 2.1 time: 0.226275 Feb 21 01:11:58.835076 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 187/392] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:58 2022] GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:58.866674 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1e8fb409-dea2-47e2-9be5-02697ee9367c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:58.875386 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1e8fb409-dea2-47e2-9be5-02697ee9367c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.208752 Feb 21 01:11:58.875993 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 206/393] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:58 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:59.253567 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ce614994-5dc5-4611-8749-6e58cd92d15a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "859d92fe-750a-4e98-b4a2-1be720fbbb02", "device": "/dev/sdb"}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:11:59.255393 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ce614994-5dc5-4611-8749-6e58cd92d15a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:59.261761 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ce614994-5dc5-4611-8749-6e58cd92d15a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:59.262292 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ce614994-5dc5-4611-8749-6e58cd92d15a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:59.263182 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ce614994-5dc5-4611-8749-6e58cd92d15a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:59.263636 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ce614994-5dc5-4611-8749-6e58cd92d15a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:59.853427 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7e26dc0a-4b38-4728-bd9c-07f0a6852dbb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:59.854137 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7e26dc0a-4b38-4728-bd9c-07f0a6852dbb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:59.860545 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7e26dc0a-4b38-4728-bd9c-07f0a6852dbb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:59.860997 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7e26dc0a-4b38-4728-bd9c-07f0a6852dbb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:59.861786 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7e26dc0a-4b38-4728-bd9c-07f0a6852dbb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:59.862268 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7e26dc0a-4b38-4728-bd9c-07f0a6852dbb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:00.017915 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7e26dc0a-4b38-4728-bd9c-07f0a6852dbb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:00.026694 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7e26dc0a-4b38-4728-bd9c-07f0a6852dbb tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f" status: 200 len: 1513 microversion: 2.1 time: 0.177169 Feb 21 01:12:00.027334 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 207/394] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:59 2022] GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:12:00.031788 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-cf0e8f24-8be0-4b68-8e11-558cbb682c81 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:00.033697 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-cf0e8f24-8be0-4b68-8e11-558cbb682c81 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:00.039556 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cf0e8f24-8be0-4b68-8e11-558cbb682c81 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:00.040050 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cf0e8f24-8be0-4b68-8e11-558cbb682c81 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:00.040845 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cf0e8f24-8be0-4b68-8e11-558cbb682c81 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:00.041485 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cf0e8f24-8be0-4b68-8e11-558cbb682c81 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:00.154062 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ce614994-5dc5-4611-8749-6e58cd92d15a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "POST /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.904835 Feb 21 01:12:00.156408 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 188/395] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Feb 21 01:11:59 2022] POST /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc/os-volume_attachments => generated 194 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:00.199111 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-cf0e8f24-8be0-4b68-8e11-558cbb682c81 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:00.207982 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-cf0e8f24-8be0-4b68-8e11-558cbb682c81 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.179487 Feb 21 01:12:00.210854 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 208/396] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:00 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:12:00.577049 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-c99792a0-a18f-4f3c-b45c-d76e753d77df req-9197a5ba-9f1e-41da-bd1e-8945caacb8ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "748a5623-7930-404e-9e68-e2c4f9439c0f", "name": "network-vif-deleted", "tag": "34bd5660-c394-4cc0-ad67-5a45a2bc7853"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:12:00.579286 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:12:00.579286 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:12:00.592700 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-c99792a0-a18f-4f3c-b45c-d76e753d77df req-9197a5ba-9f1e-41da-bd1e-8945caacb8ae service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:00.593148 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-c99792a0-a18f-4f3c-b45c-d76e753d77df req-9197a5ba-9f1e-41da-bd1e-8945caacb8ae service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:00.607670 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-c99792a0-a18f-4f3c-b45c-d76e753d77df req-9197a5ba-9f1e-41da-bd1e-8945caacb8ae service nova] Creating event network-vif-deleted:34bd5660-c394-4cc0-ad67-5a45a2bc7853 for instance 748a5623-7930-404e-9e68-e2c4f9439c0f on hv-cinder-81322 Feb 21 01:12:00.613577 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-c99792a0-a18f-4f3c-b45c-d76e753d77df req-9197a5ba-9f1e-41da-bd1e-8945caacb8ae service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041163 Feb 21 01:12:00.615447 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 189/397] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:01.044480 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-af4369b8-5fc0-434d-b56a-cbea372615ae tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:01.045019 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-af4369b8-5fc0-434d-b56a-cbea372615ae tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:01.052072 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-af4369b8-5fc0-434d-b56a-cbea372615ae tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:01.059104 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-af4369b8-5fc0-434d-b56a-cbea372615ae tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:01.059104 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-af4369b8-5fc0-434d-b56a-cbea372615ae tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:01.059104 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-af4369b8-5fc0-434d-b56a-cbea372615ae tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:01.088166 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-af4369b8-5fc0-434d-b56a-cbea372615ae tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:01.088981 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-af4369b8-5fc0-434d-b56a-cbea372615ae tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:01.090577 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.objects.instance [None req-af4369b8-5fc0-434d-b56a-cbea372615ae tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lazy-loading 'fault' on Instance uuid 748a5623-7930-404e-9e68-e2c4f9439c0f {{(pid=117139) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:12:01.138393 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-af4369b8-5fc0-434d-b56a-cbea372615ae tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:01.147522 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-af4369b8-5fc0-434d-b56a-cbea372615ae tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f" status: 200 len: 1307 microversion: 2.1 time: 0.106707 Feb 21 01:12:01.148077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 209/398] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:01 2022] GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:12:01.229171 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e44eb3d2-1b3f-427c-9c8d-03e06c7ed221 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:01.230073 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e44eb3d2-1b3f-427c-9c8d-03e06c7ed221 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:01.238917 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e44eb3d2-1b3f-427c-9c8d-03e06c7ed221 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:01.239375 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e44eb3d2-1b3f-427c-9c8d-03e06c7ed221 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:01.240266 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e44eb3d2-1b3f-427c-9c8d-03e06c7ed221 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:01.240702 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e44eb3d2-1b3f-427c-9c8d-03e06c7ed221 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:01.394642 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e44eb3d2-1b3f-427c-9c8d-03e06c7ed221 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:01.403212 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e44eb3d2-1b3f-427c-9c8d-03e06c7ed221 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.178902 Feb 21 01:12:01.403783 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 190/399] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:01 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:12:02.167157 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ac196722-d598-4bc2-9a56-f5b2ced439aa tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:02.170542 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ac196722-d598-4bc2-9a56-f5b2ced439aa tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 748a5623-7930-404e-9e68-e2c4f9439c0f] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:02.174189 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ac196722-d598-4bc2-9a56-f5b2ced439aa tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:02.174833 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ac196722-d598-4bc2-9a56-f5b2ced439aa tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:02.176187 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ac196722-d598-4bc2-9a56-f5b2ced439aa tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:02.176628 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ac196722-d598-4bc2-9a56-f5b2ced439aa tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:02.191777 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-ac196722-d598-4bc2-9a56-f5b2ced439aa tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] HTTP exception thrown: Instance 748a5623-7930-404e-9e68-e2c4f9439c0f could not be found. Feb 21 01:12:02.192407 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ac196722-d598-4bc2-9a56-f5b2ced439aa tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Returning 404 to user: Instance 748a5623-7930-404e-9e68-e2c4f9439c0f could not be found. {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:12:02.193266 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ac196722-d598-4bc2-9a56-f5b2ced439aa tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f" status: 404 len: 111 microversion: 2.1 time: 0.029859 Feb 21 01:12:02.193802 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 210/400] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:02 2022] GET /compute/v2.1/servers/748a5623-7930-404e-9e68-e2c4f9439c0f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:12:02.422443 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-654a8071-fcd5-458c-93f4-0303cf30faec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:02.423122 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-654a8071-fcd5-458c-93f4-0303cf30faec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:02.429961 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-654a8071-fcd5-458c-93f4-0303cf30faec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:02.430515 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-654a8071-fcd5-458c-93f4-0303cf30faec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:02.431474 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-654a8071-fcd5-458c-93f4-0303cf30faec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:02.432003 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-654a8071-fcd5-458c-93f4-0303cf30faec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:02.566001 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-654a8071-fcd5-458c-93f4-0303cf30faec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:02.573963 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-654a8071-fcd5-458c-93f4-0303cf30faec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.155356 Feb 21 01:12:02.574535 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 191/401] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:02 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:12:03.478477 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-83945398-2090-4ff1-8160-c6dc241b62c8 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:03.479020 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-83945398-2090-4ff1-8160-c6dc241b62c8 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:03.485940 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83945398-2090-4ff1-8160-c6dc241b62c8 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:03.486380 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83945398-2090-4ff1-8160-c6dc241b62c8 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:03.487706 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83945398-2090-4ff1-8160-c6dc241b62c8 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:03.488142 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83945398-2090-4ff1-8160-c6dc241b62c8 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:03.513135 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-83945398-2090-4ff1-8160-c6dc241b62c8 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Going to try to terminate instance {{(pid=117139) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:12:03.590898 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a65b7f8c-8065-4b90-a38e-2ba9b188f363 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:03.591627 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a65b7f8c-8065-4b90-a38e-2ba9b188f363 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:03.598423 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a65b7f8c-8065-4b90-a38e-2ba9b188f363 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:03.598843 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a65b7f8c-8065-4b90-a38e-2ba9b188f363 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:03.599627 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a65b7f8c-8065-4b90-a38e-2ba9b188f363 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:03.600086 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a65b7f8c-8065-4b90-a38e-2ba9b188f363 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:03.737386 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a65b7f8c-8065-4b90-a38e-2ba9b188f363 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:03.746152 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a65b7f8c-8065-4b90-a38e-2ba9b188f363 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.158752 Feb 21 01:12:03.746828 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 192/402] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:03 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:12:03.795559 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-83945398-2090-4ff1-8160-c6dc241b62c8 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "DELETE /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 204 len: 0 microversion: 2.1 time: 0.320490 Feb 21 01:12:03.796091 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 211/403] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Feb 21 01:12:03 2022] DELETE /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:12:03.804530 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-571558cf-14a6-459e-8652-02163bffad58 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:03.805161 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-571558cf-14a6-459e-8652-02163bffad58 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:03.811047 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-571558cf-14a6-459e-8652-02163bffad58 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:03.811488 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-571558cf-14a6-459e-8652-02163bffad58 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:03.812290 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-571558cf-14a6-459e-8652-02163bffad58 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:03.812713 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-571558cf-14a6-459e-8652-02163bffad58 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:03.951147 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-571558cf-14a6-459e-8652-02163bffad58 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:03.958498 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-571558cf-14a6-459e-8652-02163bffad58 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1513 microversion: 2.1 time: 0.157549 Feb 21 01:12:03.959070 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 193/404] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:03 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:12:04.773036 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-759504df-46bd-4232-bb03-2830ab3ba1bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:04.773926 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-759504df-46bd-4232-bb03-2830ab3ba1bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:04.781164 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-759504df-46bd-4232-bb03-2830ab3ba1bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:04.781615 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-759504df-46bd-4232-bb03-2830ab3ba1bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:04.782413 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-759504df-46bd-4232-bb03-2830ab3ba1bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:04.782846 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-759504df-46bd-4232-bb03-2830ab3ba1bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:04.944075 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-759504df-46bd-4232-bb03-2830ab3ba1bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:04.952252 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-759504df-46bd-4232-bb03-2830ab3ba1bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1547 microversion: 2.1 time: 0.183840 Feb 21 01:12:04.956448 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 212/405] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:04 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1547 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:12:04.968869 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-861456ba-afd7-4a73-a537-b42a7b59581a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:04.969496 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-861456ba-afd7-4a73-a537-b42a7b59581a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:04.974475 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7f2e6dce-3082-4d2c-bd95-2da7ed304a38 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:04.975181 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7f2e6dce-3082-4d2c-bd95-2da7ed304a38 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:04.976133 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-861456ba-afd7-4a73-a537-b42a7b59581a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:04.976585 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-861456ba-afd7-4a73-a537-b42a7b59581a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:04.977536 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-861456ba-afd7-4a73-a537-b42a7b59581a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:04.978127 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-861456ba-afd7-4a73-a537-b42a7b59581a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:04.981453 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7f2e6dce-3082-4d2c-bd95-2da7ed304a38 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:04.981906 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7f2e6dce-3082-4d2c-bd95-2da7ed304a38 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:04.982697 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7f2e6dce-3082-4d2c-bd95-2da7ed304a38 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:04.984535 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7f2e6dce-3082-4d2c-bd95-2da7ed304a38 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:05.063369 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.wsgi [None req-861456ba-afd7-4a73-a537-b42a7b59581a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] HTTP exception thrown: Cannot 'detach_volume' instance 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab while it is in vm_state rescued Feb 21 01:12:05.064007 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-861456ba-afd7-4a73-a537-b42a7b59581a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Returning 409 to user: Cannot 'detach_volume' instance 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab while it is in vm_state rescued {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:12:05.064853 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-861456ba-afd7-4a73-a537-b42a7b59581a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "DELETE /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments/d73b872e-c891-4c7f-8f9a-a7f9e52d11d3" status: 409 len: 152 microversion: 2.1 time: 0.099894 Feb 21 01:12:05.065987 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 194/406] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Feb 21 01:12:04 2022] DELETE /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments/d73b872e-c891-4c7f-8f9a-a7f9e52d11d3 => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 21 01:12:05.074226 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-88eab917-6f7e-4b1d-9c2e-74b48dec3a14 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:12:05.075181 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-88eab917-6f7e-4b1d-9c2e-74b48dec3a14 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:05.084613 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-88eab917-6f7e-4b1d-9c2e-74b48dec3a14 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:05.085480 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-88eab917-6f7e-4b1d-9c2e-74b48dec3a14 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:05.087005 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-88eab917-6f7e-4b1d-9c2e-74b48dec3a14 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:05.087707 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-88eab917-6f7e-4b1d-9c2e-74b48dec3a14 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:05.152747 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7f2e6dce-3082-4d2c-bd95-2da7ed304a38 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:05.161252 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7f2e6dce-3082-4d2c-bd95-2da7ed304a38 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1513 microversion: 2.1 time: 0.190500 Feb 21 01:12:05.161825 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 213/407] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:04 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:12:05.347854 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-88eab917-6f7e-4b1d-9c2e-74b48dec3a14 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "POST /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/action" status: 202 len: 0 microversion: 2.1 time: 0.276823 Feb 21 01:12:05.349125 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 195/408] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Feb 21 01:12:05 2022] POST /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 01:12:05.357006 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0920c8d0-9d6b-4659-b41f-4a36ab061b19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:05.357621 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0920c8d0-9d6b-4659-b41f-4a36ab061b19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:05.363846 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0920c8d0-9d6b-4659-b41f-4a36ab061b19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:05.364313 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0920c8d0-9d6b-4659-b41f-4a36ab061b19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:05.365112 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0920c8d0-9d6b-4659-b41f-4a36ab061b19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:05.365553 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0920c8d0-9d6b-4659-b41f-4a36ab061b19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:05.536203 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0920c8d0-9d6b-4659-b41f-4a36ab061b19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:05.545699 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0920c8d0-9d6b-4659-b41f-4a36ab061b19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1555 microversion: 2.1 time: 0.192210 Feb 21 01:12:05.546323 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 214/409] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:05 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1555 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:12:06.180549 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ef4e64f3-edff-4243-9950-5d1d009ce74c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:06.181265 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ef4e64f3-edff-4243-9950-5d1d009ce74c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:06.187548 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ef4e64f3-edff-4243-9950-5d1d009ce74c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:06.188027 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ef4e64f3-edff-4243-9950-5d1d009ce74c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:06.188822 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ef4e64f3-edff-4243-9950-5d1d009ce74c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:06.189251 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ef4e64f3-edff-4243-9950-5d1d009ce74c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:06.336247 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ef4e64f3-edff-4243-9950-5d1d009ce74c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:06.343777 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ef4e64f3-edff-4243-9950-5d1d009ce74c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1513 microversion: 2.1 time: 0.169659 Feb 21 01:12:06.344365 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 196/410] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:06 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:12:06.563579 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c6e70644-f9e0-451f-859e-cd67589c2c03 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:06.564233 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c6e70644-f9e0-451f-859e-cd67589c2c03 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:06.571638 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c6e70644-f9e0-451f-859e-cd67589c2c03 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:06.572107 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c6e70644-f9e0-451f-859e-cd67589c2c03 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:06.572919 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c6e70644-f9e0-451f-859e-cd67589c2c03 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:06.573359 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c6e70644-f9e0-451f-859e-cd67589c2c03 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:06.714232 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c6e70644-f9e0-451f-859e-cd67589c2c03 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:06.722683 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c6e70644-f9e0-451f-859e-cd67589c2c03 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1555 microversion: 2.1 time: 0.162663 Feb 21 01:12:06.723259 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 215/411] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:06 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:12:07.360763 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c2357b57-049c-441a-bb2e-d509ec384f8b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:07.361389 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c2357b57-049c-441a-bb2e-d509ec384f8b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:07.370593 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c2357b57-049c-441a-bb2e-d509ec384f8b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:07.371045 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c2357b57-049c-441a-bb2e-d509ec384f8b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:07.371957 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c2357b57-049c-441a-bb2e-d509ec384f8b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:07.372344 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c2357b57-049c-441a-bb2e-d509ec384f8b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:07.395698 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-be9316b7-17f4-482b-aa60-fc2c9a72f65b req-854cccd3-7c19-42f6-81ab-3c45cb8f46da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9", "name": "network-vif-deleted", "tag": "a9b8b6b3-10bd-46a7-af49-ecb93114aab6"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:12:07.398790 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:12:07.398790 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:12:07.414452 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-be9316b7-17f4-482b-aa60-fc2c9a72f65b req-854cccd3-7c19-42f6-81ab-3c45cb8f46da service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:07.415234 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-be9316b7-17f4-482b-aa60-fc2c9a72f65b req-854cccd3-7c19-42f6-81ab-3c45cb8f46da service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:07.427888 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-be9316b7-17f4-482b-aa60-fc2c9a72f65b req-854cccd3-7c19-42f6-81ab-3c45cb8f46da service nova] Creating event network-vif-deleted:a9b8b6b3-10bd-46a7-af49-ecb93114aab6 for instance 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 on hv-cinder-81322 Feb 21 01:12:07.433561 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-be9316b7-17f4-482b-aa60-fc2c9a72f65b req-854cccd3-7c19-42f6-81ab-3c45cb8f46da service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047417 Feb 21 01:12:07.434593 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 216/412] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:12:07.453253 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c2357b57-049c-441a-bb2e-d509ec384f8b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:07.465964 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c2357b57-049c-441a-bb2e-d509ec384f8b tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1471 microversion: 2.1 time: 0.108989 Feb 21 01:12:07.466858 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 197/413] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:07 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1471 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:12:07.746108 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e38fb005-9d8c-4f3a-8446-34220025179e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:07.746877 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e38fb005-9d8c-4f3a-8446-34220025179e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:07.754513 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e38fb005-9d8c-4f3a-8446-34220025179e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:07.754976 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e38fb005-9d8c-4f3a-8446-34220025179e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:07.755770 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e38fb005-9d8c-4f3a-8446-34220025179e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:07.756242 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e38fb005-9d8c-4f3a-8446-34220025179e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:07.924061 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e38fb005-9d8c-4f3a-8446-34220025179e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:07.932466 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e38fb005-9d8c-4f3a-8446-34220025179e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1555 microversion: 2.1 time: 0.191237 Feb 21 01:12:07.933035 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 217/414] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:07 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1555 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:12:08.486420 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5c190774-20c0-4029-8868-821d720db390 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:08.487700 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5c190774-20c0-4029-8868-821d720db390 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:08.494512 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c190774-20c0-4029-8868-821d720db390 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:08.494964 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c190774-20c0-4029-8868-821d720db390 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:08.495977 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c190774-20c0-4029-8868-821d720db390 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:08.496418 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c190774-20c0-4029-8868-821d720db390 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:08.546548 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c190774-20c0-4029-8868-821d720db390 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:08.547276 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c190774-20c0-4029-8868-821d720db390 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:08.548148 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.objects.instance [None req-5c190774-20c0-4029-8868-821d720db390 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lazy-loading 'fault' on Instance uuid 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 {{(pid=117138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:12:08.614415 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5c190774-20c0-4029-8868-821d720db390 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:08.623543 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5c190774-20c0-4029-8868-821d720db390 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 200 len: 1307 microversion: 2.1 time: 0.140867 Feb 21 01:12:08.624174 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 198/415] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:08 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 1307 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:12:08.950185 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b38177cd-6245-4c76-9268-29ea997342d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:08.951021 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b38177cd-6245-4c76-9268-29ea997342d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:08.958209 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b38177cd-6245-4c76-9268-29ea997342d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:08.958947 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b38177cd-6245-4c76-9268-29ea997342d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:08.959750 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b38177cd-6245-4c76-9268-29ea997342d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:08.960266 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b38177cd-6245-4c76-9268-29ea997342d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:09.106809 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b38177cd-6245-4c76-9268-29ea997342d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:09.115559 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b38177cd-6245-4c76-9268-29ea997342d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1561 microversion: 2.1 time: 0.168997 Feb 21 01:12:09.116191 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 218/416] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:08 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:12:09.192086 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3e131911-d611-4978-bde0-54b3bc39a6bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:09.192598 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3e131911-d611-4978-bde0-54b3bc39a6bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:09.199219 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3e131911-d611-4978-bde0-54b3bc39a6bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:09.199614 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3e131911-d611-4978-bde0-54b3bc39a6bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:09.200446 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3e131911-d611-4978-bde0-54b3bc39a6bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:09.200884 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3e131911-d611-4978-bde0-54b3bc39a6bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:09.325549 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.objects.instance [None req-3e131911-d611-4978-bde0-54b3bc39a6bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lazy-loading 'services' on Instance uuid 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab {{(pid=117138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:12:09.569380 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3e131911-d611-4978-bde0-54b3bc39a6bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "DELETE /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments/d73b872e-c891-4c7f-8f9a-a7f9e52d11d3" status: 202 len: 0 microversion: 2.1 time: 0.381318 Feb 21 01:12:09.570149 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 199/417] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Feb 21 01:12:09 2022] DELETE /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments/d73b872e-c891-4c7f-8f9a-a7f9e52d11d3 => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:12:09.578865 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8db354aa-aad1-4659-a2f2-972cb6adbee3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:09.579976 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8db354aa-aad1-4659-a2f2-972cb6adbee3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:09.588817 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8db354aa-aad1-4659-a2f2-972cb6adbee3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:09.589570 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8db354aa-aad1-4659-a2f2-972cb6adbee3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:09.590415 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8db354aa-aad1-4659-a2f2-972cb6adbee3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:09.590859 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8db354aa-aad1-4659-a2f2-972cb6adbee3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:09.635352 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8db354aa-aad1-4659-a2f2-972cb6adbee3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060441 Feb 21 01:12:09.640059 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 219/418] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:09 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:09.644821 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5193c3d9-01aa-4b28-811c-e371ab9d8795 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:09.645396 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5193c3d9-01aa-4b28-811c-e371ab9d8795 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:09.656092 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5193c3d9-01aa-4b28-811c-e371ab9d8795 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:09.656833 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5193c3d9-01aa-4b28-811c-e371ab9d8795 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:09.658171 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5193c3d9-01aa-4b28-811c-e371ab9d8795 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:09.659147 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5193c3d9-01aa-4b28-811c-e371ab9d8795 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:09.680189 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.wsgi [None req-5193c3d9-01aa-4b28-811c-e371ab9d8795 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] HTTP exception thrown: Instance 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 could not be found. Feb 21 01:12:09.680790 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5193c3d9-01aa-4b28-811c-e371ab9d8795 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Returning 404 to user: Instance 0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 could not be found. {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:12:09.681616 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5193c3d9-01aa-4b28-811c-e371ab9d8795 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9" status: 404 len: 111 microversion: 2.1 time: 0.043088 Feb 21 01:12:09.682347 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 200/419] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:09 2022] GET /compute/v2.1/servers/0ae05b03-1538-4b41-9d74-d9ad0bbfdaf9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 01:12:09.697785 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fd9e5902-4639-4035-8180-dd7a52a219a0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:09.698430 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fd9e5902-4639-4035-8180-dd7a52a219a0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:09.704964 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fd9e5902-4639-4035-8180-dd7a52a219a0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:09.705414 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fd9e5902-4639-4035-8180-dd7a52a219a0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:09.706874 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fd9e5902-4639-4035-8180-dd7a52a219a0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:09.707518 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fd9e5902-4639-4035-8180-dd7a52a219a0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:09.731175 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0c4f6490-f041-481e-8b46-f45f841960f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:12:09.731598 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0c4f6490-f041-481e-8b46-f45f841960f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:09.743508 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c4f6490-f041-481e-8b46-f45f841960f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:09.744362 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c4f6490-f041-481e-8b46-f45f841960f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:09.745357 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c4f6490-f041-481e-8b46-f45f841960f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:09.746100 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c4f6490-f041-481e-8b46-f45f841960f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:09.754286 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fd9e5902-4639-4035-8180-dd7a52a219a0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Going to try to terminate instance {{(pid=117139) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:12:09.776319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.objects.instance [None req-0c4f6490-f041-481e-8b46-f45f841960f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lazy-loading 'flavor' on Instance uuid e2aa103a-4f89-45a6-8c62-09282555e3b3 {{(pid=117138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:12:10.138288 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-fd9e5902-4639-4035-8180-dd7a52a219a0 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "DELETE /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 204 len: 0 microversion: 2.1 time: 0.445719 Feb 21 01:12:10.139276 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 220/420] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Feb 21 01:12:09 2022] DELETE /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:12:10.148356 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7363e07c-9eea-4808-806c-497864169d00 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:10.149062 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7363e07c-9eea-4808-806c-497864169d00 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:10.155196 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7363e07c-9eea-4808-806c-497864169d00 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:10.155548 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7363e07c-9eea-4808-806c-497864169d00 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:10.156373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7363e07c-9eea-4808-806c-497864169d00 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:10.156796 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7363e07c-9eea-4808-806c-497864169d00 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:10.321572 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7363e07c-9eea-4808-806c-497864169d00 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:10.333481 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7363e07c-9eea-4808-806c-497864169d00 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 200 len: 1513 microversion: 2.1 time: 0.189137 Feb 21 01:12:10.334066 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 221/421] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:10 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:12:10.446459 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0c4f6490-f041-481e-8b46-f45f841960f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "POST /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/action" status: 202 len: 0 microversion: 2.20 time: 0.719030 Feb 21 01:12:10.451393 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 201/422] 10.222.0.91 () {62 vars in 1318 bytes} [Mon Feb 21 01:12:09 2022] POST /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/action => generated 0 bytes in 720 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:12:10.456738 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3dbd39fc-9bb0-4688-90c4-23f9c27ca63c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:10.457449 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3dbd39fc-9bb0-4688-90c4-23f9c27ca63c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:10.464130 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3dbd39fc-9bb0-4688-90c4-23f9c27ca63c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:10.465336 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3dbd39fc-9bb0-4688-90c4-23f9c27ca63c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:10.465466 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3dbd39fc-9bb0-4688-90c4-23f9c27ca63c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:10.465835 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3dbd39fc-9bb0-4688-90c4-23f9c27ca63c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:10.618201 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3dbd39fc-9bb0-4688-90c4-23f9c27ca63c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:10.628640 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3dbd39fc-9bb0-4688-90c4-23f9c27ca63c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:10.630201 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3dbd39fc-9bb0-4688-90c4-23f9c27ca63c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:10.631414 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3dbd39fc-9bb0-4688-90c4-23f9c27ca63c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1724 microversion: 2.20 time: 0.178854 Feb 21 01:12:10.632004 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 222/423] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:10 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:10.650733 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a02d03b0-c10c-4360-89ab-03f339ed9196 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:10.651744 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a02d03b0-c10c-4360-89ab-03f339ed9196 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:10.658555 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a02d03b0-c10c-4360-89ab-03f339ed9196 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:10.660013 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a02d03b0-c10c-4360-89ab-03f339ed9196 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:10.660420 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a02d03b0-c10c-4360-89ab-03f339ed9196 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:10.660870 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a02d03b0-c10c-4360-89ab-03f339ed9196 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:10.703774 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a02d03b0-c10c-4360-89ab-03f339ed9196 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057703 Feb 21 01:12:10.704458 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 202/424] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:10 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:12:11.352675 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f9924a39-b9a0-442f-b4c6-8fa427a669e8 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:11.355163 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f9924a39-b9a0-442f-b4c6-8fa427a669e8 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:11.363425 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f9924a39-b9a0-442f-b4c6-8fa427a669e8 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:11.363870 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f9924a39-b9a0-442f-b4c6-8fa427a669e8 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:11.364796 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f9924a39-b9a0-442f-b4c6-8fa427a669e8 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:11.365225 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f9924a39-b9a0-442f-b4c6-8fa427a669e8 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:11.552108 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f9924a39-b9a0-442f-b4c6-8fa427a669e8 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:11.560338 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f9924a39-b9a0-442f-b4c6-8fa427a669e8 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 200 len: 1513 microversion: 2.1 time: 0.211338 Feb 21 01:12:11.560934 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 223/425] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:11 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:12:11.650779 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-03de2d9a-6d0b-43f1-87e1-41db1efc9081 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:11.651397 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-03de2d9a-6d0b-43f1-87e1-41db1efc9081 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:11.658003 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-03de2d9a-6d0b-43f1-87e1-41db1efc9081 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:11.658737 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-03de2d9a-6d0b-43f1-87e1-41db1efc9081 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:11.659950 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-03de2d9a-6d0b-43f1-87e1-41db1efc9081 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:11.660407 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-03de2d9a-6d0b-43f1-87e1-41db1efc9081 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:11.716614 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3ca04aa2-0609-4638-b083-10ed0b056f48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:11.717759 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3ca04aa2-0609-4638-b083-10ed0b056f48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:11.726417 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3ca04aa2-0609-4638-b083-10ed0b056f48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:11.727071 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3ca04aa2-0609-4638-b083-10ed0b056f48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:11.728134 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3ca04aa2-0609-4638-b083-10ed0b056f48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:11.728709 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3ca04aa2-0609-4638-b083-10ed0b056f48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:11.761482 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3ca04aa2-0609-4638-b083-10ed0b056f48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048635 Feb 21 01:12:11.762050 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 224/426] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:11 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:12:11.823960 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-03de2d9a-6d0b-43f1-87e1-41db1efc9081 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:11.833621 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-03de2d9a-6d0b-43f1-87e1-41db1efc9081 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:11.835144 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-03de2d9a-6d0b-43f1-87e1-41db1efc9081 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:11.836377 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-03de2d9a-6d0b-43f1-87e1-41db1efc9081 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1724 microversion: 2.20 time: 0.189403 Feb 21 01:12:11.836953 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 203/427] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:11 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:12:12.582252 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a697a97a-6d39-4399-925b-c27c8c12f5ad tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:12.582876 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a697a97a-6d39-4399-925b-c27c8c12f5ad tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:12.589862 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a697a97a-6d39-4399-925b-c27c8c12f5ad tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:12.590307 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a697a97a-6d39-4399-925b-c27c8c12f5ad tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:12.591114 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a697a97a-6d39-4399-925b-c27c8c12f5ad tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:12.591551 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a697a97a-6d39-4399-925b-c27c8c12f5ad tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:12.750316 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a697a97a-6d39-4399-925b-c27c8c12f5ad tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:12.758982 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a697a97a-6d39-4399-925b-c27c8c12f5ad tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 200 len: 1513 microversion: 2.1 time: 0.180973 Feb 21 01:12:12.759573 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 225/428] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:12 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:12:12.774516 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-74999b26-4a4f-4de6-aef1-529bd421a943 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:12.775526 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-74999b26-4a4f-4de6-aef1-529bd421a943 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:12.785772 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-74999b26-4a4f-4de6-aef1-529bd421a943 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:12.785772 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-74999b26-4a4f-4de6-aef1-529bd421a943 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:12.786190 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-74999b26-4a4f-4de6-aef1-529bd421a943 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:12.786841 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-74999b26-4a4f-4de6-aef1-529bd421a943 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:12.820374 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-74999b26-4a4f-4de6-aef1-529bd421a943 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049687 Feb 21 01:12:12.821049 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 204/429] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:12 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:12.854798 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-dfbac96e-d872-4446-b8ed-3c2b6cfa3c07 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:12.855444 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-dfbac96e-d872-4446-b8ed-3c2b6cfa3c07 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:12.862332 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dfbac96e-d872-4446-b8ed-3c2b6cfa3c07 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:12.862781 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dfbac96e-d872-4446-b8ed-3c2b6cfa3c07 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:12.863599 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dfbac96e-d872-4446-b8ed-3c2b6cfa3c07 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:12.864149 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dfbac96e-d872-4446-b8ed-3c2b6cfa3c07 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:13.026089 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-dfbac96e-d872-4446-b8ed-3c2b6cfa3c07 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:13.036068 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-dfbac96e-d872-4446-b8ed-3c2b6cfa3c07 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:13.038121 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-dfbac96e-d872-4446-b8ed-3c2b6cfa3c07 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:13.039797 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-dfbac96e-d872-4446-b8ed-3c2b6cfa3c07 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1724 microversion: 2.20 time: 0.188816 Feb 21 01:12:13.040677 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 226/430] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:12 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:13.779645 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6510dbc5-50ad-47c7-861f-65e10cc90f57 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:13.780421 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6510dbc5-50ad-47c7-861f-65e10cc90f57 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:13.801431 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6510dbc5-50ad-47c7-861f-65e10cc90f57 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:13.801431 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6510dbc5-50ad-47c7-861f-65e10cc90f57 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:13.801431 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6510dbc5-50ad-47c7-861f-65e10cc90f57 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:13.801814 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6510dbc5-50ad-47c7-861f-65e10cc90f57 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:13.834459 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f4ecdce0-49d5-440b-93dd-ec1218f2b67a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:13.835390 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f4ecdce0-49d5-440b-93dd-ec1218f2b67a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:13.842345 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f4ecdce0-49d5-440b-93dd-ec1218f2b67a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:13.843142 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f4ecdce0-49d5-440b-93dd-ec1218f2b67a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:13.844146 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f4ecdce0-49d5-440b-93dd-ec1218f2b67a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:13.844528 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f4ecdce0-49d5-440b-93dd-ec1218f2b67a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:13.878897 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f4ecdce0-49d5-440b-93dd-ec1218f2b67a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047924 Feb 21 01:12:13.880100 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 227/431] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:13 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:13.950871 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6510dbc5-50ad-47c7-861f-65e10cc90f57 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:13.959932 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6510dbc5-50ad-47c7-861f-65e10cc90f57 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 200 len: 1513 microversion: 2.1 time: 0.185145 Feb 21 01:12:13.962147 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 205/432] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:13 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:12:14.063593 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d8e5bc3a-0df2-4492-b4d4-45963b176bd5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:14.068228 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d8e5bc3a-0df2-4492-b4d4-45963b176bd5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:14.070767 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d8e5bc3a-0df2-4492-b4d4-45963b176bd5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:14.071221 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d8e5bc3a-0df2-4492-b4d4-45963b176bd5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:14.072250 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d8e5bc3a-0df2-4492-b4d4-45963b176bd5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:14.072750 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d8e5bc3a-0df2-4492-b4d4-45963b176bd5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:14.226399 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d8e5bc3a-0df2-4492-b4d4-45963b176bd5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:14.234186 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d8e5bc3a-0df2-4492-b4d4-45963b176bd5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:14.235660 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d8e5bc3a-0df2-4492-b4d4-45963b176bd5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:14.236931 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d8e5bc3a-0df2-4492-b4d4-45963b176bd5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1724 microversion: 2.20 time: 0.177435 Feb 21 01:12:14.237590 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 228/433] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:14 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:14.893665 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e8fb8e3a-ee5d-4178-bd7a-cc4f540e6dba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:14.894995 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e8fb8e3a-ee5d-4178-bd7a-cc4f540e6dba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:14.903439 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e8fb8e3a-ee5d-4178-bd7a-cc4f540e6dba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:14.904143 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e8fb8e3a-ee5d-4178-bd7a-cc4f540e6dba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:14.905066 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e8fb8e3a-ee5d-4178-bd7a-cc4f540e6dba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:14.905594 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e8fb8e3a-ee5d-4178-bd7a-cc4f540e6dba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:14.938080 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e8fb8e3a-ee5d-4178-bd7a-cc4f540e6dba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050238 Feb 21 01:12:14.938648 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 206/434] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:14 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:14.977101 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3af908d6-e7a3-4aa7-8351-f84ef2ea2db4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:14.977854 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3af908d6-e7a3-4aa7-8351-f84ef2ea2db4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:14.984118 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3af908d6-e7a3-4aa7-8351-f84ef2ea2db4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:14.984560 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3af908d6-e7a3-4aa7-8351-f84ef2ea2db4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:14.985337 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3af908d6-e7a3-4aa7-8351-f84ef2ea2db4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:14.985760 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3af908d6-e7a3-4aa7-8351-f84ef2ea2db4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:15.075802 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3af908d6-e7a3-4aa7-8351-f84ef2ea2db4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70516383f3b14d5283462803cac26d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c1bf236b2f4eb1bffab124b7392ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:15.091184 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3af908d6-e7a3-4aa7-8351-f84ef2ea2db4 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 200 len: 1471 microversion: 2.1 time: 0.117227 Feb 21 01:12:15.091820 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 229/435] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:14 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 1471 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:12:15.135181 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-df1073d8-03fa-445c-8325-c091616048e2 req-48f398c6-f867-4214-ac5c-c1b427d3048b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7095a15-9df6-4743-a602-d5410ac101a6", "name": "network-vif-deleted", "tag": "48787ba3-9f90-477e-8bb5-d81fc8b1d6a5"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:12:15.137347 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:12:15.137347 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:12:15.145836 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-df1073d8-03fa-445c-8325-c091616048e2 req-48f398c6-f867-4214-ac5c-c1b427d3048b service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:15.146391 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-df1073d8-03fa-445c-8325-c091616048e2 req-48f398c6-f867-4214-ac5c-c1b427d3048b service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:15.158751 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-df1073d8-03fa-445c-8325-c091616048e2 req-48f398c6-f867-4214-ac5c-c1b427d3048b service nova] Creating event network-vif-deleted:48787ba3-9f90-477e-8bb5-d81fc8b1d6a5 for instance b7095a15-9df6-4743-a602-d5410ac101a6 on hv-cinder-81322 Feb 21 01:12:15.164319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-df1073d8-03fa-445c-8325-c091616048e2 req-48f398c6-f867-4214-ac5c-c1b427d3048b service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034211 Feb 21 01:12:15.165189 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 207/436] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:15.264462 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7069939b-8262-4b28-a2ea-c26816471841 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:15.265154 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7069939b-8262-4b28-a2ea-c26816471841 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:15.271775 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7069939b-8262-4b28-a2ea-c26816471841 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:15.272254 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7069939b-8262-4b28-a2ea-c26816471841 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:15.273080 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7069939b-8262-4b28-a2ea-c26816471841 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:15.273522 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7069939b-8262-4b28-a2ea-c26816471841 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:15.435157 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7069939b-8262-4b28-a2ea-c26816471841 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:15.444437 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7069939b-8262-4b28-a2ea-c26816471841 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:15.446067 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7069939b-8262-4b28-a2ea-c26816471841 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:15.447244 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7069939b-8262-4b28-a2ea-c26816471841 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1724 microversion: 2.20 time: 0.186623 Feb 21 01:12:15.447802 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 230/437] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:15 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:15.950899 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-31c678aa-f7b0-4261-a692-9a9abf384d20 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:15.951931 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-31c678aa-f7b0-4261-a692-9a9abf384d20 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:15.959253 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31c678aa-f7b0-4261-a692-9a9abf384d20 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:15.959701 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31c678aa-f7b0-4261-a692-9a9abf384d20 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:15.960664 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31c678aa-f7b0-4261-a692-9a9abf384d20 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:15.961000 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31c678aa-f7b0-4261-a692-9a9abf384d20 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:15.996660 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-31c678aa-f7b0-4261-a692-9a9abf384d20 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050395 Feb 21 01:12:16.003682 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 208/438] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:15 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:16.109209 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8701d820-bf74-4be4-b44b-ca1803a3269c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:16.109777 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8701d820-bf74-4be4-b44b-ca1803a3269c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: b7095a15-9df6-4743-a602-d5410ac101a6] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:16.117248 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8701d820-bf74-4be4-b44b-ca1803a3269c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:16.117703 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8701d820-bf74-4be4-b44b-ca1803a3269c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:16.118604 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8701d820-bf74-4be4-b44b-ca1803a3269c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:16.119040 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8701d820-bf74-4be4-b44b-ca1803a3269c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:16.148933 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-8701d820-bf74-4be4-b44b-ca1803a3269c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] HTTP exception thrown: Instance b7095a15-9df6-4743-a602-d5410ac101a6 could not be found. Feb 21 01:12:16.149657 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8701d820-bf74-4be4-b44b-ca1803a3269c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Returning 404 to user: Instance b7095a15-9df6-4743-a602-d5410ac101a6 could not be found. {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:12:16.150699 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8701d820-bf74-4be4-b44b-ca1803a3269c tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6" status: 404 len: 111 microversion: 2.1 time: 0.045444 Feb 21 01:12:16.151583 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 231/439] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:12:16 2022] GET /compute/v2.1/servers/b7095a15-9df6-4743-a602-d5410ac101a6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:12:16.468921 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0e9e5961-1935-4d88-8f7f-688829352161 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:16.469711 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0e9e5961-1935-4d88-8f7f-688829352161 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:16.478789 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0e9e5961-1935-4d88-8f7f-688829352161 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:16.479418 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0e9e5961-1935-4d88-8f7f-688829352161 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:16.480269 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0e9e5961-1935-4d88-8f7f-688829352161 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:16.480978 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0e9e5961-1935-4d88-8f7f-688829352161 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:16.657623 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0e9e5961-1935-4d88-8f7f-688829352161 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:16.667346 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0e9e5961-1935-4d88-8f7f-688829352161 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:16.668897 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0e9e5961-1935-4d88-8f7f-688829352161 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:16.670079 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0e9e5961-1935-4d88-8f7f-688829352161 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1724 microversion: 2.20 time: 0.207421 Feb 21 01:12:16.670651 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 209/440] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:16 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:12:17.008664 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-610be3e1-1e11-4baa-981d-a5f008de72e8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:17.009738 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-610be3e1-1e11-4baa-981d-a5f008de72e8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:17.016365 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-610be3e1-1e11-4baa-981d-a5f008de72e8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:17.016864 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-610be3e1-1e11-4baa-981d-a5f008de72e8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:17.017756 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-610be3e1-1e11-4baa-981d-a5f008de72e8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:17.018938 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-610be3e1-1e11-4baa-981d-a5f008de72e8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:17.071769 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-610be3e1-1e11-4baa-981d-a5f008de72e8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066575 Feb 21 01:12:17.072861 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 232/441] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:17 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:17.689405 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-297084ef-623a-403f-b0ff-f3081121675f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:17.690073 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-297084ef-623a-403f-b0ff-f3081121675f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:17.697068 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-297084ef-623a-403f-b0ff-f3081121675f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:17.697517 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-297084ef-623a-403f-b0ff-f3081121675f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:17.698313 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-297084ef-623a-403f-b0ff-f3081121675f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:17.698750 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-297084ef-623a-403f-b0ff-f3081121675f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:17.843890 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-297084ef-623a-403f-b0ff-f3081121675f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:17.853021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-297084ef-623a-403f-b0ff-f3081121675f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:17.854533 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-297084ef-623a-403f-b0ff-f3081121675f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:17.855729 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-297084ef-623a-403f-b0ff-f3081121675f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1724 microversion: 2.20 time: 0.170099 Feb 21 01:12:17.856396 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 210/442] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:17 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:18.084635 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-93f541d7-d095-42e6-ac70-bc671e5e94c7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:18.085437 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-93f541d7-d095-42e6-ac70-bc671e5e94c7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:18.091385 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-93f541d7-d095-42e6-ac70-bc671e5e94c7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:18.091860 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-93f541d7-d095-42e6-ac70-bc671e5e94c7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:18.092659 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-93f541d7-d095-42e6-ac70-bc671e5e94c7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:18.093090 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-93f541d7-d095-42e6-ac70-bc671e5e94c7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:18.123019 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-93f541d7-d095-42e6-ac70-bc671e5e94c7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042818 Feb 21 01:12:18.123586 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 233/443] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:18 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:18.874770 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b99eeaf8-10ff-4bd4-a762-304b2e8c4641 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:18.875536 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b99eeaf8-10ff-4bd4-a762-304b2e8c4641 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:18.882472 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b99eeaf8-10ff-4bd4-a762-304b2e8c4641 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:18.882922 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b99eeaf8-10ff-4bd4-a762-304b2e8c4641 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:18.883733 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b99eeaf8-10ff-4bd4-a762-304b2e8c4641 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:18.884197 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b99eeaf8-10ff-4bd4-a762-304b2e8c4641 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:19.036870 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b99eeaf8-10ff-4bd4-a762-304b2e8c4641 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:19.045247 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b99eeaf8-10ff-4bd4-a762-304b2e8c4641 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:19.046756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b99eeaf8-10ff-4bd4-a762-304b2e8c4641 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:19.047981 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b99eeaf8-10ff-4bd4-a762-304b2e8c4641 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1724 microversion: 2.20 time: 0.177088 Feb 21 01:12:19.048560 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 211/444] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:18 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:19.134665 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2c02f38b-e455-4272-ab63-66427a9a84f5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:19.135501 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2c02f38b-e455-4272-ab63-66427a9a84f5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:19.142026 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2c02f38b-e455-4272-ab63-66427a9a84f5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:19.142467 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2c02f38b-e455-4272-ab63-66427a9a84f5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:19.144071 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2c02f38b-e455-4272-ab63-66427a9a84f5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:19.144512 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2c02f38b-e455-4272-ab63-66427a9a84f5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:19.176503 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2c02f38b-e455-4272-ab63-66427a9a84f5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045638 Feb 21 01:12:19.177073 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 234/445] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:19 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:12:20.068262 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4c2dfcda-882a-44b9-b579-a97288950dbe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:20.068874 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4c2dfcda-882a-44b9-b579-a97288950dbe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:20.075504 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4c2dfcda-882a-44b9-b579-a97288950dbe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:20.075990 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4c2dfcda-882a-44b9-b579-a97288950dbe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:20.076819 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4c2dfcda-882a-44b9-b579-a97288950dbe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:20.077256 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4c2dfcda-882a-44b9-b579-a97288950dbe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:20.188225 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2aba6acd-b10c-496b-8617-c5ccdeca27b9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:20.189159 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2aba6acd-b10c-496b-8617-c5ccdeca27b9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:20.195943 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2aba6acd-b10c-496b-8617-c5ccdeca27b9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:20.201924 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2aba6acd-b10c-496b-8617-c5ccdeca27b9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:20.201924 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2aba6acd-b10c-496b-8617-c5ccdeca27b9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:20.201924 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2aba6acd-b10c-496b-8617-c5ccdeca27b9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:20.238153 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2aba6acd-b10c-496b-8617-c5ccdeca27b9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053647 Feb 21 01:12:20.238876 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 235/446] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:20 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:12:20.248812 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4c2dfcda-882a-44b9-b579-a97288950dbe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:20.258129 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4c2dfcda-882a-44b9-b579-a97288950dbe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:20.259644 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4c2dfcda-882a-44b9-b579-a97288950dbe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:20.260885 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4c2dfcda-882a-44b9-b579-a97288950dbe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1724 microversion: 2.20 time: 0.197197 Feb 21 01:12:20.261446 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 212/447] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:20 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:21.250700 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3e9adc87-2241-44c4-bf5c-3ae7fc5481be tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:21.251609 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3e9adc87-2241-44c4-bf5c-3ae7fc5481be tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:21.258791 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3e9adc87-2241-44c4-bf5c-3ae7fc5481be tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:21.259232 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3e9adc87-2241-44c4-bf5c-3ae7fc5481be tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:21.260068 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3e9adc87-2241-44c4-bf5c-3ae7fc5481be tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:21.260500 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3e9adc87-2241-44c4-bf5c-3ae7fc5481be tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:21.288633 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ec4957f1-ca0c-49b8-a5bf-15cdba9aa253 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:21.289507 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ec4957f1-ca0c-49b8-a5bf-15cdba9aa253 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:21.293368 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3e9adc87-2241-44c4-bf5c-3ae7fc5481be tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046546 Feb 21 01:12:21.293954 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 236/448] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:21 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:21.295864 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec4957f1-ca0c-49b8-a5bf-15cdba9aa253 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:21.296344 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec4957f1-ca0c-49b8-a5bf-15cdba9aa253 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:21.297301 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec4957f1-ca0c-49b8-a5bf-15cdba9aa253 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:21.297588 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec4957f1-ca0c-49b8-a5bf-15cdba9aa253 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:21.458301 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ec4957f1-ca0c-49b8-a5bf-15cdba9aa253 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:21.467203 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ec4957f1-ca0c-49b8-a5bf-15cdba9aa253 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:21.468744 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ec4957f1-ca0c-49b8-a5bf-15cdba9aa253 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:21.469944 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ec4957f1-ca0c-49b8-a5bf-15cdba9aa253 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1724 microversion: 2.20 time: 0.185319 Feb 21 01:12:21.470515 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 213/449] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:21 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:12:22.307554 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9d34cc95-907b-4724-8f83-4eca3277c614 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:22.308472 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9d34cc95-907b-4724-8f83-4eca3277c614 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:22.316041 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d34cc95-907b-4724-8f83-4eca3277c614 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:22.316495 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d34cc95-907b-4724-8f83-4eca3277c614 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:22.317457 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d34cc95-907b-4724-8f83-4eca3277c614 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:22.318245 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d34cc95-907b-4724-8f83-4eca3277c614 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:22.351733 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9d34cc95-907b-4724-8f83-4eca3277c614 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049216 Feb 21 01:12:22.352651 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 237/450] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:22 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:22.488994 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-811d2b7d-08cb-4ba0-9a53-76bbe6814c81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:22.490411 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-811d2b7d-08cb-4ba0-9a53-76bbe6814c81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:22.497275 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-811d2b7d-08cb-4ba0-9a53-76bbe6814c81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:22.497722 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-811d2b7d-08cb-4ba0-9a53-76bbe6814c81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:22.498516 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-811d2b7d-08cb-4ba0-9a53-76bbe6814c81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:22.498977 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-811d2b7d-08cb-4ba0-9a53-76bbe6814c81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:22.673677 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-811d2b7d-08cb-4ba0-9a53-76bbe6814c81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:22.683542 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-811d2b7d-08cb-4ba0-9a53-76bbe6814c81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:22.685115 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-811d2b7d-08cb-4ba0-9a53-76bbe6814c81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:22.686318 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-811d2b7d-08cb-4ba0-9a53-76bbe6814c81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1724 microversion: 2.20 time: 0.201223 Feb 21 01:12:22.686877 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 214/451] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:22 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:23.362941 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7b61a60f-49fc-4923-ab4a-b644f86125e6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:23.364048 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7b61a60f-49fc-4923-ab4a-b644f86125e6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:23.370432 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7b61a60f-49fc-4923-ab4a-b644f86125e6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:23.370878 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7b61a60f-49fc-4923-ab4a-b644f86125e6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:23.371668 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7b61a60f-49fc-4923-ab4a-b644f86125e6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:23.372138 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7b61a60f-49fc-4923-ab4a-b644f86125e6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:23.403500 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7b61a60f-49fc-4923-ab4a-b644f86125e6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044647 Feb 21 01:12:23.404125 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 238/452] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:23 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:23.710480 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4e96d09d-c22c-4f75-8e21-d4002bc1e9d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:23.711360 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4e96d09d-c22c-4f75-8e21-d4002bc1e9d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:23.718668 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4e96d09d-c22c-4f75-8e21-d4002bc1e9d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:23.719111 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4e96d09d-c22c-4f75-8e21-d4002bc1e9d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:23.719944 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4e96d09d-c22c-4f75-8e21-d4002bc1e9d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:23.720380 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4e96d09d-c22c-4f75-8e21-d4002bc1e9d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:23.917989 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4e96d09d-c22c-4f75-8e21-d4002bc1e9d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:23.922989 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4e96d09d-c22c-4f75-8e21-d4002bc1e9d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:23.925384 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4e96d09d-c22c-4f75-8e21-d4002bc1e9d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:23.926538 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4e96d09d-c22c-4f75-8e21-d4002bc1e9d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1724 microversion: 2.20 time: 0.223619 Feb 21 01:12:23.927111 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 215/453] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:23 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:24.415645 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b77ca8f1-0c5f-4b12-89f0-ea6b6a35515d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:24.426915 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b77ca8f1-0c5f-4b12-89f0-ea6b6a35515d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:24.426915 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b77ca8f1-0c5f-4b12-89f0-ea6b6a35515d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:24.426915 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b77ca8f1-0c5f-4b12-89f0-ea6b6a35515d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:24.426915 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b77ca8f1-0c5f-4b12-89f0-ea6b6a35515d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:24.427317 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b77ca8f1-0c5f-4b12-89f0-ea6b6a35515d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:24.460173 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b77ca8f1-0c5f-4b12-89f0-ea6b6a35515d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048317 Feb 21 01:12:24.461124 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 239/454] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:24 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:24.945548 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ca593aee-d4fc-4bd5-abe8-0d24c9368d73 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:24.946155 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ca593aee-d4fc-4bd5-abe8-0d24c9368d73 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:24.952650 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ca593aee-d4fc-4bd5-abe8-0d24c9368d73 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:24.953091 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ca593aee-d4fc-4bd5-abe8-0d24c9368d73 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:24.953887 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ca593aee-d4fc-4bd5-abe8-0d24c9368d73 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:24.954319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ca593aee-d4fc-4bd5-abe8-0d24c9368d73 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:25.103767 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ca593aee-d4fc-4bd5-abe8-0d24c9368d73 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:25.112920 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ca593aee-d4fc-4bd5-abe8-0d24c9368d73 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:25.114487 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ca593aee-d4fc-4bd5-abe8-0d24c9368d73 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:25.115697 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ca593aee-d4fc-4bd5-abe8-0d24c9368d73 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1724 microversion: 2.20 time: 0.173837 Feb 21 01:12:25.116305 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 216/455] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:24 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:25.474646 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c11cdfc3-475b-46c9-af8d-df9dd79d547c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:25.475619 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c11cdfc3-475b-46c9-af8d-df9dd79d547c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:25.482739 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c11cdfc3-475b-46c9-af8d-df9dd79d547c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:25.483320 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c11cdfc3-475b-46c9-af8d-df9dd79d547c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:25.487711 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c11cdfc3-475b-46c9-af8d-df9dd79d547c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:25.487711 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c11cdfc3-475b-46c9-af8d-df9dd79d547c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:25.524329 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c11cdfc3-475b-46c9-af8d-df9dd79d547c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054618 Feb 21 01:12:25.524906 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 240/456] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:25 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:26.147533 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9a156055-55aa-4d26-bc26-ddc4c6b4ee9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:26.148224 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9a156055-55aa-4d26-bc26-ddc4c6b4ee9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:26.155094 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9a156055-55aa-4d26-bc26-ddc4c6b4ee9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:26.155547 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9a156055-55aa-4d26-bc26-ddc4c6b4ee9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:26.156405 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9a156055-55aa-4d26-bc26-ddc4c6b4ee9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:26.156848 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9a156055-55aa-4d26-bc26-ddc4c6b4ee9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:26.323918 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9a156055-55aa-4d26-bc26-ddc4c6b4ee9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:26.333174 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9a156055-55aa-4d26-bc26-ddc4c6b4ee9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:26.334697 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9a156055-55aa-4d26-bc26-ddc4c6b4ee9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:26.335881 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9a156055-55aa-4d26-bc26-ddc4c6b4ee9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1724 microversion: 2.20 time: 0.193068 Feb 21 01:12:26.336439 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 217/457] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:26 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:12:26.539146 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b2902f93-4a31-4e94-9899-1cd6684527af tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:26.540136 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b2902f93-4a31-4e94-9899-1cd6684527af tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:26.548779 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b2902f93-4a31-4e94-9899-1cd6684527af tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:26.550082 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b2902f93-4a31-4e94-9899-1cd6684527af tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:26.551448 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b2902f93-4a31-4e94-9899-1cd6684527af tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:26.552246 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b2902f93-4a31-4e94-9899-1cd6684527af tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:26.590758 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b2902f93-4a31-4e94-9899-1cd6684527af tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056361 Feb 21 01:12:26.591364 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 241/458] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:26 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:27.355102 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a76f2244-da54-403c-b533-8ced36bdb963 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:27.355695 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a76f2244-da54-403c-b533-8ced36bdb963 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:27.363512 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a76f2244-da54-403c-b533-8ced36bdb963 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:27.364511 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a76f2244-da54-403c-b533-8ced36bdb963 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:27.364798 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a76f2244-da54-403c-b533-8ced36bdb963 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:27.365234 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a76f2244-da54-403c-b533-8ced36bdb963 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:27.605927 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-11c4bf2c-eacf-4764-a13c-b3372bb3972f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:27.606772 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-11c4bf2c-eacf-4764-a13c-b3372bb3972f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:27.618454 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-11c4bf2c-eacf-4764-a13c-b3372bb3972f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:27.618908 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-11c4bf2c-eacf-4764-a13c-b3372bb3972f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:27.619738 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-11c4bf2c-eacf-4764-a13c-b3372bb3972f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:27.620211 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-11c4bf2c-eacf-4764-a13c-b3372bb3972f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:27.656378 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-11c4bf2c-eacf-4764-a13c-b3372bb3972f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054254 Feb 21 01:12:27.657112 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 242/459] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:27 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:12:27.758849 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a76f2244-da54-403c-b533-8ced36bdb963 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:27.767593 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a76f2244-da54-403c-b533-8ced36bdb963 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:27.770092 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a76f2244-da54-403c-b533-8ced36bdb963 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:27.771321 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a76f2244-da54-403c-b533-8ced36bdb963 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1724 microversion: 2.20 time: 0.420105 Feb 21 01:12:27.771939 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 218/460] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:27 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1724 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:12:28.669618 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9f5e1323-f0bd-4500-9ef0-ef5eda717006 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:28.670446 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9f5e1323-f0bd-4500-9ef0-ef5eda717006 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:28.677189 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9f5e1323-f0bd-4500-9ef0-ef5eda717006 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:28.677631 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9f5e1323-f0bd-4500-9ef0-ef5eda717006 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:28.678502 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9f5e1323-f0bd-4500-9ef0-ef5eda717006 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:28.678928 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9f5e1323-f0bd-4500-9ef0-ef5eda717006 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:28.709443 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9f5e1323-f0bd-4500-9ef0-ef5eda717006 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043673 Feb 21 01:12:28.709999 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 243/461] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:28 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:28.791911 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0b10c81a-6702-41ae-bc17-b66c007e9775 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:28.792593 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0b10c81a-6702-41ae-bc17-b66c007e9775 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:28.798890 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0b10c81a-6702-41ae-bc17-b66c007e9775 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:28.799428 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0b10c81a-6702-41ae-bc17-b66c007e9775 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:28.800250 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0b10c81a-6702-41ae-bc17-b66c007e9775 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:28.800678 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0b10c81a-6702-41ae-bc17-b66c007e9775 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:28.948938 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0b10c81a-6702-41ae-bc17-b66c007e9775 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:28.959137 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0b10c81a-6702-41ae-bc17-b66c007e9775 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:28.960916 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0b10c81a-6702-41ae-bc17-b66c007e9775 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:28.962151 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0b10c81a-6702-41ae-bc17-b66c007e9775 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1724 microversion: 2.20 time: 0.174059 Feb 21 01:12:28.962739 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 219/462] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:28 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:29.721683 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4ca984e4-d315-45c3-93b4-cb1d85890e1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:29.728240 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4ca984e4-d315-45c3-93b4-cb1d85890e1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:29.734940 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4ca984e4-d315-45c3-93b4-cb1d85890e1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:29.735381 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4ca984e4-d315-45c3-93b4-cb1d85890e1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:29.736221 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4ca984e4-d315-45c3-93b4-cb1d85890e1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:29.737387 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4ca984e4-d315-45c3-93b4-cb1d85890e1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:29.770980 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4ca984e4-d315-45c3-93b4-cb1d85890e1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053574 Feb 21 01:12:29.771560 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 244/463] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:29 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:29.981557 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d2e8ca52-4007-4c9c-b583-df3b3d4ad9e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:29.982152 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d2e8ca52-4007-4c9c-b583-df3b3d4ad9e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:29.988805 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d2e8ca52-4007-4c9c-b583-df3b3d4ad9e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:29.989250 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d2e8ca52-4007-4c9c-b583-df3b3d4ad9e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:29.990051 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d2e8ca52-4007-4c9c-b583-df3b3d4ad9e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:29.990485 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d2e8ca52-4007-4c9c-b583-df3b3d4ad9e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:30.145320 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d2e8ca52-4007-4c9c-b583-df3b3d4ad9e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:30.154019 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d2e8ca52-4007-4c9c-b583-df3b3d4ad9e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:30.155559 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d2e8ca52-4007-4c9c-b583-df3b3d4ad9e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:30.156811 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d2e8ca52-4007-4c9c-b583-df3b3d4ad9e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1724 microversion: 2.20 time: 0.179022 Feb 21 01:12:30.157376 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 220/464] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:29 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:30.782762 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4fe1ede8-c2fd-42a1-a9aa-f752a96aede4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:30.784222 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4fe1ede8-c2fd-42a1-a9aa-f752a96aede4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:30.790823 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4fe1ede8-c2fd-42a1-a9aa-f752a96aede4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:30.791271 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4fe1ede8-c2fd-42a1-a9aa-f752a96aede4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:30.792102 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4fe1ede8-c2fd-42a1-a9aa-f752a96aede4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:30.792545 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4fe1ede8-c2fd-42a1-a9aa-f752a96aede4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:30.825310 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4fe1ede8-c2fd-42a1-a9aa-f752a96aede4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046284 Feb 21 01:12:30.825885 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 245/465] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:30 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:31.184448 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b9857ee2-8c1d-497c-81d3-00590b12bca4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:31.185181 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b9857ee2-8c1d-497c-81d3-00590b12bca4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:31.192848 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b9857ee2-8c1d-497c-81d3-00590b12bca4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:31.193089 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b9857ee2-8c1d-497c-81d3-00590b12bca4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:31.193769 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b9857ee2-8c1d-497c-81d3-00590b12bca4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:31.194234 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b9857ee2-8c1d-497c-81d3-00590b12bca4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:31.362469 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b9857ee2-8c1d-497c-81d3-00590b12bca4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:31.373121 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b9857ee2-8c1d-497c-81d3-00590b12bca4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:31.376612 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b9857ee2-8c1d-497c-81d3-00590b12bca4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:31.379274 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b9857ee2-8c1d-497c-81d3-00590b12bca4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1724 microversion: 2.20 time: 0.198312 Feb 21 01:12:31.380376 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 221/466] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:31 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:31.836733 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c8db4d2a-8453-409c-8f1b-3b87f97b2330 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:31.837638 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c8db4d2a-8453-409c-8f1b-3b87f97b2330 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:31.843819 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c8db4d2a-8453-409c-8f1b-3b87f97b2330 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:31.844285 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c8db4d2a-8453-409c-8f1b-3b87f97b2330 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:31.845063 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c8db4d2a-8453-409c-8f1b-3b87f97b2330 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:31.845488 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c8db4d2a-8453-409c-8f1b-3b87f97b2330 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:31.873856 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c8db4d2a-8453-409c-8f1b-3b87f97b2330 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040833 Feb 21 01:12:31.874397 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 246/467] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:31 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:32.409468 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cc561c66-d1e7-4e37-a453-f8a427d35e00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:32.410484 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cc561c66-d1e7-4e37-a453-f8a427d35e00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:32.417213 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc561c66-d1e7-4e37-a453-f8a427d35e00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:32.417665 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc561c66-d1e7-4e37-a453-f8a427d35e00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:32.418470 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc561c66-d1e7-4e37-a453-f8a427d35e00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:32.418908 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc561c66-d1e7-4e37-a453-f8a427d35e00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:32.564253 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cc561c66-d1e7-4e37-a453-f8a427d35e00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:32.572686 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cc561c66-d1e7-4e37-a453-f8a427d35e00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:32.574215 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cc561c66-d1e7-4e37-a453-f8a427d35e00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:32.575365 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cc561c66-d1e7-4e37-a453-f8a427d35e00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1724 microversion: 2.20 time: 0.170835 Feb 21 01:12:32.576045 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 222/468] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:32 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:32.885877 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-42437d2e-9534-4a22-99eb-5ab2d8e34499 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:32.886702 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-42437d2e-9534-4a22-99eb-5ab2d8e34499 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:32.893734 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-42437d2e-9534-4a22-99eb-5ab2d8e34499 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:32.894163 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-42437d2e-9534-4a22-99eb-5ab2d8e34499 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:32.894945 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-42437d2e-9534-4a22-99eb-5ab2d8e34499 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:32.895374 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-42437d2e-9534-4a22-99eb-5ab2d8e34499 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:32.924757 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-42437d2e-9534-4a22-99eb-5ab2d8e34499 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042593 Feb 21 01:12:32.925345 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 247/469] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:32 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:33.594430 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-68e262d4-0a89-4173-845d-ef1361d3ddc0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:33.595028 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-68e262d4-0a89-4173-845d-ef1361d3ddc0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:33.602740 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68e262d4-0a89-4173-845d-ef1361d3ddc0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:33.603186 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68e262d4-0a89-4173-845d-ef1361d3ddc0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:33.604012 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68e262d4-0a89-4173-845d-ef1361d3ddc0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:33.604472 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68e262d4-0a89-4173-845d-ef1361d3ddc0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:33.748884 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-68e262d4-0a89-4173-845d-ef1361d3ddc0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:33.757852 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-68e262d4-0a89-4173-845d-ef1361d3ddc0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:33.759365 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-68e262d4-0a89-4173-845d-ef1361d3ddc0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:33.760611 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-68e262d4-0a89-4173-845d-ef1361d3ddc0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1745 microversion: 2.20 time: 0.169923 Feb 21 01:12:33.761146 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 223/470] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:33 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:33.936370 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ec9073a5-b9f2-41bc-801b-977cbccfcefc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:33.937230 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ec9073a5-b9f2-41bc-801b-977cbccfcefc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:33.944534 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec9073a5-b9f2-41bc-801b-977cbccfcefc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:33.944982 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec9073a5-b9f2-41bc-801b-977cbccfcefc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:33.945809 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec9073a5-b9f2-41bc-801b-977cbccfcefc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:33.946250 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec9073a5-b9f2-41bc-801b-977cbccfcefc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:33.990574 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ec9073a5-b9f2-41bc-801b-977cbccfcefc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057946 Feb 21 01:12:33.991157 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 248/471] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:33 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:34.779759 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-19c692de-d634-4210-959e-f65e1017c8bb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:34.780436 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-19c692de-d634-4210-959e-f65e1017c8bb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:34.788480 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-19c692de-d634-4210-959e-f65e1017c8bb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:34.789031 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-19c692de-d634-4210-959e-f65e1017c8bb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:34.789888 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-19c692de-d634-4210-959e-f65e1017c8bb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:34.790250 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-19c692de-d634-4210-959e-f65e1017c8bb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:34.953311 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-19c692de-d634-4210-959e-f65e1017c8bb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:34.962224 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-19c692de-d634-4210-959e-f65e1017c8bb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:34.963736 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-19c692de-d634-4210-959e-f65e1017c8bb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:34.964961 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-19c692de-d634-4210-959e-f65e1017c8bb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1745 microversion: 2.20 time: 0.189194 Feb 21 01:12:34.965528 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 224/472] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:34 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1745 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:35.004696 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-201fdcc0-44ab-4475-8fe8-071e753c7f9e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:35.005977 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-201fdcc0-44ab-4475-8fe8-071e753c7f9e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:35.014627 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-201fdcc0-44ab-4475-8fe8-071e753c7f9e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:35.015077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-201fdcc0-44ab-4475-8fe8-071e753c7f9e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:35.016065 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-201fdcc0-44ab-4475-8fe8-071e753c7f9e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:35.016540 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-201fdcc0-44ab-4475-8fe8-071e753c7f9e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:35.050725 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-201fdcc0-44ab-4475-8fe8-071e753c7f9e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051506 Feb 21 01:12:35.051299 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 249/473] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:34 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:35.987912 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3caff9bd-5699-4874-9e3a-914e77c65aae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:35.988513 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3caff9bd-5699-4874-9e3a-914e77c65aae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:35.995057 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3caff9bd-5699-4874-9e3a-914e77c65aae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:35.995501 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3caff9bd-5699-4874-9e3a-914e77c65aae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:35.996317 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3caff9bd-5699-4874-9e3a-914e77c65aae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:35.996749 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3caff9bd-5699-4874-9e3a-914e77c65aae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:36.063776 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a6a35b4d-cc18-4973-b8d3-0bf1abdfc3b1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:36.067429 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a6a35b4d-cc18-4973-b8d3-0bf1abdfc3b1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:36.072378 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a6a35b4d-cc18-4973-b8d3-0bf1abdfc3b1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:36.072876 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a6a35b4d-cc18-4973-b8d3-0bf1abdfc3b1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:36.073692 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a6a35b4d-cc18-4973-b8d3-0bf1abdfc3b1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:36.074115 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a6a35b4d-cc18-4973-b8d3-0bf1abdfc3b1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:36.107519 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a6a35b4d-cc18-4973-b8d3-0bf1abdfc3b1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047679 Feb 21 01:12:36.108135 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 250/474] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:36 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:36.140982 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3caff9bd-5699-4874-9e3a-914e77c65aae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:36.151179 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3caff9bd-5699-4874-9e3a-914e77c65aae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:36.152742 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3caff9bd-5699-4874-9e3a-914e77c65aae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:36.153927 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3caff9bd-5699-4874-9e3a-914e77c65aae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1740 microversion: 2.20 time: 0.169907 Feb 21 01:12:36.154486 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 225/475] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:35 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:37.118160 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-59764729-9a39-49fe-99a6-8cbbf043db3f req-af710099-2020-465c-80af-198208e206bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2aa103a-4f89-45a6-8c62-09282555e3b3", "name": "network-vif-plugged", "status": "completed", "tag": "17542d9a-ec16-46b0-907e-71f3f5221834"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:12:37.118942 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-96fcd226-8f0c-40fc-ac2d-f9fb8be2f86b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:37.120829 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:12:37.120829 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:12:37.122660 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-96fcd226-8f0c-40fc-ac2d-f9fb8be2f86b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:37.130113 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-96fcd226-8f0c-40fc-ac2d-f9fb8be2f86b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:37.130568 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-96fcd226-8f0c-40fc-ac2d-f9fb8be2f86b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:37.132339 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-96fcd226-8f0c-40fc-ac2d-f9fb8be2f86b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:37.133003 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-96fcd226-8f0c-40fc-ac2d-f9fb8be2f86b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:37.138763 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-59764729-9a39-49fe-99a6-8cbbf043db3f req-af710099-2020-465c-80af-198208e206bf service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:37.142257 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-59764729-9a39-49fe-99a6-8cbbf043db3f req-af710099-2020-465c-80af-198208e206bf service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:37.167752 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-59764729-9a39-49fe-99a6-8cbbf043db3f req-af710099-2020-465c-80af-198208e206bf service nova] Creating event network-vif-plugged:17542d9a-ec16-46b0-907e-71f3f5221834 for instance e2aa103a-4f89-45a6-8c62-09282555e3b3 on hv-cinder-81322 Feb 21 01:12:37.170739 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-96fcd226-8f0c-40fc-ac2d-f9fb8be2f86b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055314 Feb 21 01:12:37.174369 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-59764729-9a39-49fe-99a6-8cbbf043db3f req-af710099-2020-465c-80af-198208e206bf service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063164 Feb 21 01:12:37.177463 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 226/476] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:37 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:37.179850 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 251/477] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:37.182252 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8d34b990-f2fe-4dd1-9a29-27c490338a80 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:37.183102 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8d34b990-f2fe-4dd1-9a29-27c490338a80 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:37.190214 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8d34b990-f2fe-4dd1-9a29-27c490338a80 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:37.191039 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8d34b990-f2fe-4dd1-9a29-27c490338a80 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:37.191887 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8d34b990-f2fe-4dd1-9a29-27c490338a80 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:37.192531 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8d34b990-f2fe-4dd1-9a29-27c490338a80 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:37.381380 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8d34b990-f2fe-4dd1-9a29-27c490338a80 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:37.390171 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8d34b990-f2fe-4dd1-9a29-27c490338a80 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:37.392076 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8d34b990-f2fe-4dd1-9a29-27c490338a80 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:37.393350 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8d34b990-f2fe-4dd1-9a29-27c490338a80 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1740 microversion: 2.20 time: 0.215059 Feb 21 01:12:37.394083 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 227/478] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:37 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:38.188495 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-24c97f85-88d7-44e4-ad15-de656aa8f340 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:38.191606 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-24c97f85-88d7-44e4-ad15-de656aa8f340 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:38.198830 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-24c97f85-88d7-44e4-ad15-de656aa8f340 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:38.199352 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-24c97f85-88d7-44e4-ad15-de656aa8f340 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:38.200265 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-24c97f85-88d7-44e4-ad15-de656aa8f340 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:38.200891 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-24c97f85-88d7-44e4-ad15-de656aa8f340 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:38.236401 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-24c97f85-88d7-44e4-ad15-de656aa8f340 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054197 Feb 21 01:12:38.237660 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 252/479] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:38 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:38.416515 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2977773f-4cab-4fad-acd6-da89515b2168 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:38.417657 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2977773f-4cab-4fad-acd6-da89515b2168 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:38.428247 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2977773f-4cab-4fad-acd6-da89515b2168 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:38.429078 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2977773f-4cab-4fad-acd6-da89515b2168 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:38.430772 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2977773f-4cab-4fad-acd6-da89515b2168 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:38.431400 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2977773f-4cab-4fad-acd6-da89515b2168 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:38.616249 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2977773f-4cab-4fad-acd6-da89515b2168 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:38.625276 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2977773f-4cab-4fad-acd6-da89515b2168 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:38.626697 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2977773f-4cab-4fad-acd6-da89515b2168 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:38.628232 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2977773f-4cab-4fad-acd6-da89515b2168 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1740 microversion: 2.20 time: 0.218713 Feb 21 01:12:38.642105 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 228/480] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:38 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1740 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:12:39.249689 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-db23ac52-cf72-4c44-80ef-bebde3d2d4aa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:39.250617 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-db23ac52-cf72-4c44-80ef-bebde3d2d4aa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:39.257836 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db23ac52-cf72-4c44-80ef-bebde3d2d4aa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:39.258292 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db23ac52-cf72-4c44-80ef-bebde3d2d4aa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:39.259081 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db23ac52-cf72-4c44-80ef-bebde3d2d4aa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:39.259518 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db23ac52-cf72-4c44-80ef-bebde3d2d4aa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:39.289260 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-db23ac52-cf72-4c44-80ef-bebde3d2d4aa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043400 Feb 21 01:12:39.289827 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 253/481] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:39 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:39.647338 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-94ecddb3-4d72-4eb3-abc7-236d63a2e897 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:39.648029 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-94ecddb3-4d72-4eb3-abc7-236d63a2e897 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:39.655409 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-94ecddb3-4d72-4eb3-abc7-236d63a2e897 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:39.655891 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-94ecddb3-4d72-4eb3-abc7-236d63a2e897 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:39.656697 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-94ecddb3-4d72-4eb3-abc7-236d63a2e897 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:39.657131 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-94ecddb3-4d72-4eb3-abc7-236d63a2e897 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:39.811971 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-94ecddb3-4d72-4eb3-abc7-236d63a2e897 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:39.819936 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-94ecddb3-4d72-4eb3-abc7-236d63a2e897 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:39.821413 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-94ecddb3-4d72-4eb3-abc7-236d63a2e897 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:39.822556 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-94ecddb3-4d72-4eb3-abc7-236d63a2e897 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1740 microversion: 2.20 time: 0.179919 Feb 21 01:12:39.823095 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 229/482] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:39 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:40.303676 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-844e50e1-25a1-4e74-ac98-3610e0049ac9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:40.304691 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-844e50e1-25a1-4e74-ac98-3610e0049ac9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:40.311125 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-844e50e1-25a1-4e74-ac98-3610e0049ac9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:40.311570 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-844e50e1-25a1-4e74-ac98-3610e0049ac9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:40.312402 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-844e50e1-25a1-4e74-ac98-3610e0049ac9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:40.313004 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-844e50e1-25a1-4e74-ac98-3610e0049ac9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:40.348659 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-844e50e1-25a1-4e74-ac98-3610e0049ac9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050762 Feb 21 01:12:40.349587 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 254/483] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:40 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:40.841955 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-127e4492-3597-49f2-8b3a-789466a2a8d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:40.842503 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-127e4492-3597-49f2-8b3a-789466a2a8d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:40.850151 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-127e4492-3597-49f2-8b3a-789466a2a8d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:40.850602 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-127e4492-3597-49f2-8b3a-789466a2a8d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:40.851401 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-127e4492-3597-49f2-8b3a-789466a2a8d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:40.851851 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-127e4492-3597-49f2-8b3a-789466a2a8d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:41.023813 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-127e4492-3597-49f2-8b3a-789466a2a8d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:41.032320 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-127e4492-3597-49f2-8b3a-789466a2a8d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:41.035333 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-127e4492-3597-49f2-8b3a-789466a2a8d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:41.036608 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-127e4492-3597-49f2-8b3a-789466a2a8d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1740 microversion: 2.20 time: 0.198886 Feb 21 01:12:41.037177 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 230/484] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:40 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:41.364704 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e6eab8a8-2c42-4c1a-942d-369653cb0c26 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:41.366580 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e6eab8a8-2c42-4c1a-942d-369653cb0c26 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:41.374577 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e6eab8a8-2c42-4c1a-942d-369653cb0c26 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:41.375324 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e6eab8a8-2c42-4c1a-942d-369653cb0c26 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:41.376496 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e6eab8a8-2c42-4c1a-942d-369653cb0c26 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:41.377146 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e6eab8a8-2c42-4c1a-942d-369653cb0c26 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:41.417536 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e6eab8a8-2c42-4c1a-942d-369653cb0c26 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060293 Feb 21 01:12:41.419208 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 255/485] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:41 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:42.056500 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3eef69fe-b4b0-48a5-bca5-c85228ea3e78 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:42.057332 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3eef69fe-b4b0-48a5-bca5-c85228ea3e78 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:42.068364 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3eef69fe-b4b0-48a5-bca5-c85228ea3e78 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:42.069243 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3eef69fe-b4b0-48a5-bca5-c85228ea3e78 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:42.070310 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3eef69fe-b4b0-48a5-bca5-c85228ea3e78 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:42.071116 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3eef69fe-b4b0-48a5-bca5-c85228ea3e78 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:42.313165 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3eef69fe-b4b0-48a5-bca5-c85228ea3e78 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:42.328432 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3eef69fe-b4b0-48a5-bca5-c85228ea3e78 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:42.333201 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3eef69fe-b4b0-48a5-bca5-c85228ea3e78 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:42.336182 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3eef69fe-b4b0-48a5-bca5-c85228ea3e78 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1740 microversion: 2.20 time: 0.284077 Feb 21 01:12:42.337450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 231/486] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:42 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1740 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:12:42.434239 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0eaddb6d-c95d-457c-9b95-6a068fd1d2b5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:42.435984 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0eaddb6d-c95d-457c-9b95-6a068fd1d2b5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:42.444030 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0eaddb6d-c95d-457c-9b95-6a068fd1d2b5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:42.444578 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0eaddb6d-c95d-457c-9b95-6a068fd1d2b5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:42.445474 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0eaddb6d-c95d-457c-9b95-6a068fd1d2b5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:42.445920 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0eaddb6d-c95d-457c-9b95-6a068fd1d2b5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:42.497783 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0eaddb6d-c95d-457c-9b95-6a068fd1d2b5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067653 Feb 21 01:12:42.498938 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 256/487] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:42 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:12:43.370689 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-98f63e93-c293-44f6-9876-dd94e9154964 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:43.373659 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-98f63e93-c293-44f6-9876-dd94e9154964 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:43.386788 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-98f63e93-c293-44f6-9876-dd94e9154964 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:43.388126 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-98f63e93-c293-44f6-9876-dd94e9154964 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:43.389846 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-98f63e93-c293-44f6-9876-dd94e9154964 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:43.390827 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-98f63e93-c293-44f6-9876-dd94e9154964 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:43.515402 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-966153c2-f2ea-43fb-a894-ef441cffac27 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:43.518994 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-966153c2-f2ea-43fb-a894-ef441cffac27 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:43.535710 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-966153c2-f2ea-43fb-a894-ef441cffac27 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:43.536257 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-966153c2-f2ea-43fb-a894-ef441cffac27 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:43.537013 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-966153c2-f2ea-43fb-a894-ef441cffac27 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:43.537455 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-966153c2-f2ea-43fb-a894-ef441cffac27 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:43.583652 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-966153c2-f2ea-43fb-a894-ef441cffac27 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075464 Feb 21 01:12:43.584588 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 257/488] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:43 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:43.652355 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-98f63e93-c293-44f6-9876-dd94e9154964 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:43.669875 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-98f63e93-c293-44f6-9876-dd94e9154964 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:43.672850 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-98f63e93-c293-44f6-9876-dd94e9154964 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:43.675319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-98f63e93-c293-44f6-9876-dd94e9154964 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1740 microversion: 2.20 time: 0.310283 Feb 21 01:12:43.690479 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 232/489] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:43 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1740 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:44.602188 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1b0767ee-0157-409b-bbb4-9290aa91002d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:44.605123 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1b0767ee-0157-409b-bbb4-9290aa91002d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:44.615705 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1b0767ee-0157-409b-bbb4-9290aa91002d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:44.616143 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1b0767ee-0157-409b-bbb4-9290aa91002d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:44.617189 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1b0767ee-0157-409b-bbb4-9290aa91002d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:44.617835 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1b0767ee-0157-409b-bbb4-9290aa91002d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:44.670357 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1b0767ee-0157-409b-bbb4-9290aa91002d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076253 Feb 21 01:12:44.672001 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 258/490] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:44 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:44.703965 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ce93f980-c40d-4860-852f-16013a694aa6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:44.704848 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ce93f980-c40d-4860-852f-16013a694aa6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:44.711897 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ce93f980-c40d-4860-852f-16013a694aa6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:44.712196 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ce93f980-c40d-4860-852f-16013a694aa6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:44.713239 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ce93f980-c40d-4860-852f-16013a694aa6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:44.713882 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ce93f980-c40d-4860-852f-16013a694aa6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:44.897335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ce93f980-c40d-4860-852f-16013a694aa6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:44.906826 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ce93f980-c40d-4860-852f-16013a694aa6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:44.909371 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ce93f980-c40d-4860-852f-16013a694aa6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:44.910608 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ce93f980-c40d-4860-852f-16013a694aa6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1740 microversion: 2.20 time: 0.210524 Feb 21 01:12:44.911176 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 233/491] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:44 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:45.684901 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2b38a145-8268-4098-bfdc-38363b6bcd01 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:45.686030 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2b38a145-8268-4098-bfdc-38363b6bcd01 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:45.693606 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2b38a145-8268-4098-bfdc-38363b6bcd01 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:45.694587 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2b38a145-8268-4098-bfdc-38363b6bcd01 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:45.695824 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2b38a145-8268-4098-bfdc-38363b6bcd01 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:45.696545 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2b38a145-8268-4098-bfdc-38363b6bcd01 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:45.754073 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2b38a145-8268-4098-bfdc-38363b6bcd01 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073321 Feb 21 01:12:45.756267 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 259/492] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:45 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:12:45.933885 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fa0a9612-dfb5-4bca-834c-46a92dee69f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:45.935028 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fa0a9612-dfb5-4bca-834c-46a92dee69f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:45.944440 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fa0a9612-dfb5-4bca-834c-46a92dee69f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:45.944885 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fa0a9612-dfb5-4bca-834c-46a92dee69f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:45.945932 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fa0a9612-dfb5-4bca-834c-46a92dee69f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:45.946403 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fa0a9612-dfb5-4bca-834c-46a92dee69f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:46.157900 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fa0a9612-dfb5-4bca-834c-46a92dee69f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:46.167729 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fa0a9612-dfb5-4bca-834c-46a92dee69f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:46.169303 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fa0a9612-dfb5-4bca-834c-46a92dee69f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:46.170623 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fa0a9612-dfb5-4bca-834c-46a92dee69f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1740 microversion: 2.20 time: 0.241324 Feb 21 01:12:46.171195 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 234/493] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:45 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1740 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:12:46.775481 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-49ff0cdb-ed73-4177-a5ee-f5993c1b3720 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:46.780463 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-49ff0cdb-ed73-4177-a5ee-f5993c1b3720 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:46.792119 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49ff0cdb-ed73-4177-a5ee-f5993c1b3720 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:46.793257 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49ff0cdb-ed73-4177-a5ee-f5993c1b3720 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:46.794862 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49ff0cdb-ed73-4177-a5ee-f5993c1b3720 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:46.796242 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49ff0cdb-ed73-4177-a5ee-f5993c1b3720 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:46.850223 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-49ff0cdb-ed73-4177-a5ee-f5993c1b3720 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081308 Feb 21 01:12:46.850817 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 260/494] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:46 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:47.196707 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4118332b-159c-48d3-b22d-e683765f8d8c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:47.198061 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4118332b-159c-48d3-b22d-e683765f8d8c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:47.205587 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4118332b-159c-48d3-b22d-e683765f8d8c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:47.212788 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4118332b-159c-48d3-b22d-e683765f8d8c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:47.213993 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4118332b-159c-48d3-b22d-e683765f8d8c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:47.214618 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4118332b-159c-48d3-b22d-e683765f8d8c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:47.418643 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4118332b-159c-48d3-b22d-e683765f8d8c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:47.434267 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4118332b-159c-48d3-b22d-e683765f8d8c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:47.437486 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4118332b-159c-48d3-b22d-e683765f8d8c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:47.439141 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4118332b-159c-48d3-b22d-e683765f8d8c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1740 microversion: 2.20 time: 0.246093 Feb 21 01:12:47.440374 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 235/495] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:47 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:47.862051 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-247e61d7-ceca-494c-8ed8-ee6a0e43153c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:47.862982 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-247e61d7-ceca-494c-8ed8-ee6a0e43153c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:47.869537 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-247e61d7-ceca-494c-8ed8-ee6a0e43153c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:47.869980 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-247e61d7-ceca-494c-8ed8-ee6a0e43153c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:47.870776 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-247e61d7-ceca-494c-8ed8-ee6a0e43153c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:47.871208 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-247e61d7-ceca-494c-8ed8-ee6a0e43153c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:47.905548 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-247e61d7-ceca-494c-8ed8-ee6a0e43153c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047288 Feb 21 01:12:47.906151 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 261/496] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:47 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:48.468163 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b64b7325-0bd4-4cd5-b9d9-433eae7bd3d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:48.468808 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b64b7325-0bd4-4cd5-b9d9-433eae7bd3d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:48.476489 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b64b7325-0bd4-4cd5-b9d9-433eae7bd3d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:48.476940 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b64b7325-0bd4-4cd5-b9d9-433eae7bd3d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:48.477745 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b64b7325-0bd4-4cd5-b9d9-433eae7bd3d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:48.478180 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b64b7325-0bd4-4cd5-b9d9-433eae7bd3d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:48.633599 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b64b7325-0bd4-4cd5-b9d9-433eae7bd3d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:48.643109 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b64b7325-0bd4-4cd5-b9d9-433eae7bd3d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:48.645809 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b64b7325-0bd4-4cd5-b9d9-433eae7bd3d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:48.647610 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b64b7325-0bd4-4cd5-b9d9-433eae7bd3d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1740 microversion: 2.20 time: 0.182954 Feb 21 01:12:48.648542 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 236/497] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:48 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:48.917566 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a22e9f86-63fe-4ebb-ae0d-ac4fdb52376f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:48.918522 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a22e9f86-63fe-4ebb-ae0d-ac4fdb52376f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:48.925472 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a22e9f86-63fe-4ebb-ae0d-ac4fdb52376f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:48.925920 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a22e9f86-63fe-4ebb-ae0d-ac4fdb52376f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:48.926721 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a22e9f86-63fe-4ebb-ae0d-ac4fdb52376f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:48.927156 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a22e9f86-63fe-4ebb-ae0d-ac4fdb52376f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:48.959295 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a22e9f86-63fe-4ebb-ae0d-ac4fdb52376f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046023 Feb 21 01:12:48.959889 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 262/498] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:48 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:49.672674 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c3c6e3f8-10b6-45af-9dae-a8f07bf9cd1d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:49.673277 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c3c6e3f8-10b6-45af-9dae-a8f07bf9cd1d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:49.680487 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c3c6e3f8-10b6-45af-9dae-a8f07bf9cd1d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:49.680926 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c3c6e3f8-10b6-45af-9dae-a8f07bf9cd1d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:49.681707 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c3c6e3f8-10b6-45af-9dae-a8f07bf9cd1d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:49.682136 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c3c6e3f8-10b6-45af-9dae-a8f07bf9cd1d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:49.887860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c3c6e3f8-10b6-45af-9dae-a8f07bf9cd1d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:49.897426 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c3c6e3f8-10b6-45af-9dae-a8f07bf9cd1d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:49.898943 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c3c6e3f8-10b6-45af-9dae-a8f07bf9cd1d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:49.900127 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c3c6e3f8-10b6-45af-9dae-a8f07bf9cd1d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1722 microversion: 2.20 time: 0.231374 Feb 21 01:12:49.900692 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 237/499] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:49 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:49.971670 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d3932f8f-e3f7-4120-b651-be0351dba1d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:49.972641 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d3932f8f-e3f7-4120-b651-be0351dba1d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:49.979156 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d3932f8f-e3f7-4120-b651-be0351dba1d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:49.979612 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d3932f8f-e3f7-4120-b651-be0351dba1d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:49.980457 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d3932f8f-e3f7-4120-b651-be0351dba1d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:49.980920 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d3932f8f-e3f7-4120-b651-be0351dba1d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:50.013767 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d3932f8f-e3f7-4120-b651-be0351dba1d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046698 Feb 21 01:12:50.014339 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 263/500] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:49 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:50.918259 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-618e70b5-c5fc-4293-9cd7-2b7074e94717 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:50.919083 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-618e70b5-c5fc-4293-9cd7-2b7074e94717 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:50.926154 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-618e70b5-c5fc-4293-9cd7-2b7074e94717 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:50.926595 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-618e70b5-c5fc-4293-9cd7-2b7074e94717 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:50.927388 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-618e70b5-c5fc-4293-9cd7-2b7074e94717 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:50.927810 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-618e70b5-c5fc-4293-9cd7-2b7074e94717 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:51.030095 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-84462f27-fc8e-40d0-99c0-cef962d261ce tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:51.031023 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-84462f27-fc8e-40d0-99c0-cef962d261ce tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:51.038632 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84462f27-fc8e-40d0-99c0-cef962d261ce tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:51.039400 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84462f27-fc8e-40d0-99c0-cef962d261ce tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:51.040244 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84462f27-fc8e-40d0-99c0-cef962d261ce tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:51.040677 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84462f27-fc8e-40d0-99c0-cef962d261ce tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:51.075486 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-84462f27-fc8e-40d0-99c0-cef962d261ce tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050021 Feb 21 01:12:51.076429 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 264/501] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:51 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:12:51.080522 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-618e70b5-c5fc-4293-9cd7-2b7074e94717 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:51.094560 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-618e70b5-c5fc-4293-9cd7-2b7074e94717 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:51.098248 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-618e70b5-c5fc-4293-9cd7-2b7074e94717 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:51.099625 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-618e70b5-c5fc-4293-9cd7-2b7074e94717 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1722 microversion: 2.20 time: 0.185092 Feb 21 01:12:51.100418 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 238/502] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:50 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:51.160153 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-8ac22d78-2247-48c1-acc9-f9cb96afdda2 req-8706335d-067f-4bb0-a4fa-f711681e3b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2aa103a-4f89-45a6-8c62-09282555e3b3", "name": "network-vif-unplugged", "status": "completed", "tag": "17542d9a-ec16-46b0-907e-71f3f5221834"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:12:51.161690 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:12:51.161690 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:12:51.168832 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-8ac22d78-2247-48c1-acc9-f9cb96afdda2 req-8706335d-067f-4bb0-a4fa-f711681e3b01 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:51.169295 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-8ac22d78-2247-48c1-acc9-f9cb96afdda2 req-8706335d-067f-4bb0-a4fa-f711681e3b01 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:51.180197 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-8ac22d78-2247-48c1-acc9-f9cb96afdda2 req-8706335d-067f-4bb0-a4fa-f711681e3b01 service nova] Creating event network-vif-unplugged:17542d9a-ec16-46b0-907e-71f3f5221834 for instance e2aa103a-4f89-45a6-8c62-09282555e3b3 on hv-cinder-81322 Feb 21 01:12:51.185190 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-8ac22d78-2247-48c1-acc9-f9cb96afdda2 req-8706335d-067f-4bb0-a4fa-f711681e3b01 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029636 Feb 21 01:12:51.185769 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 265/503] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:52.087416 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9fcfc868-0c84-42b5-a02f-f13894028205 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:52.088399 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9fcfc868-0c84-42b5-a02f-f13894028205 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:52.094865 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9fcfc868-0c84-42b5-a02f-f13894028205 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:52.095318 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9fcfc868-0c84-42b5-a02f-f13894028205 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:52.096144 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9fcfc868-0c84-42b5-a02f-f13894028205 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:52.096628 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9fcfc868-0c84-42b5-a02f-f13894028205 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:52.120797 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-805290e2-4f60-41fe-b380-d608948b5c25 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:52.122270 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-805290e2-4f60-41fe-b380-d608948b5c25 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:52.129291 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-805290e2-4f60-41fe-b380-d608948b5c25 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:52.129730 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-805290e2-4f60-41fe-b380-d608948b5c25 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:52.130525 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-805290e2-4f60-41fe-b380-d608948b5c25 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:52.130961 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-805290e2-4f60-41fe-b380-d608948b5c25 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:52.131544 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9fcfc868-0c84-42b5-a02f-f13894028205 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047951 Feb 21 01:12:52.133656 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 239/504] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:52 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:12:52.279561 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-805290e2-4f60-41fe-b380-d608948b5c25 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:52.288545 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-805290e2-4f60-41fe-b380-d608948b5c25 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:52.292998 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-805290e2-4f60-41fe-b380-d608948b5c25 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:52.292998 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-805290e2-4f60-41fe-b380-d608948b5c25 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1725 microversion: 2.20 time: 0.175386 Feb 21 01:12:52.292998 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 266/505] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:52 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:12:52.309346 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fc9acd03-8fa5-433f-97b6-9ea0fd0e55c9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "088448d8-321e-47c3-9151-35cd7666ce14"}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:12:52.310443 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fc9acd03-8fa5-433f-97b6-9ea0fd0e55c9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:52.317143 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fc9acd03-8fa5-433f-97b6-9ea0fd0e55c9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:52.317581 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fc9acd03-8fa5-433f-97b6-9ea0fd0e55c9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:52.318621 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fc9acd03-8fa5-433f-97b6-9ea0fd0e55c9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:52.318994 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fc9acd03-8fa5-433f-97b6-9ea0fd0e55c9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:53.143040 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-52a34d2f-d64c-43e5-aaf7-e6976efb2a54 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:53.143923 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-52a34d2f-d64c-43e5-aaf7-e6976efb2a54 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:53.150490 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-52a34d2f-d64c-43e5-aaf7-e6976efb2a54 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:53.151024 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-52a34d2f-d64c-43e5-aaf7-e6976efb2a54 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:53.151929 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-52a34d2f-d64c-43e5-aaf7-e6976efb2a54 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:53.152390 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-52a34d2f-d64c-43e5-aaf7-e6976efb2a54 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:53.184260 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-52a34d2f-d64c-43e5-aaf7-e6976efb2a54 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045389 Feb 21 01:12:53.184848 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 267/506] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:53 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:53.480736 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fc9acd03-8fa5-433f-97b6-9ea0fd0e55c9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "POST /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.175230 Feb 21 01:12:53.481560 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 240/507] 10.222.0.91 () {62 vars in 1363 bytes} [Mon Feb 21 01:12:52 2022] POST /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 188 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:12:53.598240 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-82f8a12f-a076-40f6-b0d6-468f90e4473d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:12:53.598816 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-82f8a12f-a076-40f6-b0d6-468f90e4473d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:53.605149 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-82f8a12f-a076-40f6-b0d6-468f90e4473d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:53.605600 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-82f8a12f-a076-40f6-b0d6-468f90e4473d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:53.606398 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-82f8a12f-a076-40f6-b0d6-468f90e4473d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:53.606831 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-82f8a12f-a076-40f6-b0d6-468f90e4473d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:53.860681 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-82f8a12f-a076-40f6-b0d6-468f90e4473d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "POST /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/action" status: 202 len: 0 microversion: 2.20 time: 0.267153 Feb 21 01:12:53.861489 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 268/508] 10.222.0.91 () {62 vars in 1318 bytes} [Mon Feb 21 01:12:53 2022] POST /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:12:53.870310 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-affddade-26f6-4dfc-aed1-fe0d547012ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:53.870926 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-affddade-26f6-4dfc-aed1-fe0d547012ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:53.877614 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-affddade-26f6-4dfc-aed1-fe0d547012ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:53.878841 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-affddade-26f6-4dfc-aed1-fe0d547012ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:53.880041 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-affddade-26f6-4dfc-aed1-fe0d547012ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:53.880567 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-affddade-26f6-4dfc-aed1-fe0d547012ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:54.027276 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-affddade-26f6-4dfc-aed1-fe0d547012ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:54.036184 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-affddade-26f6-4dfc-aed1-fe0d547012ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:54.038022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-affddade-26f6-4dfc-aed1-fe0d547012ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:54.039409 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-affddade-26f6-4dfc-aed1-fe0d547012ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1751 microversion: 2.20 time: 0.172858 Feb 21 01:12:54.040339 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 241/509] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:53 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:54.197081 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2461cdcb-c65c-40c2-8f01-ed2a33996a55 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:54.198111 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2461cdcb-c65c-40c2-8f01-ed2a33996a55 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:54.204038 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2461cdcb-c65c-40c2-8f01-ed2a33996a55 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:54.204499 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2461cdcb-c65c-40c2-8f01-ed2a33996a55 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:54.205296 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2461cdcb-c65c-40c2-8f01-ed2a33996a55 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:54.205730 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2461cdcb-c65c-40c2-8f01-ed2a33996a55 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:54.239428 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2461cdcb-c65c-40c2-8f01-ed2a33996a55 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045560 Feb 21 01:12:54.240058 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 269/510] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:54 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:55.065716 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-15e3c82f-c089-4537-8d38-b3182a1d77f9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:55.066551 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-15e3c82f-c089-4537-8d38-b3182a1d77f9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:55.073059 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-15e3c82f-c089-4537-8d38-b3182a1d77f9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:55.073505 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-15e3c82f-c089-4537-8d38-b3182a1d77f9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:55.074300 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-15e3c82f-c089-4537-8d38-b3182a1d77f9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:55.074732 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-15e3c82f-c089-4537-8d38-b3182a1d77f9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:55.236585 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-15e3c82f-c089-4537-8d38-b3182a1d77f9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:55.245215 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-15e3c82f-c089-4537-8d38-b3182a1d77f9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:55.246714 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-15e3c82f-c089-4537-8d38-b3182a1d77f9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:55.247896 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-15e3c82f-c089-4537-8d38-b3182a1d77f9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1751 microversion: 2.20 time: 0.191283 Feb 21 01:12:55.250845 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4fa96cd0-759f-4213-bf4f-ff9b7aef4aef tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:55.251760 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4fa96cd0-759f-4213-bf4f-ff9b7aef4aef tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:55.258942 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4fa96cd0-759f-4213-bf4f-ff9b7aef4aef tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:55.259393 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4fa96cd0-759f-4213-bf4f-ff9b7aef4aef tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:55.259717 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 242/511] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:55 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1751 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:55.260325 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4fa96cd0-759f-4213-bf4f-ff9b7aef4aef tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:55.260760 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4fa96cd0-759f-4213-bf4f-ff9b7aef4aef tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:55.292740 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4fa96cd0-759f-4213-bf4f-ff9b7aef4aef tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045734 Feb 21 01:12:55.293331 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 270/512] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:55 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:12:56.266882 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9ddcda21-4c86-4746-b71d-691a38d8531a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:56.267484 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9ddcda21-4c86-4746-b71d-691a38d8531a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:56.274386 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9ddcda21-4c86-4746-b71d-691a38d8531a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:56.274836 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9ddcda21-4c86-4746-b71d-691a38d8531a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:56.275621 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9ddcda21-4c86-4746-b71d-691a38d8531a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:56.276101 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9ddcda21-4c86-4746-b71d-691a38d8531a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:56.303932 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-eaee2b5a-b38e-4c24-8514-f00e460c9967 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:56.304913 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-eaee2b5a-b38e-4c24-8514-f00e460c9967 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:56.311440 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eaee2b5a-b38e-4c24-8514-f00e460c9967 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:56.311956 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eaee2b5a-b38e-4c24-8514-f00e460c9967 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:56.312776 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eaee2b5a-b38e-4c24-8514-f00e460c9967 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:56.313222 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eaee2b5a-b38e-4c24-8514-f00e460c9967 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:56.346347 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-eaee2b5a-b38e-4c24-8514-f00e460c9967 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046202 Feb 21 01:12:56.346975 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 271/513] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:56 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:56.425266 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9ddcda21-4c86-4746-b71d-691a38d8531a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:56.434398 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9ddcda21-4c86-4746-b71d-691a38d8531a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:56.435937 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9ddcda21-4c86-4746-b71d-691a38d8531a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:56.437054 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9ddcda21-4c86-4746-b71d-691a38d8531a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.173930 Feb 21 01:12:56.437606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 243/514] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:56 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:57.358923 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-31588e34-874b-484f-bfcf-382b1bd0b584 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:57.359472 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-31588e34-874b-484f-bfcf-382b1bd0b584 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:57.367493 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-31588e34-874b-484f-bfcf-382b1bd0b584 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:57.367987 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-31588e34-874b-484f-bfcf-382b1bd0b584 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:57.369242 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-31588e34-874b-484f-bfcf-382b1bd0b584 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:57.369823 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-31588e34-874b-484f-bfcf-382b1bd0b584 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:57.399781 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-31588e34-874b-484f-bfcf-382b1bd0b584 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045048 Feb 21 01:12:57.400371 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 272/515] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:57 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:57.456105 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0d75e6c3-b58f-4027-b4ac-fc1f2a964d2e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:57.456711 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0d75e6c3-b58f-4027-b4ac-fc1f2a964d2e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:57.463980 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0d75e6c3-b58f-4027-b4ac-fc1f2a964d2e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:57.464461 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0d75e6c3-b58f-4027-b4ac-fc1f2a964d2e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:57.465255 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0d75e6c3-b58f-4027-b4ac-fc1f2a964d2e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:57.465696 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0d75e6c3-b58f-4027-b4ac-fc1f2a964d2e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:57.617368 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0d75e6c3-b58f-4027-b4ac-fc1f2a964d2e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:57.626006 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0d75e6c3-b58f-4027-b4ac-fc1f2a964d2e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:57.627535 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0d75e6c3-b58f-4027-b4ac-fc1f2a964d2e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:57.628742 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0d75e6c3-b58f-4027-b4ac-fc1f2a964d2e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.176393 Feb 21 01:12:57.629311 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 244/516] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:57 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:58.411375 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6056ef68-8e3b-4134-8926-94ecf684e398 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:58.412351 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6056ef68-8e3b-4134-8926-94ecf684e398 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:58.418801 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6056ef68-8e3b-4134-8926-94ecf684e398 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:58.419237 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6056ef68-8e3b-4134-8926-94ecf684e398 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:58.420065 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6056ef68-8e3b-4134-8926-94ecf684e398 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:58.420492 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6056ef68-8e3b-4134-8926-94ecf684e398 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:58.450454 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6056ef68-8e3b-4134-8926-94ecf684e398 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043568 Feb 21 01:12:58.451026 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 273/517] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:58 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:58.647461 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-17044f86-114a-4a4d-8012-d9bdc83bcba7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:58.648049 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-17044f86-114a-4a4d-8012-d9bdc83bcba7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:58.654305 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-17044f86-114a-4a4d-8012-d9bdc83bcba7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:58.654747 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-17044f86-114a-4a4d-8012-d9bdc83bcba7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:58.655527 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-17044f86-114a-4a4d-8012-d9bdc83bcba7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:58.655989 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-17044f86-114a-4a4d-8012-d9bdc83bcba7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:58.812443 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-17044f86-114a-4a4d-8012-d9bdc83bcba7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:58.821430 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-17044f86-114a-4a4d-8012-d9bdc83bcba7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:58.822937 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-17044f86-114a-4a4d-8012-d9bdc83bcba7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:12:58.824126 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-17044f86-114a-4a4d-8012-d9bdc83bcba7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.180957 Feb 21 01:12:58.824684 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 245/518] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:58 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:12:59.464279 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5f450971-4887-4334-8aee-1ee286b9a866 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:59.465340 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5f450971-4887-4334-8aee-1ee286b9a866 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:59.472176 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5f450971-4887-4334-8aee-1ee286b9a866 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:59.472627 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5f450971-4887-4334-8aee-1ee286b9a866 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:59.474730 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5f450971-4887-4334-8aee-1ee286b9a866 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:59.475177 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5f450971-4887-4334-8aee-1ee286b9a866 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:59.506413 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5f450971-4887-4334-8aee-1ee286b9a866 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046763 Feb 21 01:12:59.506999 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 274/519] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:12:59 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:12:59.842331 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-decf2440-3b6f-4f71-b3d1-85d3342510ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:12:59.842934 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-decf2440-3b6f-4f71-b3d1-85d3342510ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:12:59.849334 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-decf2440-3b6f-4f71-b3d1-85d3342510ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:59.849780 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-decf2440-3b6f-4f71-b3d1-85d3342510ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:59.850556 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-decf2440-3b6f-4f71-b3d1-85d3342510ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:12:59.850985 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-decf2440-3b6f-4f71-b3d1-85d3342510ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:12:59.993440 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-decf2440-3b6f-4f71-b3d1-85d3342510ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:00.002156 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-decf2440-3b6f-4f71-b3d1-85d3342510ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:00.003739 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-decf2440-3b6f-4f71-b3d1-85d3342510ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:00.005934 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-decf2440-3b6f-4f71-b3d1-85d3342510ae tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.167336 Feb 21 01:13:00.006660 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 246/520] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:12:59 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:00.518248 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-201e8aef-1d75-4fb8-b2fe-f77dcaa2bd8a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:00.519205 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-201e8aef-1d75-4fb8-b2fe-f77dcaa2bd8a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:00.526381 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-201e8aef-1d75-4fb8-b2fe-f77dcaa2bd8a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:00.526826 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-201e8aef-1d75-4fb8-b2fe-f77dcaa2bd8a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:00.527626 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-201e8aef-1d75-4fb8-b2fe-f77dcaa2bd8a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:00.528105 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-201e8aef-1d75-4fb8-b2fe-f77dcaa2bd8a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:00.561571 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-201e8aef-1d75-4fb8-b2fe-f77dcaa2bd8a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047097 Feb 21 01:13:00.562146 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 275/521] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:00 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:01.024888 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1fd1c276-2daa-4831-9338-e937d64f9c09 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:01.025522 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1fd1c276-2daa-4831-9338-e937d64f9c09 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:01.032103 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1fd1c276-2daa-4831-9338-e937d64f9c09 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:01.032550 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1fd1c276-2daa-4831-9338-e937d64f9c09 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:01.033606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1fd1c276-2daa-4831-9338-e937d64f9c09 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:01.034040 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1fd1c276-2daa-4831-9338-e937d64f9c09 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:01.180977 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1fd1c276-2daa-4831-9338-e937d64f9c09 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:01.189289 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1fd1c276-2daa-4831-9338-e937d64f9c09 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:01.191005 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1fd1c276-2daa-4831-9338-e937d64f9c09 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:01.192672 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1fd1c276-2daa-4831-9338-e937d64f9c09 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.172521 Feb 21 01:13:01.193223 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 247/522] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:01 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:01.576384 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9b5ace9c-8322-47cb-bb60-70f0d7e564e0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:01.578072 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9b5ace9c-8322-47cb-bb60-70f0d7e564e0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:01.588540 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9b5ace9c-8322-47cb-bb60-70f0d7e564e0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:01.588975 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9b5ace9c-8322-47cb-bb60-70f0d7e564e0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:01.589765 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9b5ace9c-8322-47cb-bb60-70f0d7e564e0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:01.590200 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9b5ace9c-8322-47cb-bb60-70f0d7e564e0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:01.621688 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9b5ace9c-8322-47cb-bb60-70f0d7e564e0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051533 Feb 21 01:13:01.622277 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 276/523] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:01 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:02.220220 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1bc48d3f-e072-45f4-95f8-4f390f711978 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:02.220830 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1bc48d3f-e072-45f4-95f8-4f390f711978 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:02.227412 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1bc48d3f-e072-45f4-95f8-4f390f711978 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:02.227892 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1bc48d3f-e072-45f4-95f8-4f390f711978 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:02.228717 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1bc48d3f-e072-45f4-95f8-4f390f711978 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:02.229152 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1bc48d3f-e072-45f4-95f8-4f390f711978 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:02.369882 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1bc48d3f-e072-45f4-95f8-4f390f711978 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:02.378108 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1bc48d3f-e072-45f4-95f8-4f390f711978 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:02.380534 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1bc48d3f-e072-45f4-95f8-4f390f711978 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:02.381752 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1bc48d3f-e072-45f4-95f8-4f390f711978 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.165249 Feb 21 01:13:02.382329 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 248/524] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:02 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:02.633152 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-718e6fac-3abb-4339-9a72-22ea7e2ac615 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:02.634057 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-718e6fac-3abb-4339-9a72-22ea7e2ac615 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:02.641682 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-718e6fac-3abb-4339-9a72-22ea7e2ac615 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:02.642373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-718e6fac-3abb-4339-9a72-22ea7e2ac615 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:02.643300 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-718e6fac-3abb-4339-9a72-22ea7e2ac615 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:02.643735 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-718e6fac-3abb-4339-9a72-22ea7e2ac615 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:02.675555 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-718e6fac-3abb-4339-9a72-22ea7e2ac615 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046669 Feb 21 01:13:02.676797 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 277/525] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:02 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:03.399951 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a3b26632-4cb4-466f-900a-e06752e7b988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:03.400567 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a3b26632-4cb4-466f-900a-e06752e7b988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:03.407072 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a3b26632-4cb4-466f-900a-e06752e7b988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:03.407518 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a3b26632-4cb4-466f-900a-e06752e7b988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:03.408599 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a3b26632-4cb4-466f-900a-e06752e7b988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:03.409122 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a3b26632-4cb4-466f-900a-e06752e7b988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:03.550334 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a3b26632-4cb4-466f-900a-e06752e7b988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:03.559537 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a3b26632-4cb4-466f-900a-e06752e7b988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:03.561105 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a3b26632-4cb4-466f-900a-e06752e7b988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:03.562257 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a3b26632-4cb4-466f-900a-e06752e7b988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.166259 Feb 21 01:13:03.562831 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 249/526] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:03 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:03.687700 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9cfc68b6-63ff-4d8e-b33a-755d77c54efb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:03.688699 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9cfc68b6-63ff-4d8e-b33a-755d77c54efb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:03.705926 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9cfc68b6-63ff-4d8e-b33a-755d77c54efb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:03.706363 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9cfc68b6-63ff-4d8e-b33a-755d77c54efb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:03.707162 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9cfc68b6-63ff-4d8e-b33a-755d77c54efb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:03.707589 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9cfc68b6-63ff-4d8e-b33a-755d77c54efb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:03.740616 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9cfc68b6-63ff-4d8e-b33a-755d77c54efb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056162 Feb 21 01:13:03.741236 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 278/527] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:03 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:04.580141 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-77588123-3918-451d-bbf8-f13591db6efb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:04.580679 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-77588123-3918-451d-bbf8-f13591db6efb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:04.588016 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-77588123-3918-451d-bbf8-f13591db6efb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:04.588569 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-77588123-3918-451d-bbf8-f13591db6efb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:04.589254 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-77588123-3918-451d-bbf8-f13591db6efb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:04.589689 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-77588123-3918-451d-bbf8-f13591db6efb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:04.732554 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-77588123-3918-451d-bbf8-f13591db6efb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:04.741535 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-77588123-3918-451d-bbf8-f13591db6efb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:04.743210 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-77588123-3918-451d-bbf8-f13591db6efb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:04.744453 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-77588123-3918-451d-bbf8-f13591db6efb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.168118 Feb 21 01:13:04.745021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 250/528] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:04 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:04.752326 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-483d49d0-7d25-4e79-93c8-f053d941c440 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:04.753261 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-483d49d0-7d25-4e79-93c8-f053d941c440 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:04.760235 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-483d49d0-7d25-4e79-93c8-f053d941c440 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:04.760688 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-483d49d0-7d25-4e79-93c8-f053d941c440 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:04.761487 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-483d49d0-7d25-4e79-93c8-f053d941c440 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:04.761926 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-483d49d0-7d25-4e79-93c8-f053d941c440 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:04.794238 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-483d49d0-7d25-4e79-93c8-f053d941c440 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045659 Feb 21 01:13:04.794804 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 279/529] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:04 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:13:05.762623 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-bfd422c6-b50a-4442-8ac4-b49627ceb41c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:05.763238 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-bfd422c6-b50a-4442-8ac4-b49627ceb41c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:05.769708 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bfd422c6-b50a-4442-8ac4-b49627ceb41c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:05.770321 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bfd422c6-b50a-4442-8ac4-b49627ceb41c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:05.772042 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bfd422c6-b50a-4442-8ac4-b49627ceb41c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:05.772487 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bfd422c6-b50a-4442-8ac4-b49627ceb41c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:05.805793 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3889f5d8-7ed0-4755-bb63-865a174d474d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:05.806703 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3889f5d8-7ed0-4755-bb63-865a174d474d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:05.813300 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3889f5d8-7ed0-4755-bb63-865a174d474d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:05.813738 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3889f5d8-7ed0-4755-bb63-865a174d474d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:05.814526 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3889f5d8-7ed0-4755-bb63-865a174d474d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:05.814951 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3889f5d8-7ed0-4755-bb63-865a174d474d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:05.849187 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3889f5d8-7ed0-4755-bb63-865a174d474d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046165 Feb 21 01:13:05.856021 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 280/530] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:05 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:13:05.920541 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bfd422c6-b50a-4442-8ac4-b49627ceb41c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:05.933671 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bfd422c6-b50a-4442-8ac4-b49627ceb41c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:05.935195 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bfd422c6-b50a-4442-8ac4-b49627ceb41c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:05.938290 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-bfd422c6-b50a-4442-8ac4-b49627ceb41c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.179486 Feb 21 01:13:05.938871 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 251/531] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:05 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:13:06.860710 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2086fa3b-e02c-4ee5-853b-53afa7c5112d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:06.861670 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2086fa3b-e02c-4ee5-853b-53afa7c5112d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:06.868375 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2086fa3b-e02c-4ee5-853b-53afa7c5112d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:06.868818 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2086fa3b-e02c-4ee5-853b-53afa7c5112d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:06.869657 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2086fa3b-e02c-4ee5-853b-53afa7c5112d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:06.870098 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2086fa3b-e02c-4ee5-853b-53afa7c5112d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:06.901888 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2086fa3b-e02c-4ee5-853b-53afa7c5112d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044955 Feb 21 01:13:06.902472 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 281/532] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:06 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:06.958345 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-00143e97-e885-4cf7-aaf3-a1c52cc09c34 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:06.959171 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-00143e97-e885-4cf7-aaf3-a1c52cc09c34 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:06.966069 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-00143e97-e885-4cf7-aaf3-a1c52cc09c34 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:06.966515 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-00143e97-e885-4cf7-aaf3-a1c52cc09c34 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:06.967319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-00143e97-e885-4cf7-aaf3-a1c52cc09c34 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:06.967748 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-00143e97-e885-4cf7-aaf3-a1c52cc09c34 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:07.114021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-00143e97-e885-4cf7-aaf3-a1c52cc09c34 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:07.122346 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-00143e97-e885-4cf7-aaf3-a1c52cc09c34 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:07.123964 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-00143e97-e885-4cf7-aaf3-a1c52cc09c34 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:07.125151 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-00143e97-e885-4cf7-aaf3-a1c52cc09c34 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.171358 Feb 21 01:13:07.126239 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 252/533] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:06 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:07.914516 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d25ff2b5-baa3-4a96-80f3-9a0c3aad91e9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:07.915449 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d25ff2b5-baa3-4a96-80f3-9a0c3aad91e9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:07.922323 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d25ff2b5-baa3-4a96-80f3-9a0c3aad91e9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:07.922770 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d25ff2b5-baa3-4a96-80f3-9a0c3aad91e9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:07.923571 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d25ff2b5-baa3-4a96-80f3-9a0c3aad91e9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:07.924120 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d25ff2b5-baa3-4a96-80f3-9a0c3aad91e9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:07.956344 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d25ff2b5-baa3-4a96-80f3-9a0c3aad91e9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046354 Feb 21 01:13:07.956908 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 282/534] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:07 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:08.147022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ef6bf76a-7ddd-491e-93b3-5798ef4048ac tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:08.148051 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ef6bf76a-7ddd-491e-93b3-5798ef4048ac tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:08.154321 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ef6bf76a-7ddd-491e-93b3-5798ef4048ac tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:08.154844 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ef6bf76a-7ddd-491e-93b3-5798ef4048ac tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:08.155569 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ef6bf76a-7ddd-491e-93b3-5798ef4048ac tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:08.156035 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ef6bf76a-7ddd-491e-93b3-5798ef4048ac tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:08.295368 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ef6bf76a-7ddd-491e-93b3-5798ef4048ac tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:08.304916 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ef6bf76a-7ddd-491e-93b3-5798ef4048ac tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:08.306408 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ef6bf76a-7ddd-491e-93b3-5798ef4048ac tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:08.307566 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ef6bf76a-7ddd-491e-93b3-5798ef4048ac tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.165234 Feb 21 01:13:08.308161 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 253/535] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:08 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:08.969007 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e87fe318-8345-46cd-93ad-25840dcc3423 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:08.969957 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e87fe318-8345-46cd-93ad-25840dcc3423 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:08.976958 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e87fe318-8345-46cd-93ad-25840dcc3423 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:08.977407 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e87fe318-8345-46cd-93ad-25840dcc3423 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:08.978198 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e87fe318-8345-46cd-93ad-25840dcc3423 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:08.978632 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e87fe318-8345-46cd-93ad-25840dcc3423 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:09.009758 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e87fe318-8345-46cd-93ad-25840dcc3423 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044511 Feb 21 01:13:09.010332 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 283/536] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:08 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:09.327014 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-70ad6160-fabd-4e3a-bc24-b69901f83036 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:09.327705 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-70ad6160-fabd-4e3a-bc24-b69901f83036 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:09.335202 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-70ad6160-fabd-4e3a-bc24-b69901f83036 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:09.335652 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-70ad6160-fabd-4e3a-bc24-b69901f83036 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:09.336516 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-70ad6160-fabd-4e3a-bc24-b69901f83036 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:09.337004 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-70ad6160-fabd-4e3a-bc24-b69901f83036 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:09.513517 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-70ad6160-fabd-4e3a-bc24-b69901f83036 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:09.522697 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-70ad6160-fabd-4e3a-bc24-b69901f83036 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:09.524238 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-70ad6160-fabd-4e3a-bc24-b69901f83036 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:09.525421 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-70ad6160-fabd-4e3a-bc24-b69901f83036 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.202555 Feb 21 01:13:09.525985 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 254/537] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:09 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:13:10.021875 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-90a9d49b-da4a-4a1d-9be4-7b608729a6ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:10.023179 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-90a9d49b-da4a-4a1d-9be4-7b608729a6ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:10.029625 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-90a9d49b-da4a-4a1d-9be4-7b608729a6ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:10.030071 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-90a9d49b-da4a-4a1d-9be4-7b608729a6ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:10.030860 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-90a9d49b-da4a-4a1d-9be4-7b608729a6ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:10.031295 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-90a9d49b-da4a-4a1d-9be4-7b608729a6ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:10.060660 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-90a9d49b-da4a-4a1d-9be4-7b608729a6ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043275 Feb 21 01:13:10.061221 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 284/538] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:10 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:10.544449 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cb0da6ed-18e0-46f8-a129-4e8d4b294693 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:10.544989 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cb0da6ed-18e0-46f8-a129-4e8d4b294693 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:10.551196 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cb0da6ed-18e0-46f8-a129-4e8d4b294693 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:10.551708 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cb0da6ed-18e0-46f8-a129-4e8d4b294693 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:10.552543 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cb0da6ed-18e0-46f8-a129-4e8d4b294693 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:10.552971 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cb0da6ed-18e0-46f8-a129-4e8d4b294693 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:10.686669 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cb0da6ed-18e0-46f8-a129-4e8d4b294693 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:10.695766 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cb0da6ed-18e0-46f8-a129-4e8d4b294693 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:10.697342 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cb0da6ed-18e0-46f8-a129-4e8d4b294693 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:10.698548 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cb0da6ed-18e0-46f8-a129-4e8d4b294693 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157829 Feb 21 01:13:10.699133 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 255/539] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:10 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:11.072167 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ffb25e82-a8f4-4f9d-af72-8f47437be2d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:11.073133 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ffb25e82-a8f4-4f9d-af72-8f47437be2d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:11.079246 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ffb25e82-a8f4-4f9d-af72-8f47437be2d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:11.079684 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ffb25e82-a8f4-4f9d-af72-8f47437be2d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:11.080506 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ffb25e82-a8f4-4f9d-af72-8f47437be2d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:11.080933 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ffb25e82-a8f4-4f9d-af72-8f47437be2d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:11.111929 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ffb25e82-a8f4-4f9d-af72-8f47437be2d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044395 Feb 21 01:13:11.112417 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 285/540] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:11 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:11.717851 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fe7f6273-00f7-463d-94c9-d3d6f100128b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:11.718483 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fe7f6273-00f7-463d-94c9-d3d6f100128b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:11.726066 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe7f6273-00f7-463d-94c9-d3d6f100128b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:11.726609 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe7f6273-00f7-463d-94c9-d3d6f100128b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:11.727462 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe7f6273-00f7-463d-94c9-d3d6f100128b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:11.727924 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe7f6273-00f7-463d-94c9-d3d6f100128b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:11.970024 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fe7f6273-00f7-463d-94c9-d3d6f100128b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:11.978874 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fe7f6273-00f7-463d-94c9-d3d6f100128b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:11.980527 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fe7f6273-00f7-463d-94c9-d3d6f100128b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:11.981601 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fe7f6273-00f7-463d-94c9-d3d6f100128b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.267544 Feb 21 01:13:11.982363 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 256/541] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:11 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:12.123637 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2c5d6841-cff8-4c38-bbe7-08761de071fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:12.124586 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2c5d6841-cff8-4c38-bbe7-08761de071fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:12.130964 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2c5d6841-cff8-4c38-bbe7-08761de071fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:12.131415 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2c5d6841-cff8-4c38-bbe7-08761de071fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:12.132387 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2c5d6841-cff8-4c38-bbe7-08761de071fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:12.132828 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2c5d6841-cff8-4c38-bbe7-08761de071fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:12.162345 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2c5d6841-cff8-4c38-bbe7-08761de071fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042399 Feb 21 01:13:12.162899 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 286/542] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:12 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:13.001881 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-480659b4-f314-4a4b-9c67-0154cf7c0c4a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:13.002476 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-480659b4-f314-4a4b-9c67-0154cf7c0c4a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:13.010440 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-480659b4-f314-4a4b-9c67-0154cf7c0c4a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:13.010888 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-480659b4-f314-4a4b-9c67-0154cf7c0c4a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:13.011653 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-480659b4-f314-4a4b-9c67-0154cf7c0c4a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:13.012109 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-480659b4-f314-4a4b-9c67-0154cf7c0c4a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:13.147643 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-480659b4-f314-4a4b-9c67-0154cf7c0c4a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:13.155794 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-480659b4-f314-4a4b-9c67-0154cf7c0c4a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:13.157322 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-480659b4-f314-4a4b-9c67-0154cf7c0c4a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:13.158740 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-480659b4-f314-4a4b-9c67-0154cf7c0c4a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.162032 Feb 21 01:13:13.159303 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 257/543] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:12 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:13:13.173036 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ed8a3dbb-9741-4551-9928-743862932111 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:13.173959 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ed8a3dbb-9741-4551-9928-743862932111 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:13.180285 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ed8a3dbb-9741-4551-9928-743862932111 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:13.180736 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ed8a3dbb-9741-4551-9928-743862932111 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:13.181523 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ed8a3dbb-9741-4551-9928-743862932111 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:13.181961 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ed8a3dbb-9741-4551-9928-743862932111 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:13.211531 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ed8a3dbb-9741-4551-9928-743862932111 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042236 Feb 21 01:13:13.212131 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 287/544] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:13 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:14.177594 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fa5b2e66-ea9c-44c7-b10e-d6055f27a830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:14.178204 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fa5b2e66-ea9c-44c7-b10e-d6055f27a830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:14.184626 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fa5b2e66-ea9c-44c7-b10e-d6055f27a830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:14.185017 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fa5b2e66-ea9c-44c7-b10e-d6055f27a830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:14.185796 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fa5b2e66-ea9c-44c7-b10e-d6055f27a830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:14.186230 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fa5b2e66-ea9c-44c7-b10e-d6055f27a830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:14.223072 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3fd5d317-a02d-4882-84fe-84011a6e8158 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:14.224592 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3fd5d317-a02d-4882-84fe-84011a6e8158 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:14.230931 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3fd5d317-a02d-4882-84fe-84011a6e8158 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:14.231380 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3fd5d317-a02d-4882-84fe-84011a6e8158 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:14.232214 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3fd5d317-a02d-4882-84fe-84011a6e8158 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:14.232653 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3fd5d317-a02d-4882-84fe-84011a6e8158 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:14.264614 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3fd5d317-a02d-4882-84fe-84011a6e8158 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045246 Feb 21 01:13:14.265189 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 288/545] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:14 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:13:14.325466 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fa5b2e66-ea9c-44c7-b10e-d6055f27a830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:14.334537 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fa5b2e66-ea9c-44c7-b10e-d6055f27a830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:14.336089 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fa5b2e66-ea9c-44c7-b10e-d6055f27a830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:14.337244 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fa5b2e66-ea9c-44c7-b10e-d6055f27a830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.163783 Feb 21 01:13:14.337792 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 258/546] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:14 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:15.276835 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5a942aec-16c4-4ad3-a398-eabd4a64516e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:15.277756 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5a942aec-16c4-4ad3-a398-eabd4a64516e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:15.284326 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5a942aec-16c4-4ad3-a398-eabd4a64516e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:15.284775 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5a942aec-16c4-4ad3-a398-eabd4a64516e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:15.285560 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5a942aec-16c4-4ad3-a398-eabd4a64516e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:15.286674 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5a942aec-16c4-4ad3-a398-eabd4a64516e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:15.316201 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5a942aec-16c4-4ad3-a398-eabd4a64516e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043090 Feb 21 01:13:15.316754 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 289/547] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:15 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:15.355231 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-207a52df-0efb-479c-87cb-597a5105b6f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:15.355932 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-207a52df-0efb-479c-87cb-597a5105b6f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:15.362409 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-207a52df-0efb-479c-87cb-597a5105b6f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:15.362868 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-207a52df-0efb-479c-87cb-597a5105b6f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:15.363650 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-207a52df-0efb-479c-87cb-597a5105b6f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:15.364226 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-207a52df-0efb-479c-87cb-597a5105b6f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:15.502144 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-207a52df-0efb-479c-87cb-597a5105b6f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:15.514058 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-207a52df-0efb-479c-87cb-597a5105b6f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:15.515790 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-207a52df-0efb-479c-87cb-597a5105b6f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:15.517019 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-207a52df-0efb-479c-87cb-597a5105b6f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.165617 Feb 21 01:13:15.517589 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 259/548] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:15 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:16.329394 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-27c4aae7-8f45-473f-8b60-9e5cffea8ec8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:16.330242 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-27c4aae7-8f45-473f-8b60-9e5cffea8ec8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:16.337778 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-27c4aae7-8f45-473f-8b60-9e5cffea8ec8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:16.338227 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-27c4aae7-8f45-473f-8b60-9e5cffea8ec8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:16.339024 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-27c4aae7-8f45-473f-8b60-9e5cffea8ec8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:16.339475 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-27c4aae7-8f45-473f-8b60-9e5cffea8ec8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:16.369466 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-27c4aae7-8f45-473f-8b60-9e5cffea8ec8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044990 Feb 21 01:13:16.370035 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 290/549] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:16 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:16.535485 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a1bf1d96-6d17-4ea1-828e-24237e981e79 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:16.536139 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a1bf1d96-6d17-4ea1-828e-24237e981e79 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:16.543820 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a1bf1d96-6d17-4ea1-828e-24237e981e79 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:16.544305 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a1bf1d96-6d17-4ea1-828e-24237e981e79 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:16.545207 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a1bf1d96-6d17-4ea1-828e-24237e981e79 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:16.545647 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a1bf1d96-6d17-4ea1-828e-24237e981e79 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:16.687508 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a1bf1d96-6d17-4ea1-828e-24237e981e79 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:16.696041 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a1bf1d96-6d17-4ea1-828e-24237e981e79 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:16.697510 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a1bf1d96-6d17-4ea1-828e-24237e981e79 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:16.698642 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a1bf1d96-6d17-4ea1-828e-24237e981e79 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.167254 Feb 21 01:13:16.699197 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 260/550] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:16 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:17.381940 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4992d439-6381-4da6-a638-9c9d88d8b21b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:17.382892 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4992d439-6381-4da6-a638-9c9d88d8b21b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:17.389231 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4992d439-6381-4da6-a638-9c9d88d8b21b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:17.389743 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4992d439-6381-4da6-a638-9c9d88d8b21b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:17.390465 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4992d439-6381-4da6-a638-9c9d88d8b21b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:17.390896 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4992d439-6381-4da6-a638-9c9d88d8b21b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:17.420333 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4992d439-6381-4da6-a638-9c9d88d8b21b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042964 Feb 21 01:13:17.420893 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 291/551] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:17 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:17.716883 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c01ae6ab-85fa-402a-bc1b-aae9ce889ef8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:17.717492 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c01ae6ab-85fa-402a-bc1b-aae9ce889ef8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:17.723428 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c01ae6ab-85fa-402a-bc1b-aae9ce889ef8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:17.723907 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c01ae6ab-85fa-402a-bc1b-aae9ce889ef8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:17.726780 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c01ae6ab-85fa-402a-bc1b-aae9ce889ef8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:17.727228 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c01ae6ab-85fa-402a-bc1b-aae9ce889ef8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:17.861973 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c01ae6ab-85fa-402a-bc1b-aae9ce889ef8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:17.870906 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c01ae6ab-85fa-402a-bc1b-aae9ce889ef8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:17.872512 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c01ae6ab-85fa-402a-bc1b-aae9ce889ef8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:17.873661 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c01ae6ab-85fa-402a-bc1b-aae9ce889ef8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160507 Feb 21 01:13:17.874257 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 261/552] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:17 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:18.432383 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f145d5ad-9172-49e5-b85f-1f56c3a9f981 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:18.433288 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f145d5ad-9172-49e5-b85f-1f56c3a9f981 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:18.439427 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f145d5ad-9172-49e5-b85f-1f56c3a9f981 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:18.439888 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f145d5ad-9172-49e5-b85f-1f56c3a9f981 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:18.440669 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f145d5ad-9172-49e5-b85f-1f56c3a9f981 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:18.441093 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f145d5ad-9172-49e5-b85f-1f56c3a9f981 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:18.470157 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f145d5ad-9172-49e5-b85f-1f56c3a9f981 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041456 Feb 21 01:13:18.470716 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 292/553] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:18 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:18.891565 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-56d70ed0-2bb1-464e-b726-98fe1be1a3dd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:18.892131 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-56d70ed0-2bb1-464e-b726-98fe1be1a3dd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:18.899060 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-56d70ed0-2bb1-464e-b726-98fe1be1a3dd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:18.899494 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-56d70ed0-2bb1-464e-b726-98fe1be1a3dd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:18.900288 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-56d70ed0-2bb1-464e-b726-98fe1be1a3dd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:18.900717 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-56d70ed0-2bb1-464e-b726-98fe1be1a3dd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:19.044669 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-56d70ed0-2bb1-464e-b726-98fe1be1a3dd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:19.053558 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-56d70ed0-2bb1-464e-b726-98fe1be1a3dd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:19.055036 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-56d70ed0-2bb1-464e-b726-98fe1be1a3dd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:19.056230 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-56d70ed0-2bb1-464e-b726-98fe1be1a3dd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.168371 Feb 21 01:13:19.065790 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 262/554] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:18 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:19.481862 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9238c52c-4ae3-48b8-acf4-e85a980fa197 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:19.482786 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9238c52c-4ae3-48b8-acf4-e85a980fa197 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:19.489119 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9238c52c-4ae3-48b8-acf4-e85a980fa197 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:19.489551 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9238c52c-4ae3-48b8-acf4-e85a980fa197 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:19.491012 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9238c52c-4ae3-48b8-acf4-e85a980fa197 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:19.491483 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9238c52c-4ae3-48b8-acf4-e85a980fa197 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:19.521711 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9238c52c-4ae3-48b8-acf4-e85a980fa197 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043599 Feb 21 01:13:19.522319 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 293/555] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:19 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:20.074597 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5962b5be-6f5b-4bf9-8802-8044abefb1b9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:20.075258 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5962b5be-6f5b-4bf9-8802-8044abefb1b9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:20.081647 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5962b5be-6f5b-4bf9-8802-8044abefb1b9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:20.082257 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5962b5be-6f5b-4bf9-8802-8044abefb1b9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:20.083048 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5962b5be-6f5b-4bf9-8802-8044abefb1b9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:20.083487 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5962b5be-6f5b-4bf9-8802-8044abefb1b9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:20.221820 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5962b5be-6f5b-4bf9-8802-8044abefb1b9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:20.230557 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5962b5be-6f5b-4bf9-8802-8044abefb1b9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:20.232076 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5962b5be-6f5b-4bf9-8802-8044abefb1b9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:20.233249 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5962b5be-6f5b-4bf9-8802-8044abefb1b9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.162485 Feb 21 01:13:20.233808 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 263/556] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:20 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:13:20.533511 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d403e1c4-f586-493d-8f37-acbe9f923535 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:20.534417 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d403e1c4-f586-493d-8f37-acbe9f923535 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:20.540760 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d403e1c4-f586-493d-8f37-acbe9f923535 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:20.541198 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d403e1c4-f586-493d-8f37-acbe9f923535 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:20.541967 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d403e1c4-f586-493d-8f37-acbe9f923535 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:20.542397 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d403e1c4-f586-493d-8f37-acbe9f923535 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:20.571905 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d403e1c4-f586-493d-8f37-acbe9f923535 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042351 Feb 21 01:13:20.572492 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 294/557] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:20 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:21.252046 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-54301d13-db45-4061-869c-40d493a6c7ab tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:21.252685 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-54301d13-db45-4061-869c-40d493a6c7ab tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:21.259199 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-54301d13-db45-4061-869c-40d493a6c7ab tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:21.259642 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-54301d13-db45-4061-869c-40d493a6c7ab tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:21.260456 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-54301d13-db45-4061-869c-40d493a6c7ab tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:21.260892 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-54301d13-db45-4061-869c-40d493a6c7ab tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:21.394432 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-54301d13-db45-4061-869c-40d493a6c7ab tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:21.403452 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-54301d13-db45-4061-869c-40d493a6c7ab tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:21.404995 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-54301d13-db45-4061-869c-40d493a6c7ab tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:21.406154 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-54301d13-db45-4061-869c-40d493a6c7ab tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158177 Feb 21 01:13:21.409372 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 264/558] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:21 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:21.583368 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-90b50eb4-9352-4a9e-be4c-2ccc5a8aaf76 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:21.584037 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-90b50eb4-9352-4a9e-be4c-2ccc5a8aaf76 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:21.590328 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-90b50eb4-9352-4a9e-be4c-2ccc5a8aaf76 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:21.590891 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-90b50eb4-9352-4a9e-be4c-2ccc5a8aaf76 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:21.591685 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-90b50eb4-9352-4a9e-be4c-2ccc5a8aaf76 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:21.592165 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-90b50eb4-9352-4a9e-be4c-2ccc5a8aaf76 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:21.621785 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-90b50eb4-9352-4a9e-be4c-2ccc5a8aaf76 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042716 Feb 21 01:13:21.622348 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 295/559] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:21 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:22.425947 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f6fb222d-e1ee-4198-8e6e-2af3d66a080d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:22.426503 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f6fb222d-e1ee-4198-8e6e-2af3d66a080d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:22.433381 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f6fb222d-e1ee-4198-8e6e-2af3d66a080d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:22.433830 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f6fb222d-e1ee-4198-8e6e-2af3d66a080d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:22.434605 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f6fb222d-e1ee-4198-8e6e-2af3d66a080d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:22.435040 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f6fb222d-e1ee-4198-8e6e-2af3d66a080d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:22.566790 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f6fb222d-e1ee-4198-8e6e-2af3d66a080d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:22.575066 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f6fb222d-e1ee-4198-8e6e-2af3d66a080d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:22.576595 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f6fb222d-e1ee-4198-8e6e-2af3d66a080d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:22.577737 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f6fb222d-e1ee-4198-8e6e-2af3d66a080d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155608 Feb 21 01:13:22.578292 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 265/560] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:22 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:22.633334 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-66a10cd3-4f11-4b02-9a9e-1a6ac3d56a2b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:22.634250 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-66a10cd3-4f11-4b02-9a9e-1a6ac3d56a2b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:22.640684 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-66a10cd3-4f11-4b02-9a9e-1a6ac3d56a2b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:22.641135 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-66a10cd3-4f11-4b02-9a9e-1a6ac3d56a2b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:22.641927 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-66a10cd3-4f11-4b02-9a9e-1a6ac3d56a2b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:22.642361 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-66a10cd3-4f11-4b02-9a9e-1a6ac3d56a2b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:22.672685 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-66a10cd3-4f11-4b02-9a9e-1a6ac3d56a2b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043238 Feb 21 01:13:22.673259 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 296/561] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:22 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:23.596199 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1579e1d3-006e-4f77-b580-dea74b9aa08a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:23.596834 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1579e1d3-006e-4f77-b580-dea74b9aa08a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:23.603537 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1579e1d3-006e-4f77-b580-dea74b9aa08a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:23.604038 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1579e1d3-006e-4f77-b580-dea74b9aa08a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:23.604792 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1579e1d3-006e-4f77-b580-dea74b9aa08a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:23.605225 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1579e1d3-006e-4f77-b580-dea74b9aa08a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:23.684899 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-84412b3f-0098-4370-bb79-a5e70640cd1b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:23.685941 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-84412b3f-0098-4370-bb79-a5e70640cd1b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:23.692345 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84412b3f-0098-4370-bb79-a5e70640cd1b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:23.692800 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84412b3f-0098-4370-bb79-a5e70640cd1b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:23.693809 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84412b3f-0098-4370-bb79-a5e70640cd1b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:23.694274 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84412b3f-0098-4370-bb79-a5e70640cd1b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:23.725884 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-84412b3f-0098-4370-bb79-a5e70640cd1b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044736 Feb 21 01:13:23.726454 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 297/562] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:23 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:13:23.737001 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1579e1d3-006e-4f77-b580-dea74b9aa08a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:23.746022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1579e1d3-006e-4f77-b580-dea74b9aa08a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:23.747498 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1579e1d3-006e-4f77-b580-dea74b9aa08a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:23.748660 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1579e1d3-006e-4f77-b580-dea74b9aa08a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156232 Feb 21 01:13:23.749200 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 266/563] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:23 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:24.737413 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-79b81b54-ce33-45db-98ce-8eff074bc0df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:24.738318 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-79b81b54-ce33-45db-98ce-8eff074bc0df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:24.745015 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-79b81b54-ce33-45db-98ce-8eff074bc0df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:24.745458 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-79b81b54-ce33-45db-98ce-8eff074bc0df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:24.746227 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-79b81b54-ce33-45db-98ce-8eff074bc0df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:24.746652 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-79b81b54-ce33-45db-98ce-8eff074bc0df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:24.766688 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-394ac9da-89d6-47ba-8b4a-f97f80d9b839 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:24.767295 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-394ac9da-89d6-47ba-8b4a-f97f80d9b839 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:24.774025 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-394ac9da-89d6-47ba-8b4a-f97f80d9b839 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:24.774475 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-394ac9da-89d6-47ba-8b4a-f97f80d9b839 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:24.775350 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-394ac9da-89d6-47ba-8b4a-f97f80d9b839 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:24.775565 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-79b81b54-ce33-45db-98ce-8eff074bc0df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041884 Feb 21 01:13:24.775764 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-394ac9da-89d6-47ba-8b4a-f97f80d9b839 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:24.776162 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 298/564] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:24 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:24.921669 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-394ac9da-89d6-47ba-8b4a-f97f80d9b839 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:24.923386 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-394ac9da-89d6-47ba-8b4a-f97f80d9b839 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:24.925643 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-394ac9da-89d6-47ba-8b4a-f97f80d9b839 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:24.926438 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-394ac9da-89d6-47ba-8b4a-f97f80d9b839 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.163357 Feb 21 01:13:24.927099 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 267/565] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:24 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:13:25.786891 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8b0134ea-1a7a-4b71-898a-971053f15f87 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:25.787917 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8b0134ea-1a7a-4b71-898a-971053f15f87 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:25.794393 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8b0134ea-1a7a-4b71-898a-971053f15f87 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:25.794840 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8b0134ea-1a7a-4b71-898a-971053f15f87 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:25.795621 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8b0134ea-1a7a-4b71-898a-971053f15f87 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:25.796086 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8b0134ea-1a7a-4b71-898a-971053f15f87 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:25.826166 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8b0134ea-1a7a-4b71-898a-971053f15f87 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043411 Feb 21 01:13:25.826717 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 299/566] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:25 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:25.945083 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c51184ab-238b-4b79-b493-c3ba2dde50b0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:25.945666 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c51184ab-238b-4b79-b493-c3ba2dde50b0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:25.952027 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c51184ab-238b-4b79-b493-c3ba2dde50b0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:25.952466 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c51184ab-238b-4b79-b493-c3ba2dde50b0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:25.953236 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c51184ab-238b-4b79-b493-c3ba2dde50b0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:25.953661 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c51184ab-238b-4b79-b493-c3ba2dde50b0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:26.095600 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c51184ab-238b-4b79-b493-c3ba2dde50b0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:26.104407 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c51184ab-238b-4b79-b493-c3ba2dde50b0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:26.105886 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c51184ab-238b-4b79-b493-c3ba2dde50b0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:26.107022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c51184ab-238b-4b79-b493-c3ba2dde50b0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.165610 Feb 21 01:13:26.107576 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 268/567] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:25 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:26.838428 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0f56e470-b0a9-4a9b-891b-00a5b576ea55 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:26.839339 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0f56e470-b0a9-4a9b-891b-00a5b576ea55 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:26.845755 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0f56e470-b0a9-4a9b-891b-00a5b576ea55 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:26.846199 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0f56e470-b0a9-4a9b-891b-00a5b576ea55 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:26.846980 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0f56e470-b0a9-4a9b-891b-00a5b576ea55 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:26.847410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0f56e470-b0a9-4a9b-891b-00a5b576ea55 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:26.875246 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0f56e470-b0a9-4a9b-891b-00a5b576ea55 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041239 Feb 21 01:13:26.875796 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 300/568] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:26 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:27.125658 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-45b7e5d9-148d-4ff0-b1d6-3c8ac8424b61 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:27.126187 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-45b7e5d9-148d-4ff0-b1d6-3c8ac8424b61 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:27.132966 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-45b7e5d9-148d-4ff0-b1d6-3c8ac8424b61 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:27.137266 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-45b7e5d9-148d-4ff0-b1d6-3c8ac8424b61 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:27.137266 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-45b7e5d9-148d-4ff0-b1d6-3c8ac8424b61 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:27.137266 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-45b7e5d9-148d-4ff0-b1d6-3c8ac8424b61 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:27.267127 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-45b7e5d9-148d-4ff0-b1d6-3c8ac8424b61 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:27.276342 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-45b7e5d9-148d-4ff0-b1d6-3c8ac8424b61 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:27.277874 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-45b7e5d9-148d-4ff0-b1d6-3c8ac8424b61 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:27.279037 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-45b7e5d9-148d-4ff0-b1d6-3c8ac8424b61 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157126 Feb 21 01:13:27.279601 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 269/569] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:27 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:27.887354 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ae68467d-f8da-4087-b628-318394c564eb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:27.888288 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ae68467d-f8da-4087-b628-318394c564eb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:27.894537 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ae68467d-f8da-4087-b628-318394c564eb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:27.894972 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ae68467d-f8da-4087-b628-318394c564eb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:27.895754 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ae68467d-f8da-4087-b628-318394c564eb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:27.896203 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ae68467d-f8da-4087-b628-318394c564eb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:27.924647 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ae68467d-f8da-4087-b628-318394c564eb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041136 Feb 21 01:13:27.925190 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 301/570] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:27 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:28.297298 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-42956355-6e68-4ed8-bafa-214c07115197 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:28.297946 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-42956355-6e68-4ed8-bafa-214c07115197 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:28.305296 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-42956355-6e68-4ed8-bafa-214c07115197 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:28.305641 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-42956355-6e68-4ed8-bafa-214c07115197 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:28.306437 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-42956355-6e68-4ed8-bafa-214c07115197 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:28.306869 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-42956355-6e68-4ed8-bafa-214c07115197 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:28.458843 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-42956355-6e68-4ed8-bafa-214c07115197 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:28.469084 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-42956355-6e68-4ed8-bafa-214c07115197 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:28.470575 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-42956355-6e68-4ed8-bafa-214c07115197 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:28.471797 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-42956355-6e68-4ed8-bafa-214c07115197 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.178106 Feb 21 01:13:28.472396 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 270/571] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:28 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:28.936460 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1e549a2a-8434-4338-a0d9-5f9c1cdd8498 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:28.937830 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1e549a2a-8434-4338-a0d9-5f9c1cdd8498 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:28.946020 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e549a2a-8434-4338-a0d9-5f9c1cdd8498 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:28.946705 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e549a2a-8434-4338-a0d9-5f9c1cdd8498 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:28.947511 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e549a2a-8434-4338-a0d9-5f9c1cdd8498 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:28.947985 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e549a2a-8434-4338-a0d9-5f9c1cdd8498 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:28.981339 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1e549a2a-8434-4338-a0d9-5f9c1cdd8498 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048460 Feb 21 01:13:28.982209 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 302/572] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:28 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:13:29.494797 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b8992708-55de-4da6-95ec-e330bee4df93 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:29.495348 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b8992708-55de-4da6-95ec-e330bee4df93 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:29.502890 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b8992708-55de-4da6-95ec-e330bee4df93 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:29.503354 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b8992708-55de-4da6-95ec-e330bee4df93 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:29.504206 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b8992708-55de-4da6-95ec-e330bee4df93 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:29.504649 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b8992708-55de-4da6-95ec-e330bee4df93 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:29.640093 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b8992708-55de-4da6-95ec-e330bee4df93 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:29.648769 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b8992708-55de-4da6-95ec-e330bee4df93 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:29.650281 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b8992708-55de-4da6-95ec-e330bee4df93 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:29.651409 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b8992708-55de-4da6-95ec-e330bee4df93 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.161804 Feb 21 01:13:29.651976 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 271/573] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:29 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:29.993554 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-df67e94e-fa6b-46ba-8732-dc9579027c7d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:29.994481 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-df67e94e-fa6b-46ba-8732-dc9579027c7d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:30.000858 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-df67e94e-fa6b-46ba-8732-dc9579027c7d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:30.001291 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-df67e94e-fa6b-46ba-8732-dc9579027c7d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:30.002080 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-df67e94e-fa6b-46ba-8732-dc9579027c7d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:30.002507 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-df67e94e-fa6b-46ba-8732-dc9579027c7d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:30.033280 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-df67e94e-fa6b-46ba-8732-dc9579027c7d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043689 Feb 21 01:13:30.033846 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 303/574] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:29 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:30.670979 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3ab7c1d6-59c4-49ff-a022-0dd459f30a81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:30.671551 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3ab7c1d6-59c4-49ff-a022-0dd459f30a81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:30.678667 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3ab7c1d6-59c4-49ff-a022-0dd459f30a81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:30.679204 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3ab7c1d6-59c4-49ff-a022-0dd459f30a81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:30.680177 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3ab7c1d6-59c4-49ff-a022-0dd459f30a81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:30.680618 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3ab7c1d6-59c4-49ff-a022-0dd459f30a81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:30.817549 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3ab7c1d6-59c4-49ff-a022-0dd459f30a81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:30.826700 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3ab7c1d6-59c4-49ff-a022-0dd459f30a81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:30.828257 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3ab7c1d6-59c4-49ff-a022-0dd459f30a81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:30.829420 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3ab7c1d6-59c4-49ff-a022-0dd459f30a81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.162632 Feb 21 01:13:30.829988 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 272/575] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:30 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:31.044835 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-db75d4a0-b9a6-44fa-8824-e49d0a5383b4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:31.045756 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-db75d4a0-b9a6-44fa-8824-e49d0a5383b4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:31.052246 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db75d4a0-b9a6-44fa-8824-e49d0a5383b4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:31.052694 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db75d4a0-b9a6-44fa-8824-e49d0a5383b4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:31.054114 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db75d4a0-b9a6-44fa-8824-e49d0a5383b4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:31.054601 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db75d4a0-b9a6-44fa-8824-e49d0a5383b4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:31.086130 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-db75d4a0-b9a6-44fa-8824-e49d0a5383b4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045148 Feb 21 01:13:31.086711 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 304/576] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:31 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:31.848490 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0eefa4dd-ff33-467e-83d1-49eb02b3d497 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:31.849122 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0eefa4dd-ff33-467e-83d1-49eb02b3d497 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:31.856075 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0eefa4dd-ff33-467e-83d1-49eb02b3d497 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:31.856529 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0eefa4dd-ff33-467e-83d1-49eb02b3d497 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:31.857309 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0eefa4dd-ff33-467e-83d1-49eb02b3d497 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:31.857743 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0eefa4dd-ff33-467e-83d1-49eb02b3d497 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:31.994050 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0eefa4dd-ff33-467e-83d1-49eb02b3d497 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:32.002852 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0eefa4dd-ff33-467e-83d1-49eb02b3d497 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:32.004387 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0eefa4dd-ff33-467e-83d1-49eb02b3d497 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:32.005542 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0eefa4dd-ff33-467e-83d1-49eb02b3d497 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160874 Feb 21 01:13:32.006518 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 273/577] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:31 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:32.097905 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-20f155ed-1fda-48c2-b49f-73986c12bf89 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:32.098848 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-20f155ed-1fda-48c2-b49f-73986c12bf89 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:32.106072 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-20f155ed-1fda-48c2-b49f-73986c12bf89 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:32.106531 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-20f155ed-1fda-48c2-b49f-73986c12bf89 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:32.107362 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-20f155ed-1fda-48c2-b49f-73986c12bf89 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:32.107822 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-20f155ed-1fda-48c2-b49f-73986c12bf89 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:32.139364 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-20f155ed-1fda-48c2-b49f-73986c12bf89 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045190 Feb 21 01:13:32.140057 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 305/578] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:32 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:13:33.024566 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-63660868-827f-4b0e-a944-a3239f6e909d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:33.025207 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-63660868-827f-4b0e-a944-a3239f6e909d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:33.031509 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-63660868-827f-4b0e-a944-a3239f6e909d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:33.031991 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-63660868-827f-4b0e-a944-a3239f6e909d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:33.033032 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-63660868-827f-4b0e-a944-a3239f6e909d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:33.033489 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-63660868-827f-4b0e-a944-a3239f6e909d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:33.151050 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-cf443c76-ae07-4d8e-9470-cbcd76276c21 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:33.152112 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-cf443c76-ae07-4d8e-9470-cbcd76276c21 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:33.158789 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cf443c76-ae07-4d8e-9470-cbcd76276c21 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:33.159146 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cf443c76-ae07-4d8e-9470-cbcd76276c21 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:33.160004 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cf443c76-ae07-4d8e-9470-cbcd76276c21 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:33.160446 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cf443c76-ae07-4d8e-9470-cbcd76276c21 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:33.172783 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-63660868-827f-4b0e-a944-a3239f6e909d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:33.181631 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-63660868-827f-4b0e-a944-a3239f6e909d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:33.183160 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-63660868-827f-4b0e-a944-a3239f6e909d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:33.184372 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-63660868-827f-4b0e-a944-a3239f6e909d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.163531 Feb 21 01:13:33.184936 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 274/579] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:33 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:33.192002 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-cf443c76-ae07-4d8e-9470-cbcd76276c21 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045188 Feb 21 01:13:33.192569 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 306/580] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:33 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:13:34.202382 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-948a4a5f-d0b6-4223-be5e-0b32a79fee9d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:34.202993 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-948a4a5f-d0b6-4223-be5e-0b32a79fee9d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:34.203572 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-73231ebf-c281-4b7b-a3de-52e64b1ffdc9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:34.208378 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-73231ebf-c281-4b7b-a3de-52e64b1ffdc9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:34.210249 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-948a4a5f-d0b6-4223-be5e-0b32a79fee9d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:34.210904 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-948a4a5f-d0b6-4223-be5e-0b32a79fee9d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:34.211701 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-948a4a5f-d0b6-4223-be5e-0b32a79fee9d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:34.212074 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-73231ebf-c281-4b7b-a3de-52e64b1ffdc9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:34.212187 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-948a4a5f-d0b6-4223-be5e-0b32a79fee9d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:34.212529 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-73231ebf-c281-4b7b-a3de-52e64b1ffdc9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:34.213323 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-73231ebf-c281-4b7b-a3de-52e64b1ffdc9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:34.213761 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-73231ebf-c281-4b7b-a3de-52e64b1ffdc9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:34.243842 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-73231ebf-c281-4b7b-a3de-52e64b1ffdc9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044041 Feb 21 01:13:34.244433 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 307/581] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:34 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:13:34.351920 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-948a4a5f-d0b6-4223-be5e-0b32a79fee9d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:34.361951 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-948a4a5f-d0b6-4223-be5e-0b32a79fee9d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:34.363426 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-948a4a5f-d0b6-4223-be5e-0b32a79fee9d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:34.364641 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-948a4a5f-d0b6-4223-be5e-0b32a79fee9d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.165993 Feb 21 01:13:34.365190 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 275/582] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:34 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:35.254413 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4937cbd1-0cb9-4444-a369-e68b0bb99b0c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:35.257956 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4937cbd1-0cb9-4444-a369-e68b0bb99b0c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:35.262347 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4937cbd1-0cb9-4444-a369-e68b0bb99b0c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:35.262801 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4937cbd1-0cb9-4444-a369-e68b0bb99b0c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:35.263635 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4937cbd1-0cb9-4444-a369-e68b0bb99b0c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:35.264135 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4937cbd1-0cb9-4444-a369-e68b0bb99b0c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:35.293238 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4937cbd1-0cb9-4444-a369-e68b0bb99b0c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042501 Feb 21 01:13:35.293796 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 308/583] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:35 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:35.384253 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-30f2cde3-1bf2-41d7-b138-de95309c1913 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:35.384866 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-30f2cde3-1bf2-41d7-b138-de95309c1913 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:35.392286 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-30f2cde3-1bf2-41d7-b138-de95309c1913 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:35.392736 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-30f2cde3-1bf2-41d7-b138-de95309c1913 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:35.393521 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-30f2cde3-1bf2-41d7-b138-de95309c1913 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:35.393960 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-30f2cde3-1bf2-41d7-b138-de95309c1913 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:35.543027 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-30f2cde3-1bf2-41d7-b138-de95309c1913 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:35.543027 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-30f2cde3-1bf2-41d7-b138-de95309c1913 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:35.543279 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-30f2cde3-1bf2-41d7-b138-de95309c1913 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:35.543279 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-30f2cde3-1bf2-41d7-b138-de95309c1913 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.161710 Feb 21 01:13:35.543279 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 276/584] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:35 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:36.304948 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-338e3509-f1a7-4d80-86df-003384acf013 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:36.305898 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-338e3509-f1a7-4d80-86df-003384acf013 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:36.312122 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-338e3509-f1a7-4d80-86df-003384acf013 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:36.312573 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-338e3509-f1a7-4d80-86df-003384acf013 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:36.313358 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-338e3509-f1a7-4d80-86df-003384acf013 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:36.313796 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-338e3509-f1a7-4d80-86df-003384acf013 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:36.343364 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-338e3509-f1a7-4d80-86df-003384acf013 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042371 Feb 21 01:13:36.343942 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 309/585] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:36 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:36.559902 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9f5b17c1-eae8-4d39-a1a4-bdc201db38d2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:36.560604 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9f5b17c1-eae8-4d39-a1a4-bdc201db38d2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:36.566813 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9f5b17c1-eae8-4d39-a1a4-bdc201db38d2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:36.567259 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9f5b17c1-eae8-4d39-a1a4-bdc201db38d2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:36.568071 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9f5b17c1-eae8-4d39-a1a4-bdc201db38d2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:36.568549 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9f5b17c1-eae8-4d39-a1a4-bdc201db38d2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:36.702673 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9f5b17c1-eae8-4d39-a1a4-bdc201db38d2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:36.711697 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9f5b17c1-eae8-4d39-a1a4-bdc201db38d2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:36.713226 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9f5b17c1-eae8-4d39-a1a4-bdc201db38d2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:36.714376 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9f5b17c1-eae8-4d39-a1a4-bdc201db38d2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158247 Feb 21 01:13:36.714929 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 277/586] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:36 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:37.355740 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-34519318-7855-4c84-b134-09c31ce3e7ce tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:37.356697 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-34519318-7855-4c84-b134-09c31ce3e7ce tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:37.363057 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-34519318-7855-4c84-b134-09c31ce3e7ce tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:37.363511 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-34519318-7855-4c84-b134-09c31ce3e7ce tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:37.364335 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-34519318-7855-4c84-b134-09c31ce3e7ce tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:37.364775 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-34519318-7855-4c84-b134-09c31ce3e7ce tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:37.394118 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-34519318-7855-4c84-b134-09c31ce3e7ce tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042147 Feb 21 01:13:37.394699 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 310/587] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:37 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:13:37.733198 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-139e7c1b-7781-4eac-9358-c193219b98e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:37.733803 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-139e7c1b-7781-4eac-9358-c193219b98e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:37.739997 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-139e7c1b-7781-4eac-9358-c193219b98e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:37.740495 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-139e7c1b-7781-4eac-9358-c193219b98e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:37.741435 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-139e7c1b-7781-4eac-9358-c193219b98e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:37.741860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-139e7c1b-7781-4eac-9358-c193219b98e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:37.871778 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-139e7c1b-7781-4eac-9358-c193219b98e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:37.879896 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-139e7c1b-7781-4eac-9358-c193219b98e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:37.881938 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-139e7c1b-7781-4eac-9358-c193219b98e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:37.883078 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-139e7c1b-7781-4eac-9358-c193219b98e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.153592 Feb 21 01:13:37.883627 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 278/588] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:37 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:38.406111 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1a8dad56-9a12-467c-9d4b-736249115b9e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:38.407082 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1a8dad56-9a12-467c-9d4b-736249115b9e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:38.414328 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1a8dad56-9a12-467c-9d4b-736249115b9e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:38.414766 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1a8dad56-9a12-467c-9d4b-736249115b9e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:38.415581 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1a8dad56-9a12-467c-9d4b-736249115b9e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:38.416061 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1a8dad56-9a12-467c-9d4b-736249115b9e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:38.444032 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1a8dad56-9a12-467c-9d4b-736249115b9e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041709 Feb 21 01:13:38.444581 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 311/589] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:38 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:38.902646 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c4228439-7a2d-43b8-b5ee-818c074230fe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:38.903178 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c4228439-7a2d-43b8-b5ee-818c074230fe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:38.909751 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c4228439-7a2d-43b8-b5ee-818c074230fe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:38.910199 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c4228439-7a2d-43b8-b5ee-818c074230fe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:38.910983 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c4228439-7a2d-43b8-b5ee-818c074230fe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:38.911418 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c4228439-7a2d-43b8-b5ee-818c074230fe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:39.047542 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c4228439-7a2d-43b8-b5ee-818c074230fe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:39.056806 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c4228439-7a2d-43b8-b5ee-818c074230fe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:39.058284 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c4228439-7a2d-43b8-b5ee-818c074230fe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:39.059422 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c4228439-7a2d-43b8-b5ee-818c074230fe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160807 Feb 21 01:13:39.060003 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 279/590] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:38 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:13:39.454603 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-591b740f-8783-495d-8563-892d85956ee2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:39.455574 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-591b740f-8783-495d-8563-892d85956ee2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:39.462384 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-591b740f-8783-495d-8563-892d85956ee2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:39.462834 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-591b740f-8783-495d-8563-892d85956ee2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:39.463616 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-591b740f-8783-495d-8563-892d85956ee2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:39.464080 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-591b740f-8783-495d-8563-892d85956ee2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:39.494899 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-591b740f-8783-495d-8563-892d85956ee2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044164 Feb 21 01:13:39.495565 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 312/591] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:39 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:40.077728 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ae7717cf-bfef-44ac-a3a5-102cc2b2f002 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:40.078322 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ae7717cf-bfef-44ac-a3a5-102cc2b2f002 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:40.084783 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ae7717cf-bfef-44ac-a3a5-102cc2b2f002 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:40.085233 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ae7717cf-bfef-44ac-a3a5-102cc2b2f002 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:40.086719 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ae7717cf-bfef-44ac-a3a5-102cc2b2f002 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:40.087261 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ae7717cf-bfef-44ac-a3a5-102cc2b2f002 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:40.218696 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ae7717cf-bfef-44ac-a3a5-102cc2b2f002 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:40.227083 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ae7717cf-bfef-44ac-a3a5-102cc2b2f002 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:40.228611 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ae7717cf-bfef-44ac-a3a5-102cc2b2f002 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:40.229820 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ae7717cf-bfef-44ac-a3a5-102cc2b2f002 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155774 Feb 21 01:13:40.230377 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 280/592] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:40 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:40.505858 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b9a281b8-a9d1-4642-a0ba-c8b4c2f88c31 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:40.506889 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b9a281b8-a9d1-4642-a0ba-c8b4c2f88c31 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:40.514766 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b9a281b8-a9d1-4642-a0ba-c8b4c2f88c31 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:40.515276 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b9a281b8-a9d1-4642-a0ba-c8b4c2f88c31 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:40.516207 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b9a281b8-a9d1-4642-a0ba-c8b4c2f88c31 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:40.516742 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b9a281b8-a9d1-4642-a0ba-c8b4c2f88c31 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:40.550500 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b9a281b8-a9d1-4642-a0ba-c8b4c2f88c31 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048478 Feb 21 01:13:40.551081 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 313/593] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:40 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:41.247685 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1b67b6ff-f992-4eb1-b3cb-e256f075ba24 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:41.248365 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1b67b6ff-f992-4eb1-b3cb-e256f075ba24 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:41.254578 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1b67b6ff-f992-4eb1-b3cb-e256f075ba24 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:41.255022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1b67b6ff-f992-4eb1-b3cb-e256f075ba24 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:41.255796 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1b67b6ff-f992-4eb1-b3cb-e256f075ba24 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:41.256253 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1b67b6ff-f992-4eb1-b3cb-e256f075ba24 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:41.388740 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1b67b6ff-f992-4eb1-b3cb-e256f075ba24 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:41.396798 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1b67b6ff-f992-4eb1-b3cb-e256f075ba24 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:41.398387 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1b67b6ff-f992-4eb1-b3cb-e256f075ba24 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:41.399901 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1b67b6ff-f992-4eb1-b3cb-e256f075ba24 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155960 Feb 21 01:13:41.404872 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 281/594] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:41 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:13:41.562040 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4f2b8b87-c08d-48bd-a8bb-2391d46e740b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:41.562874 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4f2b8b87-c08d-48bd-a8bb-2391d46e740b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:41.569110 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f2b8b87-c08d-48bd-a8bb-2391d46e740b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:41.569557 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f2b8b87-c08d-48bd-a8bb-2391d46e740b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:41.571706 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f2b8b87-c08d-48bd-a8bb-2391d46e740b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:41.571706 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f2b8b87-c08d-48bd-a8bb-2391d46e740b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:41.601031 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4f2b8b87-c08d-48bd-a8bb-2391d46e740b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042897 Feb 21 01:13:41.602139 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 314/595] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:41 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:42.418754 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a2371a90-0d49-41b9-bac0-195129652251 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:42.419365 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a2371a90-0d49-41b9-bac0-195129652251 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:42.425688 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a2371a90-0d49-41b9-bac0-195129652251 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:42.426142 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a2371a90-0d49-41b9-bac0-195129652251 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:42.426930 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a2371a90-0d49-41b9-bac0-195129652251 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:42.427370 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a2371a90-0d49-41b9-bac0-195129652251 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:42.561464 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a2371a90-0d49-41b9-bac0-195129652251 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:42.569639 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a2371a90-0d49-41b9-bac0-195129652251 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:42.572081 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a2371a90-0d49-41b9-bac0-195129652251 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:42.573249 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a2371a90-0d49-41b9-bac0-195129652251 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158240 Feb 21 01:13:42.573809 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 282/596] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:42 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:42.613202 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8ca7df18-c021-47f7-8c51-a39b288ac092 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:42.614061 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8ca7df18-c021-47f7-8c51-a39b288ac092 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:42.620413 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8ca7df18-c021-47f7-8c51-a39b288ac092 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:42.620868 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8ca7df18-c021-47f7-8c51-a39b288ac092 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:42.621661 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8ca7df18-c021-47f7-8c51-a39b288ac092 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:42.622099 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8ca7df18-c021-47f7-8c51-a39b288ac092 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:42.652312 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8ca7df18-c021-47f7-8c51-a39b288ac092 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042918 Feb 21 01:13:42.652870 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 315/597] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:42 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:43.145315 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:13:43.145618 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:13:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:13:43.591796 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fe52f523-2ad9-429b-b162-9316014a4201 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:43.592423 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fe52f523-2ad9-429b-b162-9316014a4201 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:43.598644 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe52f523-2ad9-429b-b162-9316014a4201 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:43.599083 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe52f523-2ad9-429b-b162-9316014a4201 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:43.599874 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe52f523-2ad9-429b-b162-9316014a4201 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:43.600300 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe52f523-2ad9-429b-b162-9316014a4201 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:43.663642 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2ce0d768-8002-4fe8-a199-25e49889aa22 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:43.665604 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2ce0d768-8002-4fe8-a199-25e49889aa22 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:43.672631 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2ce0d768-8002-4fe8-a199-25e49889aa22 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:43.673171 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2ce0d768-8002-4fe8-a199-25e49889aa22 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:43.674054 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2ce0d768-8002-4fe8-a199-25e49889aa22 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:43.674579 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2ce0d768-8002-4fe8-a199-25e49889aa22 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:43.704358 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2ce0d768-8002-4fe8-a199-25e49889aa22 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044345 Feb 21 01:13:43.704963 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 316/598] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:43 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:13:43.735458 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fe52f523-2ad9-429b-b162-9316014a4201 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:43.744109 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fe52f523-2ad9-429b-b162-9316014a4201 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:43.745605 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fe52f523-2ad9-429b-b162-9316014a4201 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:43.746753 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fe52f523-2ad9-429b-b162-9316014a4201 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158695 Feb 21 01:13:43.747303 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 283/599] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:43 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:44.715633 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8af7dd94-194f-4eff-8109-8e09d634cb0c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:44.716582 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8af7dd94-194f-4eff-8109-8e09d634cb0c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:44.722896 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8af7dd94-194f-4eff-8109-8e09d634cb0c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:44.723335 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8af7dd94-194f-4eff-8109-8e09d634cb0c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:44.724171 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8af7dd94-194f-4eff-8109-8e09d634cb0c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:44.724598 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8af7dd94-194f-4eff-8109-8e09d634cb0c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:44.754103 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8af7dd94-194f-4eff-8109-8e09d634cb0c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042719 Feb 21 01:13:44.754654 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 317/600] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:44 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:44.764613 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2e0c60f9-b7da-42c7-91d3-44ed613fd47e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:44.765226 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2e0c60f9-b7da-42c7-91d3-44ed613fd47e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:44.771571 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2e0c60f9-b7da-42c7-91d3-44ed613fd47e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:44.772059 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2e0c60f9-b7da-42c7-91d3-44ed613fd47e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:44.772838 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2e0c60f9-b7da-42c7-91d3-44ed613fd47e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:44.773936 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2e0c60f9-b7da-42c7-91d3-44ed613fd47e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:44.920860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2e0c60f9-b7da-42c7-91d3-44ed613fd47e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:44.924778 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2e0c60f9-b7da-42c7-91d3-44ed613fd47e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:44.926250 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2e0c60f9-b7da-42c7-91d3-44ed613fd47e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:44.927409 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2e0c60f9-b7da-42c7-91d3-44ed613fd47e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.166564 Feb 21 01:13:44.928014 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 284/601] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:44 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:45.766047 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a26df800-0e77-4344-924b-2f1e5d130c31 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:45.766972 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a26df800-0e77-4344-924b-2f1e5d130c31 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:45.774586 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a26df800-0e77-4344-924b-2f1e5d130c31 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:45.775041 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a26df800-0e77-4344-924b-2f1e5d130c31 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:45.775875 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a26df800-0e77-4344-924b-2f1e5d130c31 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:45.776313 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a26df800-0e77-4344-924b-2f1e5d130c31 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:45.805569 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a26df800-0e77-4344-924b-2f1e5d130c31 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043272 Feb 21 01:13:45.806116 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 318/602] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:45 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:45.947470 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e6a5582b-aa2d-441d-ae0c-ccb88f61b56f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:45.948112 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e6a5582b-aa2d-441d-ae0c-ccb88f61b56f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:45.954407 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e6a5582b-aa2d-441d-ae0c-ccb88f61b56f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:45.954859 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e6a5582b-aa2d-441d-ae0c-ccb88f61b56f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:45.955655 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e6a5582b-aa2d-441d-ae0c-ccb88f61b56f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:45.956117 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e6a5582b-aa2d-441d-ae0c-ccb88f61b56f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:46.087422 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e6a5582b-aa2d-441d-ae0c-ccb88f61b56f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:46.095504 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e6a5582b-aa2d-441d-ae0c-ccb88f61b56f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:46.097023 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e6a5582b-aa2d-441d-ae0c-ccb88f61b56f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:46.098159 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e6a5582b-aa2d-441d-ae0c-ccb88f61b56f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156272 Feb 21 01:13:46.098716 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 285/603] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:45 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:46.817005 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2e5d76f7-13ed-4c46-96bc-5f9c5ba3d3e4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:46.817921 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2e5d76f7-13ed-4c46-96bc-5f9c5ba3d3e4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:46.825219 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e5d76f7-13ed-4c46-96bc-5f9c5ba3d3e4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:46.825671 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e5d76f7-13ed-4c46-96bc-5f9c5ba3d3e4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:46.826455 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e5d76f7-13ed-4c46-96bc-5f9c5ba3d3e4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:46.826892 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e5d76f7-13ed-4c46-96bc-5f9c5ba3d3e4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:46.857087 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2e5d76f7-13ed-4c46-96bc-5f9c5ba3d3e4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043787 Feb 21 01:13:46.857631 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 319/604] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:46 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:47.117373 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fbf5512f-0759-4462-83b7-9a46728396bf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:47.118087 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fbf5512f-0759-4462-83b7-9a46728396bf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:47.124169 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fbf5512f-0759-4462-83b7-9a46728396bf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:47.124621 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fbf5512f-0759-4462-83b7-9a46728396bf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:47.125408 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fbf5512f-0759-4462-83b7-9a46728396bf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:47.125846 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fbf5512f-0759-4462-83b7-9a46728396bf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:47.271015 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fbf5512f-0759-4462-83b7-9a46728396bf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:47.280669 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fbf5512f-0759-4462-83b7-9a46728396bf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:47.283287 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fbf5512f-0759-4462-83b7-9a46728396bf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:47.283691 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fbf5512f-0759-4462-83b7-9a46728396bf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.170144 Feb 21 01:13:47.284286 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 286/605] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:47 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:47.868452 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b160df4a-84ac-49d7-b9af-61c30de2bd45 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:47.869359 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b160df4a-84ac-49d7-b9af-61c30de2bd45 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:47.875564 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b160df4a-84ac-49d7-b9af-61c30de2bd45 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:47.876039 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b160df4a-84ac-49d7-b9af-61c30de2bd45 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:47.876842 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b160df4a-84ac-49d7-b9af-61c30de2bd45 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:47.877271 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b160df4a-84ac-49d7-b9af-61c30de2bd45 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:47.906669 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b160df4a-84ac-49d7-b9af-61c30de2bd45 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041904 Feb 21 01:13:47.907219 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 320/606] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:47 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:48.302333 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cd3ba4c4-a082-4aff-b38c-dc14537f8235 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:48.302951 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cd3ba4c4-a082-4aff-b38c-dc14537f8235 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:48.310224 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cd3ba4c4-a082-4aff-b38c-dc14537f8235 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:48.310671 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cd3ba4c4-a082-4aff-b38c-dc14537f8235 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:48.311456 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cd3ba4c4-a082-4aff-b38c-dc14537f8235 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:48.311913 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cd3ba4c4-a082-4aff-b38c-dc14537f8235 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:48.447644 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cd3ba4c4-a082-4aff-b38c-dc14537f8235 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:48.456002 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cd3ba4c4-a082-4aff-b38c-dc14537f8235 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:48.457486 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cd3ba4c4-a082-4aff-b38c-dc14537f8235 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:48.458629 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cd3ba4c4-a082-4aff-b38c-dc14537f8235 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160053 Feb 21 01:13:48.459187 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 287/607] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:48 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:48.918462 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a68b96e3-5e4c-439c-ab07-e8cf12710bdc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:48.919364 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a68b96e3-5e4c-439c-ab07-e8cf12710bdc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:48.925677 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a68b96e3-5e4c-439c-ab07-e8cf12710bdc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:48.926117 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a68b96e3-5e4c-439c-ab07-e8cf12710bdc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:48.926890 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a68b96e3-5e4c-439c-ab07-e8cf12710bdc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:48.927343 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a68b96e3-5e4c-439c-ab07-e8cf12710bdc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:48.956589 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a68b96e3-5e4c-439c-ab07-e8cf12710bdc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041843 Feb 21 01:13:48.957130 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 321/608] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:48 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:49.478175 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-39082005-ccd8-4eb1-81e7-3d2f5dcd9936 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:49.478778 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-39082005-ccd8-4eb1-81e7-3d2f5dcd9936 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:49.485055 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-39082005-ccd8-4eb1-81e7-3d2f5dcd9936 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:49.485504 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-39082005-ccd8-4eb1-81e7-3d2f5dcd9936 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:49.486285 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-39082005-ccd8-4eb1-81e7-3d2f5dcd9936 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:49.486721 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-39082005-ccd8-4eb1-81e7-3d2f5dcd9936 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:49.618091 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-39082005-ccd8-4eb1-81e7-3d2f5dcd9936 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:49.626450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-39082005-ccd8-4eb1-81e7-3d2f5dcd9936 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:49.628026 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-39082005-ccd8-4eb1-81e7-3d2f5dcd9936 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:49.629216 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-39082005-ccd8-4eb1-81e7-3d2f5dcd9936 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155744 Feb 21 01:13:49.629768 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 288/609] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:49 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:49.968530 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9b0ac7bc-e036-42f1-9ade-ce82545bf43f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:49.969662 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9b0ac7bc-e036-42f1-9ade-ce82545bf43f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:49.976937 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9b0ac7bc-e036-42f1-9ade-ce82545bf43f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:49.977414 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9b0ac7bc-e036-42f1-9ade-ce82545bf43f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:49.978212 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9b0ac7bc-e036-42f1-9ade-ce82545bf43f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:49.978638 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9b0ac7bc-e036-42f1-9ade-ce82545bf43f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:50.008812 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9b0ac7bc-e036-42f1-9ade-ce82545bf43f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044202 Feb 21 01:13:50.009372 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 322/610] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:49 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:50.648481 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a292c24b-a323-4616-b947-b6529164f350 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:50.649203 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a292c24b-a323-4616-b947-b6529164f350 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:50.655993 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a292c24b-a323-4616-b947-b6529164f350 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:50.656450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a292c24b-a323-4616-b947-b6529164f350 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:50.657494 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a292c24b-a323-4616-b947-b6529164f350 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:50.657933 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a292c24b-a323-4616-b947-b6529164f350 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:50.794001 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a292c24b-a323-4616-b947-b6529164f350 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:50.802062 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a292c24b-a323-4616-b947-b6529164f350 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:50.803556 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a292c24b-a323-4616-b947-b6529164f350 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:50.804777 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a292c24b-a323-4616-b947-b6529164f350 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160154 Feb 21 01:13:50.805330 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 289/611] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:50 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:51.020305 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-dead1484-5d9b-4c20-9364-30fbbb139ebb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:51.021259 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-dead1484-5d9b-4c20-9364-30fbbb139ebb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:51.028121 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dead1484-5d9b-4c20-9364-30fbbb139ebb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:51.028576 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dead1484-5d9b-4c20-9364-30fbbb139ebb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:51.029363 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dead1484-5d9b-4c20-9364-30fbbb139ebb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:51.029798 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dead1484-5d9b-4c20-9364-30fbbb139ebb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:51.059272 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-dead1484-5d9b-4c20-9364-30fbbb139ebb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042681 Feb 21 01:13:51.059816 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 323/612] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:51 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:51.823102 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2950d9b8-b7e6-4ed5-8e7f-b3b49490ebde tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:51.823740 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2950d9b8-b7e6-4ed5-8e7f-b3b49490ebde tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:51.829912 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2950d9b8-b7e6-4ed5-8e7f-b3b49490ebde tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:51.830356 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2950d9b8-b7e6-4ed5-8e7f-b3b49490ebde tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:51.831122 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2950d9b8-b7e6-4ed5-8e7f-b3b49490ebde tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:51.831545 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2950d9b8-b7e6-4ed5-8e7f-b3b49490ebde tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:51.963515 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2950d9b8-b7e6-4ed5-8e7f-b3b49490ebde tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:51.971927 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2950d9b8-b7e6-4ed5-8e7f-b3b49490ebde tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:51.973440 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2950d9b8-b7e6-4ed5-8e7f-b3b49490ebde tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:51.974592 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2950d9b8-b7e6-4ed5-8e7f-b3b49490ebde tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156004 Feb 21 01:13:51.975152 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 290/613] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:51 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:52.070962 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a3b9b423-74e2-4c5b-9b39-16b2d77e6b5a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:52.071928 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a3b9b423-74e2-4c5b-9b39-16b2d77e6b5a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:52.078272 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a3b9b423-74e2-4c5b-9b39-16b2d77e6b5a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:52.078660 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a3b9b423-74e2-4c5b-9b39-16b2d77e6b5a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:52.079439 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a3b9b423-74e2-4c5b-9b39-16b2d77e6b5a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:52.079893 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a3b9b423-74e2-4c5b-9b39-16b2d77e6b5a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:52.109091 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a3b9b423-74e2-4c5b-9b39-16b2d77e6b5a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042377 Feb 21 01:13:52.109644 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 324/614] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:52 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:52.994081 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-abe17f1d-9e70-44db-a26b-f40c5b16b200 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:52.994798 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-abe17f1d-9e70-44db-a26b-f40c5b16b200 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:53.001730 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-abe17f1d-9e70-44db-a26b-f40c5b16b200 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:53.002169 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-abe17f1d-9e70-44db-a26b-f40c5b16b200 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:53.002948 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-abe17f1d-9e70-44db-a26b-f40c5b16b200 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:53.003373 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-abe17f1d-9e70-44db-a26b-f40c5b16b200 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:53.121226 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c489d00c-b14d-4a63-be50-c4eb2995576c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:53.122177 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c489d00c-b14d-4a63-be50-c4eb2995576c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:53.128385 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c489d00c-b14d-4a63-be50-c4eb2995576c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:53.128885 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c489d00c-b14d-4a63-be50-c4eb2995576c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:53.129685 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c489d00c-b14d-4a63-be50-c4eb2995576c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:53.130117 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c489d00c-b14d-4a63-be50-c4eb2995576c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:53.137626 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-abe17f1d-9e70-44db-a26b-f40c5b16b200 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:53.145861 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-abe17f1d-9e70-44db-a26b-f40c5b16b200 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:53.147350 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-abe17f1d-9e70-44db-a26b-f40c5b16b200 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:53.149113 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-abe17f1d-9e70-44db-a26b-f40c5b16b200 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159537 Feb 21 01:13:53.149737 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 291/615] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:52 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:53.163215 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c489d00c-b14d-4a63-be50-c4eb2995576c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046376 Feb 21 01:13:53.164587 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 325/616] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:53 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:13:54.168328 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ab9c8cb6-1b7a-4d3f-9dd2-b2ca0c75a297 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:54.168975 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ab9c8cb6-1b7a-4d3f-9dd2-b2ca0c75a297 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:54.174568 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9e2e1895-0da6-47a3-8354-3852bde7f3aa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:54.175339 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ab9c8cb6-1b7a-4d3f-9dd2-b2ca0c75a297 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:54.175457 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9e2e1895-0da6-47a3-8354-3852bde7f3aa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:54.175790 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ab9c8cb6-1b7a-4d3f-9dd2-b2ca0c75a297 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:54.176611 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ab9c8cb6-1b7a-4d3f-9dd2-b2ca0c75a297 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:54.177047 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ab9c8cb6-1b7a-4d3f-9dd2-b2ca0c75a297 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:54.182906 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9e2e1895-0da6-47a3-8354-3852bde7f3aa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:54.183346 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9e2e1895-0da6-47a3-8354-3852bde7f3aa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:54.184150 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9e2e1895-0da6-47a3-8354-3852bde7f3aa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:54.184580 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9e2e1895-0da6-47a3-8354-3852bde7f3aa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:54.214114 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9e2e1895-0da6-47a3-8354-3852bde7f3aa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043170 Feb 21 01:13:54.214667 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 326/617] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:54 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:13:54.317315 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ab9c8cb6-1b7a-4d3f-9dd2-b2ca0c75a297 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:54.329337 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ab9c8cb6-1b7a-4d3f-9dd2-b2ca0c75a297 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:54.330828 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ab9c8cb6-1b7a-4d3f-9dd2-b2ca0c75a297 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:54.332009 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ab9c8cb6-1b7a-4d3f-9dd2-b2ca0c75a297 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.168014 Feb 21 01:13:54.332567 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 292/618] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:54 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:55.224884 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-270257b9-7608-4cdd-8f2e-68b6caba9962 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:55.225860 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-270257b9-7608-4cdd-8f2e-68b6caba9962 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:55.232197 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-270257b9-7608-4cdd-8f2e-68b6caba9962 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:55.232650 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-270257b9-7608-4cdd-8f2e-68b6caba9962 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:55.233465 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-270257b9-7608-4cdd-8f2e-68b6caba9962 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:55.233900 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-270257b9-7608-4cdd-8f2e-68b6caba9962 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:55.264515 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-270257b9-7608-4cdd-8f2e-68b6caba9962 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043517 Feb 21 01:13:55.265073 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 327/619] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:55 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:55.349943 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3aa40b57-cbac-4591-8cf2-85d8d4219ccf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:55.350540 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3aa40b57-cbac-4591-8cf2-85d8d4219ccf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:55.358047 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3aa40b57-cbac-4591-8cf2-85d8d4219ccf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:55.359020 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3aa40b57-cbac-4591-8cf2-85d8d4219ccf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:55.359294 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3aa40b57-cbac-4591-8cf2-85d8d4219ccf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:55.359732 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3aa40b57-cbac-4591-8cf2-85d8d4219ccf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:55.493121 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3aa40b57-cbac-4591-8cf2-85d8d4219ccf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:55.501564 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3aa40b57-cbac-4591-8cf2-85d8d4219ccf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:55.503065 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3aa40b57-cbac-4591-8cf2-85d8d4219ccf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:55.504227 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3aa40b57-cbac-4591-8cf2-85d8d4219ccf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158130 Feb 21 01:13:55.504777 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 293/620] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:55 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:56.276191 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6da44420-3e34-47b5-9c06-b1e5a2cb88b3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:56.277335 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6da44420-3e34-47b5-9c06-b1e5a2cb88b3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:56.285123 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6da44420-3e34-47b5-9c06-b1e5a2cb88b3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:56.285566 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6da44420-3e34-47b5-9c06-b1e5a2cb88b3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:56.286343 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6da44420-3e34-47b5-9c06-b1e5a2cb88b3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:56.286774 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6da44420-3e34-47b5-9c06-b1e5a2cb88b3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:56.315787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6da44420-3e34-47b5-9c06-b1e5a2cb88b3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043525 Feb 21 01:13:56.316360 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 328/621] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:56 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:56.522899 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-658c96df-5fb8-4f0d-8b64-d8c645eec9ba tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:56.523893 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-658c96df-5fb8-4f0d-8b64-d8c645eec9ba tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:56.530454 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-658c96df-5fb8-4f0d-8b64-d8c645eec9ba tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:56.530841 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-658c96df-5fb8-4f0d-8b64-d8c645eec9ba tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:56.531654 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-658c96df-5fb8-4f0d-8b64-d8c645eec9ba tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:56.532370 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-658c96df-5fb8-4f0d-8b64-d8c645eec9ba tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:56.667815 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-658c96df-5fb8-4f0d-8b64-d8c645eec9ba tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:56.676031 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-658c96df-5fb8-4f0d-8b64-d8c645eec9ba tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:56.677518 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-658c96df-5fb8-4f0d-8b64-d8c645eec9ba tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:56.678666 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-658c96df-5fb8-4f0d-8b64-d8c645eec9ba tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159610 Feb 21 01:13:56.679784 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 294/622] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:56 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:57.327906 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-390e1690-3aaf-4dc9-9d9e-ac1bbcd63a21 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:57.328799 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-390e1690-3aaf-4dc9-9d9e-ac1bbcd63a21 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:57.334651 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-390e1690-3aaf-4dc9-9d9e-ac1bbcd63a21 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:57.335094 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-390e1690-3aaf-4dc9-9d9e-ac1bbcd63a21 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:57.335934 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-390e1690-3aaf-4dc9-9d9e-ac1bbcd63a21 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:57.336850 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-390e1690-3aaf-4dc9-9d9e-ac1bbcd63a21 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:57.366819 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-390e1690-3aaf-4dc9-9d9e-ac1bbcd63a21 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043330 Feb 21 01:13:57.367374 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 329/623] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:57 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:57.698902 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5b2043fe-6970-4b70-b9e0-5659ed8b09d9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:57.699457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5b2043fe-6970-4b70-b9e0-5659ed8b09d9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:57.705738 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5b2043fe-6970-4b70-b9e0-5659ed8b09d9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:57.706231 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5b2043fe-6970-4b70-b9e0-5659ed8b09d9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:57.707084 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5b2043fe-6970-4b70-b9e0-5659ed8b09d9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:57.707536 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5b2043fe-6970-4b70-b9e0-5659ed8b09d9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:57.844308 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5b2043fe-6970-4b70-b9e0-5659ed8b09d9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:57.852623 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5b2043fe-6970-4b70-b9e0-5659ed8b09d9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:57.854150 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5b2043fe-6970-4b70-b9e0-5659ed8b09d9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:57.855345 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5b2043fe-6970-4b70-b9e0-5659ed8b09d9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.161268 Feb 21 01:13:57.855930 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 295/624] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:57 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:58.112353 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a8e27c71-13ef-4c66-b207-2cdfc8be923a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:58.112848 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a8e27c71-13ef-4c66-b207-2cdfc8be923a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:58.119704 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a8e27c71-13ef-4c66-b207-2cdfc8be923a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:58.120181 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a8e27c71-13ef-4c66-b207-2cdfc8be923a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:58.120955 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a8e27c71-13ef-4c66-b207-2cdfc8be923a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:58.121384 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a8e27c71-13ef-4c66-b207-2cdfc8be923a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:58.145816 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a8e27c71-13ef-4c66-b207-2cdfc8be923a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Going to try to terminate instance {{(pid=117139) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:13:58.386296 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cc9a83b4-7081-429d-8848-0e5bcc60b375 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:58.386296 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cc9a83b4-7081-429d-8848-0e5bcc60b375 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:58.386296 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc9a83b4-7081-429d-8848-0e5bcc60b375 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:58.386773 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc9a83b4-7081-429d-8848-0e5bcc60b375 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:58.387601 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc9a83b4-7081-429d-8848-0e5bcc60b375 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:58.388067 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc9a83b4-7081-429d-8848-0e5bcc60b375 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:58.420499 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cc9a83b4-7081-429d-8848-0e5bcc60b375 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045983 Feb 21 01:13:58.421067 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 296/625] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:58 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:13:58.494960 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a8e27c71-13ef-4c66-b207-2cdfc8be923a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "DELETE /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 204 len: 0 microversion: 2.1 time: 0.385876 Feb 21 01:13:58.498997 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 330/626] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Feb 21 01:13:58 2022] DELETE /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:13:58.504099 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5f66659f-8621-41e1-a212-0bcc12b1eab9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:58.504886 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5f66659f-8621-41e1-a212-0bcc12b1eab9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:58.515482 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5f66659f-8621-41e1-a212-0bcc12b1eab9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:58.515482 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5f66659f-8621-41e1-a212-0bcc12b1eab9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:58.517034 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5f66659f-8621-41e1-a212-0bcc12b1eab9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:58.517473 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5f66659f-8621-41e1-a212-0bcc12b1eab9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:58.661924 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5f66659f-8621-41e1-a212-0bcc12b1eab9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:58.670249 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5f66659f-8621-41e1-a212-0bcc12b1eab9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1576 microversion: 2.1 time: 0.170114 Feb 21 01:13:58.670822 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 297/627] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:58 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:58.874258 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ce62d408-d844-45e3-8b62-43306ffa9e9e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:58.874949 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ce62d408-d844-45e3-8b62-43306ffa9e9e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:58.881043 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ce62d408-d844-45e3-8b62-43306ffa9e9e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:58.881491 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ce62d408-d844-45e3-8b62-43306ffa9e9e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:58.882265 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ce62d408-d844-45e3-8b62-43306ffa9e9e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:58.882715 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ce62d408-d844-45e3-8b62-43306ffa9e9e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:59.020486 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ce62d408-d844-45e3-8b62-43306ffa9e9e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:59.029774 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ce62d408-d844-45e3-8b62-43306ffa9e9e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:59.031255 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ce62d408-d844-45e3-8b62-43306ffa9e9e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:59.032688 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ce62d408-d844-45e3-8b62-43306ffa9e9e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.162246 Feb 21 01:13:59.033247 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 331/628] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:13:58 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:13:59.433231 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-23fd7bd7-f666-41c6-b182-1129aa91402f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:59.434334 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-23fd7bd7-f666-41c6-b182-1129aa91402f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:59.440790 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-23fd7bd7-f666-41c6-b182-1129aa91402f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:59.441243 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-23fd7bd7-f666-41c6-b182-1129aa91402f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:59.442030 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-23fd7bd7-f666-41c6-b182-1129aa91402f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:59.442570 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-23fd7bd7-f666-41c6-b182-1129aa91402f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:59.474183 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-23fd7bd7-f666-41c6-b182-1129aa91402f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045697 Feb 21 01:13:59.474745 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 298/629] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:13:59 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:59.687629 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a5b07dca-20e8-465a-84fb-927016548061 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:59.688277 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a5b07dca-20e8-465a-84fb-927016548061 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:59.694816 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a5b07dca-20e8-465a-84fb-927016548061 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:59.695293 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a5b07dca-20e8-465a-84fb-927016548061 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:59.696850 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a5b07dca-20e8-465a-84fb-927016548061 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:59.697411 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a5b07dca-20e8-465a-84fb-927016548061 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:59.829715 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a5b07dca-20e8-465a-84fb-927016548061 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:59.837018 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a5b07dca-20e8-465a-84fb-927016548061 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1576 microversion: 2.1 time: 0.153128 Feb 21 01:13:59.837568 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 332/630] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:59 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:00.051096 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f192a6f0-12e3-447a-a464-482656492145 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:00.051739 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f192a6f0-12e3-447a-a464-482656492145 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:00.058494 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f192a6f0-12e3-447a-a464-482656492145 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:00.058948 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f192a6f0-12e3-447a-a464-482656492145 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:00.059725 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f192a6f0-12e3-447a-a464-482656492145 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:00.060190 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f192a6f0-12e3-447a-a464-482656492145 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:00.265812 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f192a6f0-12e3-447a-a464-482656492145 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:00.274751 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f192a6f0-12e3-447a-a464-482656492145 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:00.276377 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f192a6f0-12e3-447a-a464-482656492145 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:00.277550 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f192a6f0-12e3-447a-a464-482656492145 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.230244 Feb 21 01:14:00.278111 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 299/631] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:00 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:00.590174 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a94208eb-3686-4e1e-9c2b-7860b438ae25 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:00.590174 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a94208eb-3686-4e1e-9c2b-7860b438ae25 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:00.590174 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a94208eb-3686-4e1e-9c2b-7860b438ae25 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:00.590174 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a94208eb-3686-4e1e-9c2b-7860b438ae25 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:00.590555 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a94208eb-3686-4e1e-9c2b-7860b438ae25 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:00.590555 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a94208eb-3686-4e1e-9c2b-7860b438ae25 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:00.590555 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a94208eb-3686-4e1e-9c2b-7860b438ae25 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043650 Feb 21 01:14:00.590555 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 333/632] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:00 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:00.853738 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a871225b-b40c-4200-bdb0-8580d9c7e137 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:00.854340 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a871225b-b40c-4200-bdb0-8580d9c7e137 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:00.860608 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a871225b-b40c-4200-bdb0-8580d9c7e137 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:00.861046 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a871225b-b40c-4200-bdb0-8580d9c7e137 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:00.861824 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a871225b-b40c-4200-bdb0-8580d9c7e137 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:00.862251 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a871225b-b40c-4200-bdb0-8580d9c7e137 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:01.038565 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a871225b-b40c-4200-bdb0-8580d9c7e137 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:01.046135 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a871225b-b40c-4200-bdb0-8580d9c7e137 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1576 microversion: 2.1 time: 0.195863 Feb 21 01:14:01.046707 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 300/633] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:00 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1576 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:01.296073 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5a59dae6-145c-4f9b-bf5f-b34ee40d886b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:01.297459 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5a59dae6-145c-4f9b-bf5f-b34ee40d886b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:01.304034 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5a59dae6-145c-4f9b-bf5f-b34ee40d886b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:01.304598 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5a59dae6-145c-4f9b-bf5f-b34ee40d886b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:01.305965 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5a59dae6-145c-4f9b-bf5f-b34ee40d886b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:01.306612 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5a59dae6-145c-4f9b-bf5f-b34ee40d886b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:01.386864 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-49f92868-283a-41af-ba43-217e11ba5147 req-76ae4819-f6ef-44cd-8a7b-d0292ff77d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f114c776-ca8f-4972-a0a7-3af4a2740a2e", "name": "network-vif-deleted", "tag": "6f209b80-f946-4b10-9f3f-3eab83a2ef86"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:14:01.388969 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:14:01.388969 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:14:01.396480 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-49f92868-283a-41af-ba43-217e11ba5147 req-76ae4819-f6ef-44cd-8a7b-d0292ff77d25 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:01.402392 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-49f92868-283a-41af-ba43-217e11ba5147 req-76ae4819-f6ef-44cd-8a7b-d0292ff77d25 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:01.413330 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-49f92868-283a-41af-ba43-217e11ba5147 req-76ae4819-f6ef-44cd-8a7b-d0292ff77d25 service nova] Creating event network-vif-deleted:6f209b80-f946-4b10-9f3f-3eab83a2ef86 for instance f114c776-ca8f-4972-a0a7-3af4a2740a2e on hv-cinder-81322 Feb 21 01:14:01.420154 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-49f92868-283a-41af-ba43-217e11ba5147 req-76ae4819-f6ef-44cd-8a7b-d0292ff77d25 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037877 Feb 21 01:14:01.421859 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 301/634] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:14:01.498146 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5a59dae6-145c-4f9b-bf5f-b34ee40d886b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:01.517119 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5a59dae6-145c-4f9b-bf5f-b34ee40d886b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:01.517119 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5a59dae6-145c-4f9b-bf5f-b34ee40d886b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:01.517119 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5a59dae6-145c-4f9b-bf5f-b34ee40d886b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.224884 Feb 21 01:14:01.518033 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 334/635] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:01 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:01.538337 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6de36752-e532-4860-acdc-a6413d9f600f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:01.539659 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6de36752-e532-4860-acdc-a6413d9f600f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:01.545952 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6de36752-e532-4860-acdc-a6413d9f600f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:01.546478 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6de36752-e532-4860-acdc-a6413d9f600f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:01.547309 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6de36752-e532-4860-acdc-a6413d9f600f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:01.547955 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6de36752-e532-4860-acdc-a6413d9f600f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:01.581921 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6de36752-e532-4860-acdc-a6413d9f600f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047804 Feb 21 01:14:01.582468 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 302/636] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:01 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:02.064139 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-79976eef-9e01-4d31-bb6a-755f90620f95 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:02.065245 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-79976eef-9e01-4d31-bb6a-755f90620f95 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:02.072959 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-79976eef-9e01-4d31-bb6a-755f90620f95 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:02.073881 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-79976eef-9e01-4d31-bb6a-755f90620f95 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:02.074681 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-79976eef-9e01-4d31-bb6a-755f90620f95 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:02.075220 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-79976eef-9e01-4d31-bb6a-755f90620f95 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:02.136866 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-79976eef-9e01-4d31-bb6a-755f90620f95 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:02.145124 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-79976eef-9e01-4d31-bb6a-755f90620f95 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084873 Feb 21 01:14:02.146233 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 335/637] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:02 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:02.536494 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b135b2ff-4c5e-4f66-a702-713c94812e73 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:02.537283 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b135b2ff-4c5e-4f66-a702-713c94812e73 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:02.549525 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b135b2ff-4c5e-4f66-a702-713c94812e73 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:02.551773 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b135b2ff-4c5e-4f66-a702-713c94812e73 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:02.551773 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b135b2ff-4c5e-4f66-a702-713c94812e73 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:02.551773 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b135b2ff-4c5e-4f66-a702-713c94812e73 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:02.594151 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f9bee824-83b2-4183-9697-4bad2e9be14e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:02.596214 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f9bee824-83b2-4183-9697-4bad2e9be14e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:02.603972 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f9bee824-83b2-4183-9697-4bad2e9be14e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:02.604428 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f9bee824-83b2-4183-9697-4bad2e9be14e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:02.605228 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f9bee824-83b2-4183-9697-4bad2e9be14e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:02.605663 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f9bee824-83b2-4183-9697-4bad2e9be14e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:02.638633 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f9bee824-83b2-4183-9697-4bad2e9be14e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048951 Feb 21 01:14:02.642654 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 336/638] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:02 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:02.693502 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b135b2ff-4c5e-4f66-a702-713c94812e73 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:02.704579 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b135b2ff-4c5e-4f66-a702-713c94812e73 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:02.706065 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b135b2ff-4c5e-4f66-a702-713c94812e73 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:02.707224 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b135b2ff-4c5e-4f66-a702-713c94812e73 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.174934 Feb 21 01:14:02.707783 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 303/639] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:02 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:03.162280 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7936c2e9-a1aa-412f-8059-28c2a52ff650 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:03.162887 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7936c2e9-a1aa-412f-8059-28c2a52ff650 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:03.168981 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7936c2e9-a1aa-412f-8059-28c2a52ff650 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:03.169425 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7936c2e9-a1aa-412f-8059-28c2a52ff650 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:03.170201 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7936c2e9-a1aa-412f-8059-28c2a52ff650 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:03.170631 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7936c2e9-a1aa-412f-8059-28c2a52ff650 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:03.232017 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7936c2e9-a1aa-412f-8059-28c2a52ff650 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:03.239501 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7936c2e9-a1aa-412f-8059-28c2a52ff650 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080818 Feb 21 01:14:03.240093 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 337/640] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:03 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:03.650871 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2088c90d-3247-454d-928b-d3b011f7a570 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:03.651786 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2088c90d-3247-454d-928b-d3b011f7a570 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:03.658461 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2088c90d-3247-454d-928b-d3b011f7a570 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:03.658906 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2088c90d-3247-454d-928b-d3b011f7a570 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:03.659695 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2088c90d-3247-454d-928b-d3b011f7a570 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:03.660164 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2088c90d-3247-454d-928b-d3b011f7a570 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:03.691478 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2088c90d-3247-454d-928b-d3b011f7a570 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044866 Feb 21 01:14:03.692074 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 304/641] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:03 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:03.726704 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-66e39f79-78a2-4ff9-9a40-fbefe6c65b34 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:03.728480 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-66e39f79-78a2-4ff9-9a40-fbefe6c65b34 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:03.735271 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-66e39f79-78a2-4ff9-9a40-fbefe6c65b34 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:03.735827 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-66e39f79-78a2-4ff9-9a40-fbefe6c65b34 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:03.736718 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-66e39f79-78a2-4ff9-9a40-fbefe6c65b34 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:03.737218 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-66e39f79-78a2-4ff9-9a40-fbefe6c65b34 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:03.880548 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-66e39f79-78a2-4ff9-9a40-fbefe6c65b34 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:03.890000 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-66e39f79-78a2-4ff9-9a40-fbefe6c65b34 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:03.891506 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-66e39f79-78a2-4ff9-9a40-fbefe6c65b34 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:03.892783 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-66e39f79-78a2-4ff9-9a40-fbefe6c65b34 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.170250 Feb 21 01:14:03.893364 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 338/642] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:03 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:04.256221 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-08ebfa47-e471-4be0-9e82-31e31a156447 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:04.256728 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-08ebfa47-e471-4be0-9e82-31e31a156447 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:04.263029 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-08ebfa47-e471-4be0-9e82-31e31a156447 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:04.263545 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-08ebfa47-e471-4be0-9e82-31e31a156447 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:04.264344 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-08ebfa47-e471-4be0-9e82-31e31a156447 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:04.264766 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-08ebfa47-e471-4be0-9e82-31e31a156447 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:04.327938 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-08ebfa47-e471-4be0-9e82-31e31a156447 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:04.335309 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-08ebfa47-e471-4be0-9e82-31e31a156447 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082850 Feb 21 01:14:04.335892 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 305/643] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:04 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:04.704169 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-46600ebc-94a9-4d4c-950a-36b462859133 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:04.705104 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-46600ebc-94a9-4d4c-950a-36b462859133 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:04.711287 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-46600ebc-94a9-4d4c-950a-36b462859133 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:04.711719 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-46600ebc-94a9-4d4c-950a-36b462859133 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:04.713106 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-46600ebc-94a9-4d4c-950a-36b462859133 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:04.713532 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-46600ebc-94a9-4d4c-950a-36b462859133 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:04.744303 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-46600ebc-94a9-4d4c-950a-36b462859133 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044436 Feb 21 01:14:04.744986 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 339/644] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:04 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:04.912265 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9521ef7b-7c06-4e46-8534-0a3283a33d19 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:04.912857 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9521ef7b-7c06-4e46-8534-0a3283a33d19 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:04.919491 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9521ef7b-7c06-4e46-8534-0a3283a33d19 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:04.919971 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9521ef7b-7c06-4e46-8534-0a3283a33d19 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:04.920790 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9521ef7b-7c06-4e46-8534-0a3283a33d19 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:04.921222 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9521ef7b-7c06-4e46-8534-0a3283a33d19 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:05.054907 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9521ef7b-7c06-4e46-8534-0a3283a33d19 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:05.064076 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9521ef7b-7c06-4e46-8534-0a3283a33d19 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:05.065573 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9521ef7b-7c06-4e46-8534-0a3283a33d19 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:05.066722 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9521ef7b-7c06-4e46-8534-0a3283a33d19 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158327 Feb 21 01:14:05.067277 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 306/645] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:04 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:05.352437 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-57fb5bd2-27c1-41e3-b392-f3bc1775994e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:05.353531 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-57fb5bd2-27c1-41e3-b392-f3bc1775994e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:05.359569 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57fb5bd2-27c1-41e3-b392-f3bc1775994e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:05.360062 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57fb5bd2-27c1-41e3-b392-f3bc1775994e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:05.360839 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57fb5bd2-27c1-41e3-b392-f3bc1775994e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:05.361269 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57fb5bd2-27c1-41e3-b392-f3bc1775994e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:05.421700 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-57fb5bd2-27c1-41e3-b392-f3bc1775994e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:05.429167 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-57fb5bd2-27c1-41e3-b392-f3bc1775994e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080348 Feb 21 01:14:05.429722 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 340/646] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:05 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:05.662242 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:14:05.662468 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:14:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:14:05.755418 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0a5b6f7d-763a-42c6-a69b-3318565c5022 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:05.756361 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0a5b6f7d-763a-42c6-a69b-3318565c5022 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:05.762825 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0a5b6f7d-763a-42c6-a69b-3318565c5022 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:05.763274 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0a5b6f7d-763a-42c6-a69b-3318565c5022 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:05.764086 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0a5b6f7d-763a-42c6-a69b-3318565c5022 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:05.764520 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0a5b6f7d-763a-42c6-a69b-3318565c5022 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:05.795532 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0a5b6f7d-763a-42c6-a69b-3318565c5022 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043897 Feb 21 01:14:05.796188 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 307/647] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:05 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:06.085906 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a460b2e8-39e6-48af-acb2-36ccb959be81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:06.086516 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a460b2e8-39e6-48af-acb2-36ccb959be81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:06.092973 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a460b2e8-39e6-48af-acb2-36ccb959be81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:06.093415 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a460b2e8-39e6-48af-acb2-36ccb959be81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:06.094415 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a460b2e8-39e6-48af-acb2-36ccb959be81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:06.094942 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a460b2e8-39e6-48af-acb2-36ccb959be81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:06.225160 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a460b2e8-39e6-48af-acb2-36ccb959be81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:06.233924 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a460b2e8-39e6-48af-acb2-36ccb959be81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:06.235553 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a460b2e8-39e6-48af-acb2-36ccb959be81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:06.236732 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a460b2e8-39e6-48af-acb2-36ccb959be81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.154546 Feb 21 01:14:06.237283 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 341/648] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:06 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:06.446171 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-de7ce2f4-a093-4adb-8fde-81ba534df87a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:06.447082 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-de7ce2f4-a093-4adb-8fde-81ba534df87a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:06.453645 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-de7ce2f4-a093-4adb-8fde-81ba534df87a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:06.454095 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-de7ce2f4-a093-4adb-8fde-81ba534df87a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:06.454889 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-de7ce2f4-a093-4adb-8fde-81ba534df87a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:06.455328 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-de7ce2f4-a093-4adb-8fde-81ba534df87a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:06.515653 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-de7ce2f4-a093-4adb-8fde-81ba534df87a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:06.523001 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-de7ce2f4-a093-4adb-8fde-81ba534df87a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080519 Feb 21 01:14:06.523567 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 308/649] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:06 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:06.807229 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b78d2334-2640-494b-84e3-d63ad5e722f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:06.808114 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b78d2334-2640-494b-84e3-d63ad5e722f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:06.813906 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b78d2334-2640-494b-84e3-d63ad5e722f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:06.814345 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b78d2334-2640-494b-84e3-d63ad5e722f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:06.815109 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b78d2334-2640-494b-84e3-d63ad5e722f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:06.815537 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b78d2334-2640-494b-84e3-d63ad5e722f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:06.845246 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b78d2334-2640-494b-84e3-d63ad5e722f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041967 Feb 21 01:14:06.845802 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 342/650] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:06 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:07.254855 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-75af3788-3541-4c35-a745-65867a06b751 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:07.255476 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-75af3788-3541-4c35-a745-65867a06b751 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:07.262215 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-75af3788-3541-4c35-a745-65867a06b751 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:07.262671 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-75af3788-3541-4c35-a745-65867a06b751 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:07.263485 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-75af3788-3541-4c35-a745-65867a06b751 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:07.263957 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-75af3788-3541-4c35-a745-65867a06b751 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:07.399987 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-75af3788-3541-4c35-a745-65867a06b751 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:07.408570 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-75af3788-3541-4c35-a745-65867a06b751 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:07.410056 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-75af3788-3541-4c35-a745-65867a06b751 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:07.411207 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-75af3788-3541-4c35-a745-65867a06b751 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160069 Feb 21 01:14:07.411751 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 309/651] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:07 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:07.541536 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-842b5eca-4903-4aa4-a1a4-ded09dd13286 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:07.542085 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-842b5eca-4903-4aa4-a1a4-ded09dd13286 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:07.548253 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-842b5eca-4903-4aa4-a1a4-ded09dd13286 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:07.548704 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-842b5eca-4903-4aa4-a1a4-ded09dd13286 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:07.549485 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-842b5eca-4903-4aa4-a1a4-ded09dd13286 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:07.549917 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-842b5eca-4903-4aa4-a1a4-ded09dd13286 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:07.665940 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-842b5eca-4903-4aa4-a1a4-ded09dd13286 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:07.673368 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-842b5eca-4903-4aa4-a1a4-ded09dd13286 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.136546 Feb 21 01:14:07.673921 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 343/652] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:07 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:07.857358 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-185edbf6-ab30-48fa-a73f-d978963b858d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:07.858270 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-185edbf6-ab30-48fa-a73f-d978963b858d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:07.864537 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-185edbf6-ab30-48fa-a73f-d978963b858d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:07.864980 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-185edbf6-ab30-48fa-a73f-d978963b858d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:07.865752 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-185edbf6-ab30-48fa-a73f-d978963b858d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:07.866180 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-185edbf6-ab30-48fa-a73f-d978963b858d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:07.896721 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-185edbf6-ab30-48fa-a73f-d978963b858d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043807 Feb 21 01:14:07.897277 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 310/653] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:07 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:08.429866 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-caf28c7a-5f80-44ac-9f70-85057e9bb572 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:08.430525 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-caf28c7a-5f80-44ac-9f70-85057e9bb572 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:08.437280 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-caf28c7a-5f80-44ac-9f70-85057e9bb572 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:08.437730 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-caf28c7a-5f80-44ac-9f70-85057e9bb572 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:08.438511 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-caf28c7a-5f80-44ac-9f70-85057e9bb572 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:08.438942 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-caf28c7a-5f80-44ac-9f70-85057e9bb572 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:08.570223 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-caf28c7a-5f80-44ac-9f70-85057e9bb572 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:08.578701 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-caf28c7a-5f80-44ac-9f70-85057e9bb572 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:08.580253 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-caf28c7a-5f80-44ac-9f70-85057e9bb572 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:08.582885 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-caf28c7a-5f80-44ac-9f70-85057e9bb572 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155276 Feb 21 01:14:08.582885 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 344/654] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:08 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:08.689703 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2ced7e1a-35ae-4457-9368-077dd470da1c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:08.690226 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2ced7e1a-35ae-4457-9368-077dd470da1c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:08.696119 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2ced7e1a-35ae-4457-9368-077dd470da1c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:08.696700 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2ced7e1a-35ae-4457-9368-077dd470da1c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:08.697783 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2ced7e1a-35ae-4457-9368-077dd470da1c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:08.698219 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2ced7e1a-35ae-4457-9368-077dd470da1c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:08.807007 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2ced7e1a-35ae-4457-9368-077dd470da1c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:08.814392 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2ced7e1a-35ae-4457-9368-077dd470da1c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.128395 Feb 21 01:14:08.814947 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 311/655] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:08 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:08.908784 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5821db54-5199-4c66-9fae-8b805199f232 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:08.909705 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5821db54-5199-4c66-9fae-8b805199f232 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:08.916189 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5821db54-5199-4c66-9fae-8b805199f232 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:08.916631 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5821db54-5199-4c66-9fae-8b805199f232 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:08.917423 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5821db54-5199-4c66-9fae-8b805199f232 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:08.917863 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5821db54-5199-4c66-9fae-8b805199f232 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:08.946897 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5821db54-5199-4c66-9fae-8b805199f232 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041662 Feb 21 01:14:08.947899 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 345/656] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:08 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:09.600651 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b59146ce-d3cb-4f6e-b9fa-f07dddb32bab tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:09.601197 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b59146ce-d3cb-4f6e-b9fa-f07dddb32bab tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:09.607522 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b59146ce-d3cb-4f6e-b9fa-f07dddb32bab tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:09.607996 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b59146ce-d3cb-4f6e-b9fa-f07dddb32bab tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:09.608768 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b59146ce-d3cb-4f6e-b9fa-f07dddb32bab tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:09.609197 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b59146ce-d3cb-4f6e-b9fa-f07dddb32bab tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:09.742778 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b59146ce-d3cb-4f6e-b9fa-f07dddb32bab tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:09.751391 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b59146ce-d3cb-4f6e-b9fa-f07dddb32bab tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:09.752886 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b59146ce-d3cb-4f6e-b9fa-f07dddb32bab tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:09.754022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b59146ce-d3cb-4f6e-b9fa-f07dddb32bab tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157145 Feb 21 01:14:09.754567 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 312/657] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:09 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:09.830079 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ac84052f-0c55-412e-b502-482865e6e753 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:09.830691 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ac84052f-0c55-412e-b502-482865e6e753 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:09.837673 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ac84052f-0c55-412e-b502-482865e6e753 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:09.838139 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ac84052f-0c55-412e-b502-482865e6e753 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:09.839200 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ac84052f-0c55-412e-b502-482865e6e753 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:09.839639 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ac84052f-0c55-412e-b502-482865e6e753 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:09.902540 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ac84052f-0c55-412e-b502-482865e6e753 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:09.910076 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ac84052f-0c55-412e-b502-482865e6e753 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083539 Feb 21 01:14:09.910634 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 346/658] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:09 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:09.958371 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-51967fdb-a47e-4043-8cc9-36381b829f2a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:09.959321 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-51967fdb-a47e-4043-8cc9-36381b829f2a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:09.965715 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51967fdb-a47e-4043-8cc9-36381b829f2a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:09.966160 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51967fdb-a47e-4043-8cc9-36381b829f2a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:09.966941 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51967fdb-a47e-4043-8cc9-36381b829f2a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:09.967372 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51967fdb-a47e-4043-8cc9-36381b829f2a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:09.981328 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:14:09.983602 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:14:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments (ip 10.222.0.91) !!! Feb 21 01:14:10.000481 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-51967fdb-a47e-4043-8cc9-36381b829f2a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045819 Feb 21 01:14:10.001066 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 313/659] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:09 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:10.771922 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8cf71872-9534-4cb6-b0cd-409496b6f01c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:10.772535 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8cf71872-9534-4cb6-b0cd-409496b6f01c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:10.779856 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8cf71872-9534-4cb6-b0cd-409496b6f01c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:10.780317 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8cf71872-9534-4cb6-b0cd-409496b6f01c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:10.781098 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8cf71872-9534-4cb6-b0cd-409496b6f01c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:10.781534 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8cf71872-9534-4cb6-b0cd-409496b6f01c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:10.927543 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3277b4bb-fd68-47d5-85c0-afd21ad648de tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:10.928179 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3277b4bb-fd68-47d5-85c0-afd21ad648de tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:10.935551 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3277b4bb-fd68-47d5-85c0-afd21ad648de tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:10.936032 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3277b4bb-fd68-47d5-85c0-afd21ad648de tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:10.936831 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3277b4bb-fd68-47d5-85c0-afd21ad648de tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:10.937264 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3277b4bb-fd68-47d5-85c0-afd21ad648de tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:11.005029 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3277b4bb-fd68-47d5-85c0-afd21ad648de tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:11.013715 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3277b4bb-fd68-47d5-85c0-afd21ad648de tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.089746 Feb 21 01:14:11.022864 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 314/660] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:10 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:14:11.027119 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1417f013-5f83-45ec-9afa-ee8e1facef6b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:11.028230 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1417f013-5f83-45ec-9afa-ee8e1facef6b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:11.034599 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1417f013-5f83-45ec-9afa-ee8e1facef6b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:11.035043 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1417f013-5f83-45ec-9afa-ee8e1facef6b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:11.035855 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1417f013-5f83-45ec-9afa-ee8e1facef6b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:11.036320 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1417f013-5f83-45ec-9afa-ee8e1facef6b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:11.067606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1417f013-5f83-45ec-9afa-ee8e1facef6b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051868 Feb 21 01:14:11.068424 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 315/661] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:11 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:11.143783 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8cf71872-9534-4cb6-b0cd-409496b6f01c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:11.152755 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8cf71872-9534-4cb6-b0cd-409496b6f01c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:11.154246 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8cf71872-9534-4cb6-b0cd-409496b6f01c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:11.155392 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8cf71872-9534-4cb6-b0cd-409496b6f01c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.387330 Feb 21 01:14:11.155975 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 347/662] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:10 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:12.030371 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b92f930b-1d70-468c-8c17-9b9aaeac424a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:12.030977 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b92f930b-1d70-468c-8c17-9b9aaeac424a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:12.037443 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b92f930b-1d70-468c-8c17-9b9aaeac424a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:12.037887 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b92f930b-1d70-468c-8c17-9b9aaeac424a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:12.038657 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b92f930b-1d70-468c-8c17-9b9aaeac424a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:12.039087 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b92f930b-1d70-468c-8c17-9b9aaeac424a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:12.079564 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c751159a-773c-4116-9d75-cccb3af633c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:12.080550 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c751159a-773c-4116-9d75-cccb3af633c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:12.086903 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c751159a-773c-4116-9d75-cccb3af633c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:12.087578 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c751159a-773c-4116-9d75-cccb3af633c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:12.088542 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c751159a-773c-4116-9d75-cccb3af633c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:12.088988 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c751159a-773c-4116-9d75-cccb3af633c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:12.104570 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b92f930b-1d70-468c-8c17-9b9aaeac424a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:12.111982 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b92f930b-1d70-468c-8c17-9b9aaeac424a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.085236 Feb 21 01:14:12.112551 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 316/663] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:12 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:12.121392 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c751159a-773c-4116-9d75-cccb3af633c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045558 Feb 21 01:14:12.121958 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 348/664] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:12 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:14:12.174335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ce9ac032-20f0-496e-b220-85ed77c14355 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:12.174864 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ce9ac032-20f0-496e-b220-85ed77c14355 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:12.181611 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ce9ac032-20f0-496e-b220-85ed77c14355 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:12.182058 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ce9ac032-20f0-496e-b220-85ed77c14355 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:12.182839 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ce9ac032-20f0-496e-b220-85ed77c14355 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:12.183263 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ce9ac032-20f0-496e-b220-85ed77c14355 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:12.315692 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ce9ac032-20f0-496e-b220-85ed77c14355 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:12.324259 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ce9ac032-20f0-496e-b220-85ed77c14355 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:12.325759 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ce9ac032-20f0-496e-b220-85ed77c14355 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:12.326945 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ce9ac032-20f0-496e-b220-85ed77c14355 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156394 Feb 21 01:14:12.327502 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 317/665] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:12 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:14:13.129489 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-121c29ff-8dea-43db-b458-862642f8178f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:13.130120 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-121c29ff-8dea-43db-b458-862642f8178f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:13.132862 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-80c5649b-ee67-4395-8ca8-9924633f6b19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:13.134472 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-80c5649b-ee67-4395-8ca8-9924633f6b19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:13.138100 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-121c29ff-8dea-43db-b458-862642f8178f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:13.138688 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-121c29ff-8dea-43db-b458-862642f8178f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:13.139485 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-121c29ff-8dea-43db-b458-862642f8178f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:13.139937 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-121c29ff-8dea-43db-b458-862642f8178f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:13.140847 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-80c5649b-ee67-4395-8ca8-9924633f6b19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:13.141308 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-80c5649b-ee67-4395-8ca8-9924633f6b19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:13.142088 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-80c5649b-ee67-4395-8ca8-9924633f6b19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:13.142534 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-80c5649b-ee67-4395-8ca8-9924633f6b19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:13.174557 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-80c5649b-ee67-4395-8ca8-9924633f6b19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045160 Feb 21 01:14:13.178283 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 318/666] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:13 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:13.206904 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-121c29ff-8dea-43db-b458-862642f8178f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:13.214357 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-121c29ff-8dea-43db-b458-862642f8178f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.088717 Feb 21 01:14:13.214913 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 349/667] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:13 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:13.345856 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2e05efed-4cd3-45c7-a822-9f1c3ed72611 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:13.346504 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2e05efed-4cd3-45c7-a822-9f1c3ed72611 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:13.352550 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2e05efed-4cd3-45c7-a822-9f1c3ed72611 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:13.353011 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2e05efed-4cd3-45c7-a822-9f1c3ed72611 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:13.353816 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2e05efed-4cd3-45c7-a822-9f1c3ed72611 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:13.354248 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2e05efed-4cd3-45c7-a822-9f1c3ed72611 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:13.489306 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2e05efed-4cd3-45c7-a822-9f1c3ed72611 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:13.498086 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2e05efed-4cd3-45c7-a822-9f1c3ed72611 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:13.499565 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2e05efed-4cd3-45c7-a822-9f1c3ed72611 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:13.500732 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2e05efed-4cd3-45c7-a822-9f1c3ed72611 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158627 Feb 21 01:14:13.501286 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 319/668] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:13 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:14.231305 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4ae4d89b-a4ce-449d-b0e5-bc534ff4780d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:14.232009 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4ae4d89b-a4ce-449d-b0e5-bc534ff4780d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:14.238262 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ae4d89b-a4ce-449d-b0e5-bc534ff4780d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:14.238709 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ae4d89b-a4ce-449d-b0e5-bc534ff4780d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:14.239492 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ae4d89b-a4ce-449d-b0e5-bc534ff4780d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:14.239964 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ae4d89b-a4ce-449d-b0e5-bc534ff4780d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:14.287112 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8b2f0b7b-1ce7-4111-a343-26540f498fa4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:14.288116 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8b2f0b7b-1ce7-4111-a343-26540f498fa4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:14.294623 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8b2f0b7b-1ce7-4111-a343-26540f498fa4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:14.295066 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8b2f0b7b-1ce7-4111-a343-26540f498fa4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:14.295887 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8b2f0b7b-1ce7-4111-a343-26540f498fa4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:14.296325 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8b2f0b7b-1ce7-4111-a343-26540f498fa4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:14.303749 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4ae4d89b-a4ce-449d-b0e5-bc534ff4780d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:14.311850 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4ae4d89b-a4ce-449d-b0e5-bc534ff4780d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.085253 Feb 21 01:14:14.312425 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 320/669] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:14 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:14:14.325803 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8b2f0b7b-1ce7-4111-a343-26540f498fa4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143123 Feb 21 01:14:14.326345 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 350/670] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:14 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:14.518858 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2248df80-3035-4724-8413-b61a5334c201 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:14.519489 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2248df80-3035-4724-8413-b61a5334c201 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:14.525873 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2248df80-3035-4724-8413-b61a5334c201 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:14.526308 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2248df80-3035-4724-8413-b61a5334c201 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:14.527074 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2248df80-3035-4724-8413-b61a5334c201 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:14.527496 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2248df80-3035-4724-8413-b61a5334c201 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:14.659177 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2248df80-3035-4724-8413-b61a5334c201 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:14.668141 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2248df80-3035-4724-8413-b61a5334c201 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:14.669674 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2248df80-3035-4724-8413-b61a5334c201 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:14.670808 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2248df80-3035-4724-8413-b61a5334c201 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155751 Feb 21 01:14:14.671360 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 321/671] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:14 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:14:15.328288 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-779db35e-bce8-4a25-85e5-8a55920bc72c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:15.329006 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-779db35e-bce8-4a25-85e5-8a55920bc72c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:15.335559 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-779db35e-bce8-4a25-85e5-8a55920bc72c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:15.336043 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-779db35e-bce8-4a25-85e5-8a55920bc72c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:15.337286 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-681e3bb2-668d-4351-a549-57fd9ee8364f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:15.338080 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-779db35e-bce8-4a25-85e5-8a55920bc72c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:15.338234 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-681e3bb2-668d-4351-a549-57fd9ee8364f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:15.338536 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-779db35e-bce8-4a25-85e5-8a55920bc72c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:15.344651 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-681e3bb2-668d-4351-a549-57fd9ee8364f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:15.345100 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-681e3bb2-668d-4351-a549-57fd9ee8364f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:15.345894 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-681e3bb2-668d-4351-a549-57fd9ee8364f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:15.346427 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-681e3bb2-668d-4351-a549-57fd9ee8364f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:15.378578 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-681e3bb2-668d-4351-a549-57fd9ee8364f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045387 Feb 21 01:14:15.379153 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 322/672] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:15 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:14:15.401050 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-779db35e-bce8-4a25-85e5-8a55920bc72c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:15.409185 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-779db35e-bce8-4a25-85e5-8a55920bc72c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084475 Feb 21 01:14:15.409762 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 351/673] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:15 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:15.689141 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cedc8f9f-ec16-43ef-899e-54d3496fd629 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:15.689666 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cedc8f9f-ec16-43ef-899e-54d3496fd629 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:15.695525 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cedc8f9f-ec16-43ef-899e-54d3496fd629 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:15.696014 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cedc8f9f-ec16-43ef-899e-54d3496fd629 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:15.697821 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cedc8f9f-ec16-43ef-899e-54d3496fd629 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:15.698262 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cedc8f9f-ec16-43ef-899e-54d3496fd629 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:15.831327 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cedc8f9f-ec16-43ef-899e-54d3496fd629 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:15.840524 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cedc8f9f-ec16-43ef-899e-54d3496fd629 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:15.842025 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cedc8f9f-ec16-43ef-899e-54d3496fd629 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:15.843260 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cedc8f9f-ec16-43ef-899e-54d3496fd629 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157979 Feb 21 01:14:15.843734 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 323/674] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:15 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:16.390590 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1cf2cc03-ae49-4f17-9075-78d9ac779a8e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:16.391514 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1cf2cc03-ae49-4f17-9075-78d9ac779a8e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:16.397833 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1cf2cc03-ae49-4f17-9075-78d9ac779a8e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:16.398281 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1cf2cc03-ae49-4f17-9075-78d9ac779a8e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:16.399096 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1cf2cc03-ae49-4f17-9075-78d9ac779a8e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:16.399766 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1cf2cc03-ae49-4f17-9075-78d9ac779a8e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:16.426261 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ffddd4f2-8c04-4706-9971-eac0e300c67a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:16.427115 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ffddd4f2-8c04-4706-9971-eac0e300c67a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:16.430134 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1cf2cc03-ae49-4f17-9075-78d9ac779a8e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043347 Feb 21 01:14:16.431371 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 352/675] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:16 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:16.434251 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ffddd4f2-8c04-4706-9971-eac0e300c67a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:16.434699 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ffddd4f2-8c04-4706-9971-eac0e300c67a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:16.435488 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ffddd4f2-8c04-4706-9971-eac0e300c67a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:16.435946 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ffddd4f2-8c04-4706-9971-eac0e300c67a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:16.500183 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ffddd4f2-8c04-4706-9971-eac0e300c67a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:16.507401 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ffddd4f2-8c04-4706-9971-eac0e300c67a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084916 Feb 21 01:14:16.507970 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 324/676] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:16 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:14:16.861393 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5e7bacea-535c-4e63-ae27-f0ef55ba46b7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:16.862015 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5e7bacea-535c-4e63-ae27-f0ef55ba46b7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:16.867827 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5e7bacea-535c-4e63-ae27-f0ef55ba46b7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:16.868863 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5e7bacea-535c-4e63-ae27-f0ef55ba46b7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:16.869676 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5e7bacea-535c-4e63-ae27-f0ef55ba46b7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:16.870100 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5e7bacea-535c-4e63-ae27-f0ef55ba46b7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:17.005943 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5e7bacea-535c-4e63-ae27-f0ef55ba46b7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:17.014591 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5e7bacea-535c-4e63-ae27-f0ef55ba46b7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:17.016096 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5e7bacea-535c-4e63-ae27-f0ef55ba46b7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:17.017299 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5e7bacea-535c-4e63-ae27-f0ef55ba46b7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159612 Feb 21 01:14:17.017849 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 353/677] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:16 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:14:17.441993 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-06312b7a-4512-4cef-9344-ea86f15667ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:17.442975 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-06312b7a-4512-4cef-9344-ea86f15667ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:17.449934 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-06312b7a-4512-4cef-9344-ea86f15667ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:17.450384 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-06312b7a-4512-4cef-9344-ea86f15667ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:17.451172 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-06312b7a-4512-4cef-9344-ea86f15667ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:17.451609 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-06312b7a-4512-4cef-9344-ea86f15667ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:17.481093 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-06312b7a-4512-4cef-9344-ea86f15667ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043134 Feb 21 01:14:17.481651 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 325/678] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:17 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:14:17.524181 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-edf0752c-8cf3-4341-bb8c-fdaffdd9664a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:17.525315 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-edf0752c-8cf3-4341-bb8c-fdaffdd9664a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:17.531678 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-edf0752c-8cf3-4341-bb8c-fdaffdd9664a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:17.532409 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-edf0752c-8cf3-4341-bb8c-fdaffdd9664a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:17.533200 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-edf0752c-8cf3-4341-bb8c-fdaffdd9664a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:17.533633 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-edf0752c-8cf3-4341-bb8c-fdaffdd9664a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:17.593742 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-edf0752c-8cf3-4341-bb8c-fdaffdd9664a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:17.601055 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-edf0752c-8cf3-4341-bb8c-fdaffdd9664a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080626 Feb 21 01:14:17.601613 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 354/679] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:17 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:18.036155 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1e767da5-0c1b-4303-babd-e2a5d98aacc6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:18.036812 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1e767da5-0c1b-4303-babd-e2a5d98aacc6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:18.043193 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1e767da5-0c1b-4303-babd-e2a5d98aacc6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:18.043642 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1e767da5-0c1b-4303-babd-e2a5d98aacc6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:18.044457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1e767da5-0c1b-4303-babd-e2a5d98aacc6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:18.044891 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1e767da5-0c1b-4303-babd-e2a5d98aacc6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:18.176493 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1e767da5-0c1b-4303-babd-e2a5d98aacc6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:18.185901 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1e767da5-0c1b-4303-babd-e2a5d98aacc6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:18.188441 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1e767da5-0c1b-4303-babd-e2a5d98aacc6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:18.189653 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1e767da5-0c1b-4303-babd-e2a5d98aacc6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157573 Feb 21 01:14:18.190230 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 326/680] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:18 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:18.492633 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d8c2586f-5007-4ff1-9da9-9d3e11369043 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:18.493969 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d8c2586f-5007-4ff1-9da9-9d3e11369043 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:18.499925 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d8c2586f-5007-4ff1-9da9-9d3e11369043 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:18.500374 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d8c2586f-5007-4ff1-9da9-9d3e11369043 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:18.501162 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d8c2586f-5007-4ff1-9da9-9d3e11369043 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:18.501594 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d8c2586f-5007-4ff1-9da9-9d3e11369043 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:18.532067 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d8c2586f-5007-4ff1-9da9-9d3e11369043 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042892 Feb 21 01:14:18.532866 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 355/681] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:18 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:18.619448 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d89e9cc5-3379-4812-8534-94822e92051c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:18.620061 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d89e9cc5-3379-4812-8534-94822e92051c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:18.626457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d89e9cc5-3379-4812-8534-94822e92051c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:18.626908 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d89e9cc5-3379-4812-8534-94822e92051c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:18.627697 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d89e9cc5-3379-4812-8534-94822e92051c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:18.628178 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d89e9cc5-3379-4812-8534-94822e92051c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:18.690136 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d89e9cc5-3379-4812-8534-94822e92051c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:18.698256 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d89e9cc5-3379-4812-8534-94822e92051c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083031 Feb 21 01:14:18.698818 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 327/682] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:18 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:14:19.207633 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-56db13f7-5659-4db4-90ff-33d172ffe38e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:19.219476 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-56db13f7-5659-4db4-90ff-33d172ffe38e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:19.219476 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-56db13f7-5659-4db4-90ff-33d172ffe38e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:19.219476 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-56db13f7-5659-4db4-90ff-33d172ffe38e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:19.219476 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-56db13f7-5659-4db4-90ff-33d172ffe38e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:19.219893 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-56db13f7-5659-4db4-90ff-33d172ffe38e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:19.351654 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-56db13f7-5659-4db4-90ff-33d172ffe38e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:19.360178 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-56db13f7-5659-4db4-90ff-33d172ffe38e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:19.361661 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-56db13f7-5659-4db4-90ff-33d172ffe38e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:19.362799 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-56db13f7-5659-4db4-90ff-33d172ffe38e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158874 Feb 21 01:14:19.363342 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 356/683] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:19 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:19.543966 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e381c859-0e3a-4824-bf45-39b5537387fb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:19.544890 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e381c859-0e3a-4824-bf45-39b5537387fb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:19.550739 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e381c859-0e3a-4824-bf45-39b5537387fb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:19.551187 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e381c859-0e3a-4824-bf45-39b5537387fb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:19.552012 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e381c859-0e3a-4824-bf45-39b5537387fb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:19.552453 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e381c859-0e3a-4824-bf45-39b5537387fb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:19.581052 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e381c859-0e3a-4824-bf45-39b5537387fb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041513 Feb 21 01:14:19.581616 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 328/684] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:19 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:19.715488 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c7455893-73f9-4f1b-9bd4-fd488bb8772b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:19.716123 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c7455893-73f9-4f1b-9bd4-fd488bb8772b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:19.722185 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c7455893-73f9-4f1b-9bd4-fd488bb8772b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:19.722638 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c7455893-73f9-4f1b-9bd4-fd488bb8772b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:19.723420 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c7455893-73f9-4f1b-9bd4-fd488bb8772b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:19.723911 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c7455893-73f9-4f1b-9bd4-fd488bb8772b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:19.784935 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c7455893-73f9-4f1b-9bd4-fd488bb8772b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:19.792328 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c7455893-73f9-4f1b-9bd4-fd488bb8772b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081163 Feb 21 01:14:19.792891 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 357/685] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:19 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:20.381801 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3316f2d1-0202-49b1-a36e-64cd0283a292 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:20.382403 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3316f2d1-0202-49b1-a36e-64cd0283a292 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:20.388801 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3316f2d1-0202-49b1-a36e-64cd0283a292 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:20.389249 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3316f2d1-0202-49b1-a36e-64cd0283a292 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:20.390030 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3316f2d1-0202-49b1-a36e-64cd0283a292 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:20.390464 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3316f2d1-0202-49b1-a36e-64cd0283a292 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:20.528828 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3316f2d1-0202-49b1-a36e-64cd0283a292 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:20.537136 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3316f2d1-0202-49b1-a36e-64cd0283a292 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:20.538611 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3316f2d1-0202-49b1-a36e-64cd0283a292 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:20.539750 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3316f2d1-0202-49b1-a36e-64cd0283a292 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.161706 Feb 21 01:14:20.540986 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 329/686] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:20 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:20.592441 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-db5cbc7b-3001-44f4-882a-a1394e612383 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:20.593348 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-db5cbc7b-3001-44f4-882a-a1394e612383 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:20.599482 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db5cbc7b-3001-44f4-882a-a1394e612383 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:20.599948 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db5cbc7b-3001-44f4-882a-a1394e612383 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:20.600718 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db5cbc7b-3001-44f4-882a-a1394e612383 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:20.601143 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db5cbc7b-3001-44f4-882a-a1394e612383 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:20.631331 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-db5cbc7b-3001-44f4-882a-a1394e612383 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042406 Feb 21 01:14:20.631795 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 358/687] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:20 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:20.808687 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-049c65fe-4e38-4748-8ba4-ae64d654a59a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:20.809335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-049c65fe-4e38-4748-8ba4-ae64d654a59a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:20.815207 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-049c65fe-4e38-4748-8ba4-ae64d654a59a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:20.815653 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-049c65fe-4e38-4748-8ba4-ae64d654a59a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:20.816468 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-049c65fe-4e38-4748-8ba4-ae64d654a59a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:20.816899 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-049c65fe-4e38-4748-8ba4-ae64d654a59a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:20.875339 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-049c65fe-4e38-4748-8ba4-ae64d654a59a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:20.882683 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-049c65fe-4e38-4748-8ba4-ae64d654a59a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.077667 Feb 21 01:14:20.883189 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 330/688] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:20 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:21.558790 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-61b044ef-a03e-4493-baa3-fd0926a3e4c1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:21.559336 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-61b044ef-a03e-4493-baa3-fd0926a3e4c1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:21.565263 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-61b044ef-a03e-4493-baa3-fd0926a3e4c1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:21.565709 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-61b044ef-a03e-4493-baa3-fd0926a3e4c1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:21.566479 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-61b044ef-a03e-4493-baa3-fd0926a3e4c1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:21.566909 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-61b044ef-a03e-4493-baa3-fd0926a3e4c1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:21.643249 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-73870823-0343-4a1d-a820-30f96017b0f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:21.644281 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-73870823-0343-4a1d-a820-30f96017b0f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:21.651727 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-73870823-0343-4a1d-a820-30f96017b0f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:21.652208 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-73870823-0343-4a1d-a820-30f96017b0f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:21.653340 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-73870823-0343-4a1d-a820-30f96017b0f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:21.653446 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-73870823-0343-4a1d-a820-30f96017b0f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:21.684439 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-73870823-0343-4a1d-a820-30f96017b0f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045344 Feb 21 01:14:21.685014 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 331/689] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:21 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:21.708384 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-61b044ef-a03e-4493-baa3-fd0926a3e4c1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:21.713814 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-61b044ef-a03e-4493-baa3-fd0926a3e4c1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:21.715318 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-61b044ef-a03e-4493-baa3-fd0926a3e4c1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:21.716523 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-61b044ef-a03e-4493-baa3-fd0926a3e4c1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.161577 Feb 21 01:14:21.717080 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 359/690] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:21 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:21.899176 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5a59b454-03d4-4bb8-8238-0491ef758592 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:21.900382 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5a59b454-03d4-4bb8-8238-0491ef758592 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:21.906227 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5a59b454-03d4-4bb8-8238-0491ef758592 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:21.906674 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5a59b454-03d4-4bb8-8238-0491ef758592 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:21.907708 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5a59b454-03d4-4bb8-8238-0491ef758592 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:21.908177 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5a59b454-03d4-4bb8-8238-0491ef758592 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:21.970940 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5a59b454-03d4-4bb8-8238-0491ef758592 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:21.979982 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5a59b454-03d4-4bb8-8238-0491ef758592 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084530 Feb 21 01:14:21.980566 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 332/691] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:21 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:22.696444 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9cd39efc-b974-42df-8676-daa7eaeb15c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:22.697528 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9cd39efc-b974-42df-8676-daa7eaeb15c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:22.704472 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9cd39efc-b974-42df-8676-daa7eaeb15c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:22.704911 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9cd39efc-b974-42df-8676-daa7eaeb15c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:22.705706 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9cd39efc-b974-42df-8676-daa7eaeb15c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:22.706137 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9cd39efc-b974-42df-8676-daa7eaeb15c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:22.736187 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-67557703-416f-42f0-9e9a-36c1e4bc2b33 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:22.736944 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-67557703-416f-42f0-9e9a-36c1e4bc2b33 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:22.738489 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9cd39efc-b974-42df-8676-daa7eaeb15c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046106 Feb 21 01:14:22.739075 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 360/692] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:22 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:22.744173 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-67557703-416f-42f0-9e9a-36c1e4bc2b33 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:22.744863 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-67557703-416f-42f0-9e9a-36c1e4bc2b33 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:22.745685 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-67557703-416f-42f0-9e9a-36c1e4bc2b33 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:22.746124 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-67557703-416f-42f0-9e9a-36c1e4bc2b33 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:22.912449 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-67557703-416f-42f0-9e9a-36c1e4bc2b33 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:22.924235 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-67557703-416f-42f0-9e9a-36c1e4bc2b33 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:22.925712 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-67557703-416f-42f0-9e9a-36c1e4bc2b33 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:22.926882 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-67557703-416f-42f0-9e9a-36c1e4bc2b33 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.195225 Feb 21 01:14:22.927448 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 333/693] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:22 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:14:22.996840 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f6bdfe08-f64f-4315-815b-8e8551943149 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:22.997463 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f6bdfe08-f64f-4315-815b-8e8551943149 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:23.003734 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f6bdfe08-f64f-4315-815b-8e8551943149 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:23.004235 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f6bdfe08-f64f-4315-815b-8e8551943149 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:23.005065 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f6bdfe08-f64f-4315-815b-8e8551943149 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:23.005550 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f6bdfe08-f64f-4315-815b-8e8551943149 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:23.068860 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f6bdfe08-f64f-4315-815b-8e8551943149 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:23.076903 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f6bdfe08-f64f-4315-815b-8e8551943149 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084484 Feb 21 01:14:23.077475 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 361/694] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:22 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:23.750796 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5528a915-e3e9-4099-bd5b-75486d019b96 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:23.751785 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5528a915-e3e9-4099-bd5b-75486d019b96 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:23.758123 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5528a915-e3e9-4099-bd5b-75486d019b96 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:23.759217 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5528a915-e3e9-4099-bd5b-75486d019b96 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:23.760451 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5528a915-e3e9-4099-bd5b-75486d019b96 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:23.760894 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5528a915-e3e9-4099-bd5b-75486d019b96 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:23.792580 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5528a915-e3e9-4099-bd5b-75486d019b96 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045550 Feb 21 01:14:23.793155 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 334/695] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:23 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:23.945753 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-16eb4820-73c1-4adb-8710-f459e6ccb22f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:23.946934 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-16eb4820-73c1-4adb-8710-f459e6ccb22f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:23.953362 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-16eb4820-73c1-4adb-8710-f459e6ccb22f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:23.953810 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-16eb4820-73c1-4adb-8710-f459e6ccb22f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:23.954692 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-16eb4820-73c1-4adb-8710-f459e6ccb22f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:23.955133 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-16eb4820-73c1-4adb-8710-f459e6ccb22f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:24.095067 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5333594b-4b2a-4f05-8730-460a7ff67dbf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:24.095969 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5333594b-4b2a-4f05-8730-460a7ff67dbf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:24.103500 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5333594b-4b2a-4f05-8730-460a7ff67dbf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:24.103500 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5333594b-4b2a-4f05-8730-460a7ff67dbf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:24.104140 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-16eb4820-73c1-4adb-8710-f459e6ccb22f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:24.104336 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5333594b-4b2a-4f05-8730-460a7ff67dbf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:24.104764 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5333594b-4b2a-4f05-8730-460a7ff67dbf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:24.113371 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-16eb4820-73c1-4adb-8710-f459e6ccb22f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:24.114858 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-16eb4820-73c1-4adb-8710-f459e6ccb22f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:24.116185 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-16eb4820-73c1-4adb-8710-f459e6ccb22f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.174126 Feb 21 01:14:24.116835 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 362/696] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:23 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:24.172332 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5333594b-4b2a-4f05-8730-460a7ff67dbf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:24.180340 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5333594b-4b2a-4f05-8730-460a7ff67dbf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.089836 Feb 21 01:14:24.181103 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 335/697] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:24 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:14:24.804464 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3879bc0a-4966-4818-9a7f-e8df1ce9dd60 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:24.805430 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3879bc0a-4966-4818-9a7f-e8df1ce9dd60 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:24.812258 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3879bc0a-4966-4818-9a7f-e8df1ce9dd60 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:24.812708 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3879bc0a-4966-4818-9a7f-e8df1ce9dd60 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:24.813502 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3879bc0a-4966-4818-9a7f-e8df1ce9dd60 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:24.813944 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3879bc0a-4966-4818-9a7f-e8df1ce9dd60 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:24.845479 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3879bc0a-4966-4818-9a7f-e8df1ce9dd60 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044752 Feb 21 01:14:24.846047 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 363/698] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:24 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:25.135293 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5653f535-c79b-4ef2-9f20-eb3f4f1a49c3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:25.135909 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5653f535-c79b-4ef2-9f20-eb3f4f1a49c3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:25.142342 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5653f535-c79b-4ef2-9f20-eb3f4f1a49c3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:25.142781 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5653f535-c79b-4ef2-9f20-eb3f4f1a49c3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:25.143564 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5653f535-c79b-4ef2-9f20-eb3f4f1a49c3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:25.144016 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5653f535-c79b-4ef2-9f20-eb3f4f1a49c3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:25.198435 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a97cab2f-5bc6-4f81-b47c-cb5287bfc4eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:25.199044 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a97cab2f-5bc6-4f81-b47c-cb5287bfc4eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:25.205565 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a97cab2f-5bc6-4f81-b47c-cb5287bfc4eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:25.206442 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a97cab2f-5bc6-4f81-b47c-cb5287bfc4eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:25.206837 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a97cab2f-5bc6-4f81-b47c-cb5287bfc4eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:25.207266 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a97cab2f-5bc6-4f81-b47c-cb5287bfc4eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:25.273082 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a97cab2f-5bc6-4f81-b47c-cb5287bfc4eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:25.281185 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5653f535-c79b-4ef2-9f20-eb3f4f1a49c3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:25.282938 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a97cab2f-5bc6-4f81-b47c-cb5287bfc4eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.088074 Feb 21 01:14:25.283783 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 364/699] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:25 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:14:25.290942 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5653f535-c79b-4ef2-9f20-eb3f4f1a49c3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:25.292558 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5653f535-c79b-4ef2-9f20-eb3f4f1a49c3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:25.293725 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5653f535-c79b-4ef2-9f20-eb3f4f1a49c3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.162851 Feb 21 01:14:25.294297 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 336/700] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:25 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:25.857438 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0fd81b45-447f-4ea6-a395-872de76caa32 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:25.858356 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0fd81b45-447f-4ea6-a395-872de76caa32 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:25.864266 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0fd81b45-447f-4ea6-a395-872de76caa32 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:25.864715 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0fd81b45-447f-4ea6-a395-872de76caa32 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:25.865526 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0fd81b45-447f-4ea6-a395-872de76caa32 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:25.865957 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0fd81b45-447f-4ea6-a395-872de76caa32 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:25.897756 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0fd81b45-447f-4ea6-a395-872de76caa32 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044062 Feb 21 01:14:25.898322 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 365/701] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:25 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:26.299999 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-222ba7e9-b25c-4455-a027-d2d49b82e9a3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:26.300596 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-222ba7e9-b25c-4455-a027-d2d49b82e9a3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:26.307856 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-222ba7e9-b25c-4455-a027-d2d49b82e9a3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:26.308301 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-222ba7e9-b25c-4455-a027-d2d49b82e9a3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:26.309095 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-222ba7e9-b25c-4455-a027-d2d49b82e9a3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:26.309529 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-222ba7e9-b25c-4455-a027-d2d49b82e9a3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:26.313196 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f2e45927-bff8-4726-8f80-1f0ec5f4b4de tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:26.313813 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f2e45927-bff8-4726-8f80-1f0ec5f4b4de tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:26.320131 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f2e45927-bff8-4726-8f80-1f0ec5f4b4de tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:26.320580 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f2e45927-bff8-4726-8f80-1f0ec5f4b4de tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:26.321374 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f2e45927-bff8-4726-8f80-1f0ec5f4b4de tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:26.321853 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f2e45927-bff8-4726-8f80-1f0ec5f4b4de tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:26.370772 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-222ba7e9-b25c-4455-a027-d2d49b82e9a3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:26.378193 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-222ba7e9-b25c-4455-a027-d2d49b82e9a3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081851 Feb 21 01:14:26.378754 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 337/702] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:26 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:26.456188 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f2e45927-bff8-4726-8f80-1f0ec5f4b4de tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:26.464454 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f2e45927-bff8-4726-8f80-1f0ec5f4b4de tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:26.465941 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f2e45927-bff8-4726-8f80-1f0ec5f4b4de tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:26.467101 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f2e45927-bff8-4726-8f80-1f0ec5f4b4de tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157586 Feb 21 01:14:26.467651 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 366/703] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:26 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:26.908860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2c5288f8-3647-430d-b898-c798b5ba7b83 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:26.909778 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2c5288f8-3647-430d-b898-c798b5ba7b83 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:26.916032 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2c5288f8-3647-430d-b898-c798b5ba7b83 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:26.916657 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2c5288f8-3647-430d-b898-c798b5ba7b83 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:26.917459 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2c5288f8-3647-430d-b898-c798b5ba7b83 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:26.917946 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2c5288f8-3647-430d-b898-c798b5ba7b83 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:26.948659 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2c5288f8-3647-430d-b898-c798b5ba7b83 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043954 Feb 21 01:14:26.949217 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 338/704] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:26 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:27.394203 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fd3709b1-4059-4873-a346-f1b278ddcd73 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:27.394821 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fd3709b1-4059-4873-a346-f1b278ddcd73 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:27.401248 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fd3709b1-4059-4873-a346-f1b278ddcd73 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:27.401698 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fd3709b1-4059-4873-a346-f1b278ddcd73 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:27.402483 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fd3709b1-4059-4873-a346-f1b278ddcd73 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:27.402919 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fd3709b1-4059-4873-a346-f1b278ddcd73 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:27.464023 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fd3709b1-4059-4873-a346-f1b278ddcd73 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:27.471489 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-fd3709b1-4059-4873-a346-f1b278ddcd73 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080940 Feb 21 01:14:27.472077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 367/705] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:27 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:27.484771 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-68fe303a-ad0e-44ae-aa5c-af086a27ca21 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:27.485370 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-68fe303a-ad0e-44ae-aa5c-af086a27ca21 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:27.491512 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68fe303a-ad0e-44ae-aa5c-af086a27ca21 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:27.491993 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68fe303a-ad0e-44ae-aa5c-af086a27ca21 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:27.492759 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68fe303a-ad0e-44ae-aa5c-af086a27ca21 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:27.493182 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68fe303a-ad0e-44ae-aa5c-af086a27ca21 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:27.627076 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-68fe303a-ad0e-44ae-aa5c-af086a27ca21 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:27.635745 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-68fe303a-ad0e-44ae-aa5c-af086a27ca21 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:27.637276 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-68fe303a-ad0e-44ae-aa5c-af086a27ca21 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:27.638479 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-68fe303a-ad0e-44ae-aa5c-af086a27ca21 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157287 Feb 21 01:14:27.639025 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 339/706] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:27 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:27.960267 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-684f4313-5209-4a6c-ac64-e333304a6b5f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:27.961093 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-684f4313-5209-4a6c-ac64-e333304a6b5f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:27.967504 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-684f4313-5209-4a6c-ac64-e333304a6b5f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:27.967976 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-684f4313-5209-4a6c-ac64-e333304a6b5f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:27.968747 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-684f4313-5209-4a6c-ac64-e333304a6b5f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:27.969171 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-684f4313-5209-4a6c-ac64-e333304a6b5f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:27.997327 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-684f4313-5209-4a6c-ac64-e333304a6b5f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040812 Feb 21 01:14:27.997878 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 368/707] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:27 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:28.488166 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-bb2e033e-ed6b-4613-9775-5f5ba92383df tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:28.488774 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-bb2e033e-ed6b-4613-9775-5f5ba92383df tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:28.495769 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bb2e033e-ed6b-4613-9775-5f5ba92383df tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:28.496240 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bb2e033e-ed6b-4613-9775-5f5ba92383df tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:28.497016 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bb2e033e-ed6b-4613-9775-5f5ba92383df tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:28.497438 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bb2e033e-ed6b-4613-9775-5f5ba92383df tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:28.559004 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bb2e033e-ed6b-4613-9775-5f5ba92383df tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:28.566648 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-bb2e033e-ed6b-4613-9775-5f5ba92383df tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082247 Feb 21 01:14:28.567227 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 340/708] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:28 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:28.657664 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1fec9956-0f4a-4689-aec6-27c9a2901400 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:28.658233 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1fec9956-0f4a-4689-aec6-27c9a2901400 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:28.664670 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1fec9956-0f4a-4689-aec6-27c9a2901400 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:28.665124 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1fec9956-0f4a-4689-aec6-27c9a2901400 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:28.666418 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1fec9956-0f4a-4689-aec6-27c9a2901400 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:28.666916 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1fec9956-0f4a-4689-aec6-27c9a2901400 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:28.806664 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1fec9956-0f4a-4689-aec6-27c9a2901400 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:28.815196 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1fec9956-0f4a-4689-aec6-27c9a2901400 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:28.816738 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1fec9956-0f4a-4689-aec6-27c9a2901400 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:28.817879 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1fec9956-0f4a-4689-aec6-27c9a2901400 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.164736 Feb 21 01:14:28.818424 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 369/709] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:28 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:29.008739 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2617cba8-8526-45bd-8483-6d88ffb5bc6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:29.010110 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2617cba8-8526-45bd-8483-6d88ffb5bc6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:29.016075 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2617cba8-8526-45bd-8483-6d88ffb5bc6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:29.016527 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2617cba8-8526-45bd-8483-6d88ffb5bc6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:29.017369 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2617cba8-8526-45bd-8483-6d88ffb5bc6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:29.017768 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2617cba8-8526-45bd-8483-6d88ffb5bc6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:29.048982 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2617cba8-8526-45bd-8483-6d88ffb5bc6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043979 Feb 21 01:14:29.049552 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 341/710] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:29 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:29.584433 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-704c0a99-3e00-466e-8444-34a149f34fe5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:29.585041 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-704c0a99-3e00-466e-8444-34a149f34fe5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:29.592051 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-704c0a99-3e00-466e-8444-34a149f34fe5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:29.592488 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-704c0a99-3e00-466e-8444-34a149f34fe5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:29.593331 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-704c0a99-3e00-466e-8444-34a149f34fe5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:29.593791 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-704c0a99-3e00-466e-8444-34a149f34fe5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:29.680474 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-704c0a99-3e00-466e-8444-34a149f34fe5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:29.688782 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-704c0a99-3e00-466e-8444-34a149f34fe5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.108813 Feb 21 01:14:29.689366 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 370/711] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:29 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:29.836669 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2efade57-2e78-4d6d-9f50-b448ed742baf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:29.837749 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2efade57-2e78-4d6d-9f50-b448ed742baf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:29.845021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2efade57-2e78-4d6d-9f50-b448ed742baf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:29.845472 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2efade57-2e78-4d6d-9f50-b448ed742baf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:29.846680 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2efade57-2e78-4d6d-9f50-b448ed742baf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:29.847500 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2efade57-2e78-4d6d-9f50-b448ed742baf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:30.006395 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2efade57-2e78-4d6d-9f50-b448ed742baf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:30.016506 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2efade57-2e78-4d6d-9f50-b448ed742baf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:30.018032 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2efade57-2e78-4d6d-9f50-b448ed742baf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:30.019884 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2efade57-2e78-4d6d-9f50-b448ed742baf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.187356 Feb 21 01:14:30.020481 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 342/712] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:29 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:30.060678 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e26bbe92-bd4c-48ff-889c-1b9c66f6d54b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:30.061607 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e26bbe92-bd4c-48ff-889c-1b9c66f6d54b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:30.067967 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e26bbe92-bd4c-48ff-889c-1b9c66f6d54b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:30.068417 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e26bbe92-bd4c-48ff-889c-1b9c66f6d54b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:30.069209 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e26bbe92-bd4c-48ff-889c-1b9c66f6d54b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:30.069645 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e26bbe92-bd4c-48ff-889c-1b9c66f6d54b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:30.107940 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e26bbe92-bd4c-48ff-889c-1b9c66f6d54b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051729 Feb 21 01:14:30.108423 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 371/713] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:30 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:30.706594 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-89870854-9291-4c78-bed5-70c8dcb61b23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:30.707111 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-89870854-9291-4c78-bed5-70c8dcb61b23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:30.713427 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-89870854-9291-4c78-bed5-70c8dcb61b23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:30.713871 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-89870854-9291-4c78-bed5-70c8dcb61b23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:30.714669 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-89870854-9291-4c78-bed5-70c8dcb61b23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:30.715093 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-89870854-9291-4c78-bed5-70c8dcb61b23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:30.777339 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-89870854-9291-4c78-bed5-70c8dcb61b23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:30.785019 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-89870854-9291-4c78-bed5-70c8dcb61b23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082283 Feb 21 01:14:30.785583 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 343/714] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:30 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:31.042803 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7de8702e-bbb8-4b4d-a898-271338551b4e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:31.043439 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7de8702e-bbb8-4b4d-a898-271338551b4e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:31.049855 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7de8702e-bbb8-4b4d-a898-271338551b4e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:31.050296 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7de8702e-bbb8-4b4d-a898-271338551b4e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:31.051074 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7de8702e-bbb8-4b4d-a898-271338551b4e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:31.051507 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7de8702e-bbb8-4b4d-a898-271338551b4e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:31.119335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ea9d9df1-f5ea-4415-964f-e06037864f7b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:31.120289 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ea9d9df1-f5ea-4415-964f-e06037864f7b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:31.126500 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ea9d9df1-f5ea-4415-964f-e06037864f7b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:31.126943 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ea9d9df1-f5ea-4415-964f-e06037864f7b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:31.128349 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ea9d9df1-f5ea-4415-964f-e06037864f7b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:31.128349 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ea9d9df1-f5ea-4415-964f-e06037864f7b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:31.158694 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ea9d9df1-f5ea-4415-964f-e06037864f7b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043726 Feb 21 01:14:31.159264 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 344/715] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:31 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:14:31.190200 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7de8702e-bbb8-4b4d-a898-271338551b4e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:31.199107 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7de8702e-bbb8-4b4d-a898-271338551b4e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:31.200971 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7de8702e-bbb8-4b4d-a898-271338551b4e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:31.201909 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7de8702e-bbb8-4b4d-a898-271338551b4e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.162867 Feb 21 01:14:31.202461 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 372/716] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:31 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:31.803905 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e4eebdd7-e77a-487c-9c86-c11f61d8cba2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:31.804614 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e4eebdd7-e77a-487c-9c86-c11f61d8cba2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:31.811930 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e4eebdd7-e77a-487c-9c86-c11f61d8cba2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:31.812388 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e4eebdd7-e77a-487c-9c86-c11f61d8cba2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:31.813215 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e4eebdd7-e77a-487c-9c86-c11f61d8cba2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:31.813657 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e4eebdd7-e77a-487c-9c86-c11f61d8cba2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:31.878528 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e4eebdd7-e77a-487c-9c86-c11f61d8cba2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:31.886978 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e4eebdd7-e77a-487c-9c86-c11f61d8cba2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.088710 Feb 21 01:14:31.887522 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 345/717] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:31 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:32.170732 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4eacf0bc-e733-432d-8eaa-353c04216155 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:32.171653 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4eacf0bc-e733-432d-8eaa-353c04216155 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:32.178141 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4eacf0bc-e733-432d-8eaa-353c04216155 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:32.178589 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4eacf0bc-e733-432d-8eaa-353c04216155 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:32.179379 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4eacf0bc-e733-432d-8eaa-353c04216155 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:32.179813 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4eacf0bc-e733-432d-8eaa-353c04216155 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:32.211591 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4eacf0bc-e733-432d-8eaa-353c04216155 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044564 Feb 21 01:14:32.212119 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 373/718] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:32 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:32.219510 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-608e4e78-36c0-4f63-9c0a-e50185c23d90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:32.220143 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-608e4e78-36c0-4f63-9c0a-e50185c23d90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:32.226880 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-608e4e78-36c0-4f63-9c0a-e50185c23d90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:32.227328 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-608e4e78-36c0-4f63-9c0a-e50185c23d90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:32.229513 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-608e4e78-36c0-4f63-9c0a-e50185c23d90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:32.229955 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-608e4e78-36c0-4f63-9c0a-e50185c23d90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:32.376602 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-608e4e78-36c0-4f63-9c0a-e50185c23d90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:32.386135 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-608e4e78-36c0-4f63-9c0a-e50185c23d90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:32.387640 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-608e4e78-36c0-4f63-9c0a-e50185c23d90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:32.388878 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-608e4e78-36c0-4f63-9c0a-e50185c23d90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.173214 Feb 21 01:14:32.389431 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 346/719] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:32 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:14:32.903802 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fc1f2a2b-225a-4ff9-8bfc-1fcb8b209719 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:32.904459 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fc1f2a2b-225a-4ff9-8bfc-1fcb8b209719 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:32.910740 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fc1f2a2b-225a-4ff9-8bfc-1fcb8b209719 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:32.911180 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fc1f2a2b-225a-4ff9-8bfc-1fcb8b209719 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:32.911992 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fc1f2a2b-225a-4ff9-8bfc-1fcb8b209719 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:32.912427 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fc1f2a2b-225a-4ff9-8bfc-1fcb8b209719 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:32.978952 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fc1f2a2b-225a-4ff9-8bfc-1fcb8b209719 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:32.986501 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-fc1f2a2b-225a-4ff9-8bfc-1fcb8b209719 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.086902 Feb 21 01:14:32.987095 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 374/720] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:32 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:33.225377 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-62f9cc11-3fb6-4642-af4d-67d0171e414b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:33.226380 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-62f9cc11-3fb6-4642-af4d-67d0171e414b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:33.233794 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-62f9cc11-3fb6-4642-af4d-67d0171e414b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:33.234238 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-62f9cc11-3fb6-4642-af4d-67d0171e414b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:33.235102 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-62f9cc11-3fb6-4642-af4d-67d0171e414b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:33.235564 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-62f9cc11-3fb6-4642-af4d-67d0171e414b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:33.267166 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-62f9cc11-3fb6-4642-af4d-67d0171e414b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047883 Feb 21 01:14:33.267780 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 347/721] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:33 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:33.407093 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6edba165-aaa4-44bd-972b-4fec5df9cdc9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:33.407726 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6edba165-aaa4-44bd-972b-4fec5df9cdc9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:33.414170 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6edba165-aaa4-44bd-972b-4fec5df9cdc9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:33.414611 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6edba165-aaa4-44bd-972b-4fec5df9cdc9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:33.416047 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6edba165-aaa4-44bd-972b-4fec5df9cdc9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:33.416490 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6edba165-aaa4-44bd-972b-4fec5df9cdc9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:33.555219 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-6edba165-aaa4-44bd-972b-4fec5df9cdc9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:33.564883 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-6edba165-aaa4-44bd-972b-4fec5df9cdc9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:33.566373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-6edba165-aaa4-44bd-972b-4fec5df9cdc9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:33.567528 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6edba165-aaa4-44bd-972b-4fec5df9cdc9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.164531 Feb 21 01:14:33.568131 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 375/722] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:33 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:34.003468 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-062872c0-cca9-43f5-ba89-48d3a656dced tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:34.004119 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-062872c0-cca9-43f5-ba89-48d3a656dced tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:34.011369 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-062872c0-cca9-43f5-ba89-48d3a656dced tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:34.011816 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-062872c0-cca9-43f5-ba89-48d3a656dced tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:34.012745 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-062872c0-cca9-43f5-ba89-48d3a656dced tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:34.013190 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-062872c0-cca9-43f5-ba89-48d3a656dced tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:34.075942 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-062872c0-cca9-43f5-ba89-48d3a656dced tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:34.084170 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-062872c0-cca9-43f5-ba89-48d3a656dced tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083989 Feb 21 01:14:34.084927 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 348/723] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:33 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:14:34.279238 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-caf82831-9061-424c-bbc2-facdddc1bdb7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:34.280097 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-caf82831-9061-424c-bbc2-facdddc1bdb7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:34.286670 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-caf82831-9061-424c-bbc2-facdddc1bdb7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:34.287120 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-caf82831-9061-424c-bbc2-facdddc1bdb7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:34.287935 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-caf82831-9061-424c-bbc2-facdddc1bdb7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:34.288372 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-caf82831-9061-424c-bbc2-facdddc1bdb7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:34.319432 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-caf82831-9061-424c-bbc2-facdddc1bdb7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044357 Feb 21 01:14:34.320026 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 376/724] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:34 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:34.586299 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a26a221c-1b96-493e-a42e-32c6b195108d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:34.586829 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a26a221c-1b96-493e-a42e-32c6b195108d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:34.593990 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a26a221c-1b96-493e-a42e-32c6b195108d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:34.594440 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a26a221c-1b96-493e-a42e-32c6b195108d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:34.595231 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a26a221c-1b96-493e-a42e-32c6b195108d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:34.595668 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a26a221c-1b96-493e-a42e-32c6b195108d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:34.748142 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a26a221c-1b96-493e-a42e-32c6b195108d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:34.756563 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a26a221c-1b96-493e-a42e-32c6b195108d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:34.758061 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a26a221c-1b96-493e-a42e-32c6b195108d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:34.759305 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a26a221c-1b96-493e-a42e-32c6b195108d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.176736 Feb 21 01:14:34.759895 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 349/725] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:34 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:35.102084 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c8540666-b398-4173-beff-2efa3704f319 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:35.102834 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c8540666-b398-4173-beff-2efa3704f319 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:35.110282 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c8540666-b398-4173-beff-2efa3704f319 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:35.110730 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c8540666-b398-4173-beff-2efa3704f319 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:35.111536 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c8540666-b398-4173-beff-2efa3704f319 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:35.112010 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c8540666-b398-4173-beff-2efa3704f319 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:35.179869 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c8540666-b398-4173-beff-2efa3704f319 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:35.188193 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c8540666-b398-4173-beff-2efa3704f319 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.089747 Feb 21 01:14:35.188773 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 377/726] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:35 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:35.333262 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-14e67bc5-8a35-4aef-a4b2-09a9f023cf96 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:35.334193 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-14e67bc5-8a35-4aef-a4b2-09a9f023cf96 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:35.340796 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-14e67bc5-8a35-4aef-a4b2-09a9f023cf96 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:35.341247 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-14e67bc5-8a35-4aef-a4b2-09a9f023cf96 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:35.342454 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-14e67bc5-8a35-4aef-a4b2-09a9f023cf96 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:35.343255 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-14e67bc5-8a35-4aef-a4b2-09a9f023cf96 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:35.377713 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-14e67bc5-8a35-4aef-a4b2-09a9f023cf96 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048826 Feb 21 01:14:35.378292 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 350/727] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:35 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:14:35.778920 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-57c737e0-160b-41c8-8aaa-637816009779 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:35.779517 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-57c737e0-160b-41c8-8aaa-637816009779 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:35.785791 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57c737e0-160b-41c8-8aaa-637816009779 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:35.786230 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57c737e0-160b-41c8-8aaa-637816009779 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:35.787016 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57c737e0-160b-41c8-8aaa-637816009779 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:35.787442 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57c737e0-160b-41c8-8aaa-637816009779 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:35.927784 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-57c737e0-160b-41c8-8aaa-637816009779 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:35.938122 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-57c737e0-160b-41c8-8aaa-637816009779 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:35.939630 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-57c737e0-160b-41c8-8aaa-637816009779 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:35.940803 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-57c737e0-160b-41c8-8aaa-637816009779 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.166270 Feb 21 01:14:35.941354 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 378/728] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:35 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:36.204974 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1762bd45-f038-4018-849b-ebed57bd9c23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:36.205557 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1762bd45-f038-4018-849b-ebed57bd9c23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:36.211884 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1762bd45-f038-4018-849b-ebed57bd9c23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:36.213188 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1762bd45-f038-4018-849b-ebed57bd9c23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:36.213978 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1762bd45-f038-4018-849b-ebed57bd9c23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:36.214405 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1762bd45-f038-4018-849b-ebed57bd9c23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:36.276574 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1762bd45-f038-4018-849b-ebed57bd9c23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:36.284432 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1762bd45-f038-4018-849b-ebed57bd9c23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083184 Feb 21 01:14:36.284992 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 351/729] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:36 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:36.390029 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4af90916-e51d-4e7d-98f1-51ed904924fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:36.390855 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4af90916-e51d-4e7d-98f1-51ed904924fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:36.397190 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4af90916-e51d-4e7d-98f1-51ed904924fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:36.397709 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4af90916-e51d-4e7d-98f1-51ed904924fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:36.398454 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4af90916-e51d-4e7d-98f1-51ed904924fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:36.398891 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4af90916-e51d-4e7d-98f1-51ed904924fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:36.429628 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4af90916-e51d-4e7d-98f1-51ed904924fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043483 Feb 21 01:14:36.430202 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 379/730] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:36 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:36.960004 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e1f79380-3681-4c65-a258-ce5dcae4658e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:36.960621 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e1f79380-3681-4c65-a258-ce5dcae4658e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:36.967389 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e1f79380-3681-4c65-a258-ce5dcae4658e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:36.967843 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e1f79380-3681-4c65-a258-ce5dcae4658e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:36.968650 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e1f79380-3681-4c65-a258-ce5dcae4658e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:36.969081 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e1f79380-3681-4c65-a258-ce5dcae4658e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:37.110229 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e1f79380-3681-4c65-a258-ce5dcae4658e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:37.119083 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e1f79380-3681-4c65-a258-ce5dcae4658e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:37.120766 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e1f79380-3681-4c65-a258-ce5dcae4658e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:37.121927 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e1f79380-3681-4c65-a258-ce5dcae4658e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.165704 Feb 21 01:14:37.122488 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 352/731] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:36 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:37.301157 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-56986674-8db1-40c6-848b-1bb44bdcc879 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:37.301769 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-56986674-8db1-40c6-848b-1bb44bdcc879 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:37.308809 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-56986674-8db1-40c6-848b-1bb44bdcc879 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:37.309259 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-56986674-8db1-40c6-848b-1bb44bdcc879 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:37.310051 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-56986674-8db1-40c6-848b-1bb44bdcc879 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:37.310489 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-56986674-8db1-40c6-848b-1bb44bdcc879 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:37.372454 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-56986674-8db1-40c6-848b-1bb44bdcc879 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:37.380276 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-56986674-8db1-40c6-848b-1bb44bdcc879 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082680 Feb 21 01:14:37.380854 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 380/732] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:37 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:14:37.442066 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-dbf1dd3d-e114-43a5-978a-0964bde7f044 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:37.442976 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-dbf1dd3d-e114-43a5-978a-0964bde7f044 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:37.450374 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dbf1dd3d-e114-43a5-978a-0964bde7f044 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:37.450818 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dbf1dd3d-e114-43a5-978a-0964bde7f044 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:37.451619 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dbf1dd3d-e114-43a5-978a-0964bde7f044 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:37.452108 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dbf1dd3d-e114-43a5-978a-0964bde7f044 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:37.483769 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-dbf1dd3d-e114-43a5-978a-0964bde7f044 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045401 Feb 21 01:14:37.484385 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 353/733] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:37 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:38.140838 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d3865247-cfcd-4067-82ff-aaa136ea3570 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:38.141432 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d3865247-cfcd-4067-82ff-aaa136ea3570 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:38.147781 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d3865247-cfcd-4067-82ff-aaa136ea3570 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:38.148254 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d3865247-cfcd-4067-82ff-aaa136ea3570 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:38.149076 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d3865247-cfcd-4067-82ff-aaa136ea3570 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:38.149511 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d3865247-cfcd-4067-82ff-aaa136ea3570 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:38.291578 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d3865247-cfcd-4067-82ff-aaa136ea3570 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:38.300207 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d3865247-cfcd-4067-82ff-aaa136ea3570 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:38.301691 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d3865247-cfcd-4067-82ff-aaa136ea3570 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:38.302848 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d3865247-cfcd-4067-82ff-aaa136ea3570 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.165706 Feb 21 01:14:38.303398 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 381/734] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:38 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:38.398478 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-54c95a64-b404-4050-993c-a63156a6d9a1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:38.398990 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-54c95a64-b404-4050-993c-a63156a6d9a1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:38.405190 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-54c95a64-b404-4050-993c-a63156a6d9a1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:38.405640 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-54c95a64-b404-4050-993c-a63156a6d9a1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:38.406419 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-54c95a64-b404-4050-993c-a63156a6d9a1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:38.407100 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-54c95a64-b404-4050-993c-a63156a6d9a1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:38.472237 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-54c95a64-b404-4050-993c-a63156a6d9a1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:38.480446 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-54c95a64-b404-4050-993c-a63156a6d9a1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.085777 Feb 21 01:14:38.481016 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 354/735] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:38 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:38.498675 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-86b9c5aa-58cf-43bc-82ff-d455f94c18c1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:38.499614 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-86b9c5aa-58cf-43bc-82ff-d455f94c18c1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:38.505662 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-86b9c5aa-58cf-43bc-82ff-d455f94c18c1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:38.506106 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-86b9c5aa-58cf-43bc-82ff-d455f94c18c1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:38.506892 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-86b9c5aa-58cf-43bc-82ff-d455f94c18c1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:38.507324 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-86b9c5aa-58cf-43bc-82ff-d455f94c18c1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:38.538388 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-86b9c5aa-58cf-43bc-82ff-d455f94c18c1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046638 Feb 21 01:14:38.538956 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 382/736] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:38 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:39.323598 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e355fec8-8fa4-4a13-a7c9-65658d2108ed tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:39.324267 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e355fec8-8fa4-4a13-a7c9-65658d2108ed tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:39.330280 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e355fec8-8fa4-4a13-a7c9-65658d2108ed tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:39.330726 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e355fec8-8fa4-4a13-a7c9-65658d2108ed tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:39.331503 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e355fec8-8fa4-4a13-a7c9-65658d2108ed tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:39.332126 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e355fec8-8fa4-4a13-a7c9-65658d2108ed tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:39.475215 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e355fec8-8fa4-4a13-a7c9-65658d2108ed tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:39.483939 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e355fec8-8fa4-4a13-a7c9-65658d2108ed tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:39.485437 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e355fec8-8fa4-4a13-a7c9-65658d2108ed tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:39.486621 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e355fec8-8fa4-4a13-a7c9-65658d2108ed tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.168110 Feb 21 01:14:39.487161 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 355/737] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:39 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:39.497832 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-328fd5ff-13fb-42ba-9f20-e3e3aad4efef tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:39.498431 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-328fd5ff-13fb-42ba-9f20-e3e3aad4efef tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:39.504938 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-328fd5ff-13fb-42ba-9f20-e3e3aad4efef tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:39.505390 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-328fd5ff-13fb-42ba-9f20-e3e3aad4efef tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:39.506195 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-328fd5ff-13fb-42ba-9f20-e3e3aad4efef tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:39.506629 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-328fd5ff-13fb-42ba-9f20-e3e3aad4efef tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:39.550552 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-701c32e4-7d5c-4799-b8d3-5bd52b552b2b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:39.551518 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-701c32e4-7d5c-4799-b8d3-5bd52b552b2b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:39.558140 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-701c32e4-7d5c-4799-b8d3-5bd52b552b2b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:39.558596 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-701c32e4-7d5c-4799-b8d3-5bd52b552b2b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:39.559397 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-701c32e4-7d5c-4799-b8d3-5bd52b552b2b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:39.559857 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-701c32e4-7d5c-4799-b8d3-5bd52b552b2b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:39.575014 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-328fd5ff-13fb-42ba-9f20-e3e3aad4efef tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:39.582490 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-328fd5ff-13fb-42ba-9f20-e3e3aad4efef tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.088252 Feb 21 01:14:39.583067 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 383/738] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:39 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:39.590748 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-701c32e4-7d5c-4799-b8d3-5bd52b552b2b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043817 Feb 21 01:14:39.591316 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 356/739] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:39 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:14:40.505369 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6ace4174-f2ad-4808-aefb-08d57a317c97 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:40.505978 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6ace4174-f2ad-4808-aefb-08d57a317c97 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:40.512692 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6ace4174-f2ad-4808-aefb-08d57a317c97 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:40.513141 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6ace4174-f2ad-4808-aefb-08d57a317c97 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:40.513930 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6ace4174-f2ad-4808-aefb-08d57a317c97 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:40.514365 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6ace4174-f2ad-4808-aefb-08d57a317c97 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:40.598350 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b6b983c4-721d-4243-b97c-40d0321ad45f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:40.599502 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b6b983c4-721d-4243-b97c-40d0321ad45f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:40.605856 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b6b983c4-721d-4243-b97c-40d0321ad45f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:40.606292 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b6b983c4-721d-4243-b97c-40d0321ad45f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:40.607081 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b6b983c4-721d-4243-b97c-40d0321ad45f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:40.607512 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b6b983c4-721d-4243-b97c-40d0321ad45f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:40.663859 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-6ace4174-f2ad-4808-aefb-08d57a317c97 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:40.674341 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b6b983c4-721d-4243-b97c-40d0321ad45f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:40.678414 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-6ace4174-f2ad-4808-aefb-08d57a317c97 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:40.682087 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-6ace4174-f2ad-4808-aefb-08d57a317c97 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:40.683417 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6ace4174-f2ad-4808-aefb-08d57a317c97 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.181750 Feb 21 01:14:40.684120 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 384/740] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:40 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:40.684303 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b6b983c4-721d-4243-b97c-40d0321ad45f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.089504 Feb 21 01:14:40.685444 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 357/741] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:40 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:14:40.688947 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0d69e6c1-a391-413b-bf0c-2d50f9ef8cc4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:40.689867 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0d69e6c1-a391-413b-bf0c-2d50f9ef8cc4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:40.696640 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0d69e6c1-a391-413b-bf0c-2d50f9ef8cc4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:40.696640 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0d69e6c1-a391-413b-bf0c-2d50f9ef8cc4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:40.697997 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0d69e6c1-a391-413b-bf0c-2d50f9ef8cc4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:40.698431 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0d69e6c1-a391-413b-bf0c-2d50f9ef8cc4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:40.729822 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0d69e6c1-a391-413b-bf0c-2d50f9ef8cc4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044461 Feb 21 01:14:40.730385 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 385/742] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:40 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:41.701709 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-bc019f60-a349-44d2-8d1c-10022c62fec2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:41.702273 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3b28bb73-764b-4751-ab0c-56e34813cee2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:41.702649 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-bc019f60-a349-44d2-8d1c-10022c62fec2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:41.702736 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3b28bb73-764b-4751-ab0c-56e34813cee2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:41.708961 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bc019f60-a349-44d2-8d1c-10022c62fec2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:41.709239 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b28bb73-764b-4751-ab0c-56e34813cee2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:41.709391 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bc019f60-a349-44d2-8d1c-10022c62fec2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:41.709692 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b28bb73-764b-4751-ab0c-56e34813cee2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:41.710192 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bc019f60-a349-44d2-8d1c-10022c62fec2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:41.710482 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b28bb73-764b-4751-ab0c-56e34813cee2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:41.710623 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bc019f60-a349-44d2-8d1c-10022c62fec2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:41.710921 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b28bb73-764b-4751-ab0c-56e34813cee2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:41.774054 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bc019f60-a349-44d2-8d1c-10022c62fec2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:41.782257 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-bc019f60-a349-44d2-8d1c-10022c62fec2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084498 Feb 21 01:14:41.782822 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 358/743] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:41 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:41.787299 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c4421393-85bf-424f-a189-e4b5fed4d396 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:41.788253 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c4421393-85bf-424f-a189-e4b5fed4d396 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:41.794817 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c4421393-85bf-424f-a189-e4b5fed4d396 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:41.795272 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c4421393-85bf-424f-a189-e4b5fed4d396 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:41.796091 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c4421393-85bf-424f-a189-e4b5fed4d396 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:41.796520 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c4421393-85bf-424f-a189-e4b5fed4d396 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:41.828061 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c4421393-85bf-424f-a189-e4b5fed4d396 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044138 Feb 21 01:14:41.828627 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 359/744] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:41 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:41.849745 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3b28bb73-764b-4751-ab0c-56e34813cee2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:41.859290 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3b28bb73-764b-4751-ab0c-56e34813cee2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:41.860860 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3b28bb73-764b-4751-ab0c-56e34813cee2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:41.862008 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3b28bb73-764b-4751-ab0c-56e34813cee2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.163749 Feb 21 01:14:41.862553 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 386/745] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:41 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:42.799789 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4b413490-8eec-4cfc-b897-ecbb88effa89 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:42.800401 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4b413490-8eec-4cfc-b897-ecbb88effa89 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:42.807077 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4b413490-8eec-4cfc-b897-ecbb88effa89 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:42.807516 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4b413490-8eec-4cfc-b897-ecbb88effa89 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:42.808326 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4b413490-8eec-4cfc-b897-ecbb88effa89 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:42.808834 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4b413490-8eec-4cfc-b897-ecbb88effa89 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:42.839654 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-03913ea4-7ec0-4b7b-9873-3738282903f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:42.840772 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-03913ea4-7ec0-4b7b-9873-3738282903f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:42.847582 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-03913ea4-7ec0-4b7b-9873-3738282903f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:42.848063 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-03913ea4-7ec0-4b7b-9873-3738282903f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:42.848856 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-03913ea4-7ec0-4b7b-9873-3738282903f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:42.849319 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-03913ea4-7ec0-4b7b-9873-3738282903f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:42.873629 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4b413490-8eec-4cfc-b897-ecbb88effa89 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:42.880017 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-03913ea4-7ec0-4b7b-9873-3738282903f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044525 Feb 21 01:14:42.880590 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 387/746] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:42 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:14:42.881695 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4b413490-8eec-4cfc-b897-ecbb88effa89 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.085684 Feb 21 01:14:42.882647 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 360/747] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:42 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:42.885377 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-49a319b1-d57b-4fb0-a663-a93727b2b95d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:42.885969 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-49a319b1-d57b-4fb0-a663-a93727b2b95d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:42.892838 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49a319b1-d57b-4fb0-a663-a93727b2b95d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:42.893298 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49a319b1-d57b-4fb0-a663-a93727b2b95d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:42.894098 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49a319b1-d57b-4fb0-a663-a93727b2b95d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:42.894598 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49a319b1-d57b-4fb0-a663-a93727b2b95d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:43.034718 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-49a319b1-d57b-4fb0-a663-a93727b2b95d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:43.044115 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-49a319b1-d57b-4fb0-a663-a93727b2b95d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:43.045638 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-49a319b1-d57b-4fb0-a663-a93727b2b95d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:43.046794 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-49a319b1-d57b-4fb0-a663-a93727b2b95d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.165303 Feb 21 01:14:43.047350 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 388/748] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:42 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:43.892709 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d85c9b4b-d477-46f3-8652-a8368653f226 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:43.893658 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d85c9b4b-d477-46f3-8652-a8368653f226 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:43.900026 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-02e2270f-dfbd-4a59-9cc8-890386a4a676 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:43.900947 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d85c9b4b-d477-46f3-8652-a8368653f226 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:43.901187 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-02e2270f-dfbd-4a59-9cc8-890386a4a676 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:43.901396 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d85c9b4b-d477-46f3-8652-a8368653f226 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:43.902222 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d85c9b4b-d477-46f3-8652-a8368653f226 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:43.902757 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d85c9b4b-d477-46f3-8652-a8368653f226 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:43.907782 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-02e2270f-dfbd-4a59-9cc8-890386a4a676 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:43.908364 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-02e2270f-dfbd-4a59-9cc8-890386a4a676 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:43.909182 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-02e2270f-dfbd-4a59-9cc8-890386a4a676 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:43.909617 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-02e2270f-dfbd-4a59-9cc8-890386a4a676 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:43.933690 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d85c9b4b-d477-46f3-8652-a8368653f226 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044815 Feb 21 01:14:43.934259 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 361/749] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:43 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:43.971487 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-02e2270f-dfbd-4a59-9cc8-890386a4a676 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:43.979536 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-02e2270f-dfbd-4a59-9cc8-890386a4a676 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083598 Feb 21 01:14:43.980131 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 389/750] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:43 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:14:44.065379 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-88c2dce6-1684-4839-95f4-687e8278fed6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:44.066096 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-88c2dce6-1684-4839-95f4-687e8278fed6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:44.072096 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-88c2dce6-1684-4839-95f4-687e8278fed6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:44.072544 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-88c2dce6-1684-4839-95f4-687e8278fed6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:44.073325 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-88c2dce6-1684-4839-95f4-687e8278fed6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:44.073872 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-88c2dce6-1684-4839-95f4-687e8278fed6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:44.212767 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-88c2dce6-1684-4839-95f4-687e8278fed6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:44.221849 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-88c2dce6-1684-4839-95f4-687e8278fed6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:44.223348 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-88c2dce6-1684-4839-95f4-687e8278fed6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:44.224598 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-88c2dce6-1684-4839-95f4-687e8278fed6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.163014 Feb 21 01:14:44.225157 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 362/751] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:44 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:44.945110 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-848aa57a-4de0-4235-abba-1735196ea132 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:44.946025 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-848aa57a-4de0-4235-abba-1735196ea132 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:44.952439 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-848aa57a-4de0-4235-abba-1735196ea132 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:44.952893 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-848aa57a-4de0-4235-abba-1735196ea132 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:44.953706 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-848aa57a-4de0-4235-abba-1735196ea132 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:44.954143 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-848aa57a-4de0-4235-abba-1735196ea132 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:44.983579 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-848aa57a-4de0-4235-abba-1735196ea132 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042228 Feb 21 01:14:44.984175 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 390/752] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:44 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:44.996898 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3b85ab43-d3c5-4f84-ad99-05ed823e5adc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:44.999015 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3b85ab43-d3c5-4f84-ad99-05ed823e5adc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:45.003677 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3b85ab43-d3c5-4f84-ad99-05ed823e5adc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:45.004185 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3b85ab43-d3c5-4f84-ad99-05ed823e5adc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:45.004961 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3b85ab43-d3c5-4f84-ad99-05ed823e5adc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:45.005432 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3b85ab43-d3c5-4f84-ad99-05ed823e5adc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:45.066980 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3b85ab43-d3c5-4f84-ad99-05ed823e5adc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:45.074596 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3b85ab43-d3c5-4f84-ad99-05ed823e5adc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082118 Feb 21 01:14:45.075166 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 363/753] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:44 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:45.245587 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-aaf24200-2cfe-4365-ad1c-12b121cd5b1b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:45.246217 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-aaf24200-2cfe-4365-ad1c-12b121cd5b1b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:45.252337 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aaf24200-2cfe-4365-ad1c-12b121cd5b1b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:45.252783 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aaf24200-2cfe-4365-ad1c-12b121cd5b1b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:45.253567 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aaf24200-2cfe-4365-ad1c-12b121cd5b1b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:45.254533 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aaf24200-2cfe-4365-ad1c-12b121cd5b1b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:45.387396 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-aaf24200-2cfe-4365-ad1c-12b121cd5b1b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:45.395551 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-aaf24200-2cfe-4365-ad1c-12b121cd5b1b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:45.397066 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-aaf24200-2cfe-4365-ad1c-12b121cd5b1b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:45.398205 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-aaf24200-2cfe-4365-ad1c-12b121cd5b1b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157003 Feb 21 01:14:45.398790 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 391/754] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:45 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:45.995655 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fba71629-3b9c-43f2-949a-9bf194d4c5a6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:45.996598 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fba71629-3b9c-43f2-949a-9bf194d4c5a6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:46.003162 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fba71629-3b9c-43f2-949a-9bf194d4c5a6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:46.003777 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fba71629-3b9c-43f2-949a-9bf194d4c5a6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:46.004523 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fba71629-3b9c-43f2-949a-9bf194d4c5a6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:46.004961 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fba71629-3b9c-43f2-949a-9bf194d4c5a6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:46.035238 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fba71629-3b9c-43f2-949a-9bf194d4c5a6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043926 Feb 21 01:14:46.035797 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 364/755] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:45 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:46.090153 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0a6ea4c4-adfb-4c8e-b670-c330d90e2f4a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:46.090754 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0a6ea4c4-adfb-4c8e-b670-c330d90e2f4a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:46.097162 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a6ea4c4-adfb-4c8e-b670-c330d90e2f4a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:46.097602 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a6ea4c4-adfb-4c8e-b670-c330d90e2f4a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:46.098374 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a6ea4c4-adfb-4c8e-b670-c330d90e2f4a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:46.098798 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a6ea4c4-adfb-4c8e-b670-c330d90e2f4a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:46.161700 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0a6ea4c4-adfb-4c8e-b670-c330d90e2f4a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:46.169460 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0a6ea4c4-adfb-4c8e-b670-c330d90e2f4a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082927 Feb 21 01:14:46.170023 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 392/756] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:46 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:46.417910 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c27cc021-47d9-4f11-a285-95c4e1ff4b9e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:46.418519 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c27cc021-47d9-4f11-a285-95c4e1ff4b9e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:46.424558 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c27cc021-47d9-4f11-a285-95c4e1ff4b9e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:46.425000 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c27cc021-47d9-4f11-a285-95c4e1ff4b9e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:46.425766 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c27cc021-47d9-4f11-a285-95c4e1ff4b9e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:46.426188 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c27cc021-47d9-4f11-a285-95c4e1ff4b9e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:46.562265 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c27cc021-47d9-4f11-a285-95c4e1ff4b9e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:46.570400 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c27cc021-47d9-4f11-a285-95c4e1ff4b9e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:46.572310 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c27cc021-47d9-4f11-a285-95c4e1ff4b9e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:46.573499 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c27cc021-47d9-4f11-a285-95c4e1ff4b9e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159817 Feb 21 01:14:46.574064 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 365/757] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:46 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:47.047246 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-37f46e71-74da-4759-8e87-9910dbb9bb59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:47.048211 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-37f46e71-74da-4759-8e87-9910dbb9bb59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:47.053993 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-37f46e71-74da-4759-8e87-9910dbb9bb59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:47.054433 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-37f46e71-74da-4759-8e87-9910dbb9bb59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:47.055200 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-37f46e71-74da-4759-8e87-9910dbb9bb59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:47.055627 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-37f46e71-74da-4759-8e87-9910dbb9bb59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:47.084968 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-37f46e71-74da-4759-8e87-9910dbb9bb59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041498 Feb 21 01:14:47.085517 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 393/758] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:47 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:47.185321 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9d079b05-c523-45c8-a067-ae041e7be297 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:47.185932 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9d079b05-c523-45c8-a067-ae041e7be297 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:47.192331 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9d079b05-c523-45c8-a067-ae041e7be297 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:47.192778 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9d079b05-c523-45c8-a067-ae041e7be297 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:47.193565 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9d079b05-c523-45c8-a067-ae041e7be297 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:47.196999 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9d079b05-c523-45c8-a067-ae041e7be297 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:47.254657 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9d079b05-c523-45c8-a067-ae041e7be297 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:47.262563 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9d079b05-c523-45c8-a067-ae041e7be297 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080964 Feb 21 01:14:47.263120 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 366/759] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:47 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:47.591577 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-08b2b1bd-1b91-41e1-8658-9050fb13e46e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:47.592265 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-08b2b1bd-1b91-41e1-8658-9050fb13e46e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:47.598525 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-08b2b1bd-1b91-41e1-8658-9050fb13e46e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:47.598974 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-08b2b1bd-1b91-41e1-8658-9050fb13e46e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:47.599751 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-08b2b1bd-1b91-41e1-8658-9050fb13e46e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:47.600248 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-08b2b1bd-1b91-41e1-8658-9050fb13e46e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:47.735188 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-08b2b1bd-1b91-41e1-8658-9050fb13e46e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:47.744381 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-08b2b1bd-1b91-41e1-8658-9050fb13e46e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:47.745898 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-08b2b1bd-1b91-41e1-8658-9050fb13e46e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:47.747044 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-08b2b1bd-1b91-41e1-8658-9050fb13e46e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159284 Feb 21 01:14:47.747607 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 394/760] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:47 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:48.096923 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b33e2f2d-b1c9-4186-81fe-ebc4856014de tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:48.097863 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b33e2f2d-b1c9-4186-81fe-ebc4856014de tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:48.103990 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b33e2f2d-b1c9-4186-81fe-ebc4856014de tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:48.104436 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b33e2f2d-b1c9-4186-81fe-ebc4856014de tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:48.105223 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b33e2f2d-b1c9-4186-81fe-ebc4856014de tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:48.105654 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b33e2f2d-b1c9-4186-81fe-ebc4856014de tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:48.134701 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b33e2f2d-b1c9-4186-81fe-ebc4856014de tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041530 Feb 21 01:14:48.135259 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 367/761] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:48 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:48.278905 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-69dd0f05-c0d1-47b6-ad90-5522479aac44 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:48.279505 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-69dd0f05-c0d1-47b6-ad90-5522479aac44 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:48.285654 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-69dd0f05-c0d1-47b6-ad90-5522479aac44 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:48.286119 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-69dd0f05-c0d1-47b6-ad90-5522479aac44 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:48.286889 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-69dd0f05-c0d1-47b6-ad90-5522479aac44 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:48.287318 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-69dd0f05-c0d1-47b6-ad90-5522479aac44 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:48.346429 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-69dd0f05-c0d1-47b6-ad90-5522479aac44 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:48.353820 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-69dd0f05-c0d1-47b6-ad90-5522479aac44 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.078460 Feb 21 01:14:48.354309 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 395/762] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:48 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:48.765136 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fefabec9-45d7-44e7-87ca-42a1890a3638 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:48.765775 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fefabec9-45d7-44e7-87ca-42a1890a3638 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:48.772044 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fefabec9-45d7-44e7-87ca-42a1890a3638 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:48.772495 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fefabec9-45d7-44e7-87ca-42a1890a3638 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:48.773271 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fefabec9-45d7-44e7-87ca-42a1890a3638 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:48.773710 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fefabec9-45d7-44e7-87ca-42a1890a3638 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:48.917544 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fefabec9-45d7-44e7-87ca-42a1890a3638 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:48.925768 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fefabec9-45d7-44e7-87ca-42a1890a3638 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:48.927379 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fefabec9-45d7-44e7-87ca-42a1890a3638 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:48.928550 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fefabec9-45d7-44e7-87ca-42a1890a3638 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.167112 Feb 21 01:14:48.929112 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 368/763] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:48 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:49.145900 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1fe12d44-a39e-48e0-8c48-f7061292dbd5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:49.146851 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1fe12d44-a39e-48e0-8c48-f7061292dbd5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:49.153751 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1fe12d44-a39e-48e0-8c48-f7061292dbd5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:49.154191 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1fe12d44-a39e-48e0-8c48-f7061292dbd5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:49.154969 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1fe12d44-a39e-48e0-8c48-f7061292dbd5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:49.155401 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1fe12d44-a39e-48e0-8c48-f7061292dbd5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:49.185670 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1fe12d44-a39e-48e0-8c48-f7061292dbd5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043637 Feb 21 01:14:49.186231 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 396/764] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:49 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:49.369883 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ba54af44-3d39-432a-bff6-f6ac03b54d8b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:49.370523 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ba54af44-3d39-432a-bff6-f6ac03b54d8b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:49.376674 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ba54af44-3d39-432a-bff6-f6ac03b54d8b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:49.377072 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ba54af44-3d39-432a-bff6-f6ac03b54d8b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:49.377855 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ba54af44-3d39-432a-bff6-f6ac03b54d8b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:49.378288 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ba54af44-3d39-432a-bff6-f6ac03b54d8b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:49.442657 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ba54af44-3d39-432a-bff6-f6ac03b54d8b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:49.450565 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ba54af44-3d39-432a-bff6-f6ac03b54d8b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084394 Feb 21 01:14:49.451117 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 369/765] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:49 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:49.948337 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ce625b35-3f80-4a15-81e8-572050835b23 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:49.948945 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ce625b35-3f80-4a15-81e8-572050835b23 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:49.954978 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ce625b35-3f80-4a15-81e8-572050835b23 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:49.955424 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ce625b35-3f80-4a15-81e8-572050835b23 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:49.956232 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ce625b35-3f80-4a15-81e8-572050835b23 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:49.956664 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ce625b35-3f80-4a15-81e8-572050835b23 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:50.091109 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ce625b35-3f80-4a15-81e8-572050835b23 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:50.099197 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ce625b35-3f80-4a15-81e8-572050835b23 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:50.100716 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ce625b35-3f80-4a15-81e8-572050835b23 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:50.101872 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ce625b35-3f80-4a15-81e8-572050835b23 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158205 Feb 21 01:14:50.102464 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 397/766] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:49 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:50.197340 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a15b7771-5bf7-475d-9045-e50d6c49d057 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:50.198262 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a15b7771-5bf7-475d-9045-e50d6c49d057 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:50.204647 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a15b7771-5bf7-475d-9045-e50d6c49d057 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:50.205079 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a15b7771-5bf7-475d-9045-e50d6c49d057 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:50.205849 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a15b7771-5bf7-475d-9045-e50d6c49d057 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:50.206282 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a15b7771-5bf7-475d-9045-e50d6c49d057 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:50.236524 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a15b7771-5bf7-475d-9045-e50d6c49d057 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043135 Feb 21 01:14:50.237103 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 370/767] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:50 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:50.467577 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6e78676d-d31a-4d0a-a4fd-8ed25f0e5957 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:50.468212 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6e78676d-d31a-4d0a-a4fd-8ed25f0e5957 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:50.474251 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6e78676d-d31a-4d0a-a4fd-8ed25f0e5957 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:50.474690 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6e78676d-d31a-4d0a-a4fd-8ed25f0e5957 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:50.475463 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6e78676d-d31a-4d0a-a4fd-8ed25f0e5957 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:50.475954 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6e78676d-d31a-4d0a-a4fd-8ed25f0e5957 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:50.536769 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-6e78676d-d31a-4d0a-a4fd-8ed25f0e5957 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:50.544283 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6e78676d-d31a-4d0a-a4fd-8ed25f0e5957 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080425 Feb 21 01:14:50.544844 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 398/768] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:50 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:51.120551 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-dd42e35c-ba74-41ca-8c6f-133adaaa7ffe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:51.121158 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-dd42e35c-ba74-41ca-8c6f-133adaaa7ffe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:51.126937 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dd42e35c-ba74-41ca-8c6f-133adaaa7ffe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:51.127385 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dd42e35c-ba74-41ca-8c6f-133adaaa7ffe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:51.128197 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dd42e35c-ba74-41ca-8c6f-133adaaa7ffe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:51.128628 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dd42e35c-ba74-41ca-8c6f-133adaaa7ffe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:51.248550 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-bb4f294c-ea77-4863-885a-89e68ad398b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:51.249463 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-bb4f294c-ea77-4863-885a-89e68ad398b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:51.255672 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bb4f294c-ea77-4863-885a-89e68ad398b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:51.256142 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bb4f294c-ea77-4863-885a-89e68ad398b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:51.256920 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bb4f294c-ea77-4863-885a-89e68ad398b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:51.257346 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bb4f294c-ea77-4863-885a-89e68ad398b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:51.266416 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-dd42e35c-ba74-41ca-8c6f-133adaaa7ffe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:51.272872 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-dd42e35c-ba74-41ca-8c6f-133adaaa7ffe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:51.274511 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-dd42e35c-ba74-41ca-8c6f-133adaaa7ffe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:51.275685 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-dd42e35c-ba74-41ca-8c6f-133adaaa7ffe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159261 Feb 21 01:14:51.276269 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 371/769] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:51 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:51.298552 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-bb4f294c-ea77-4863-885a-89e68ad398b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053726 Feb 21 01:14:51.300844 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 399/770] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:51 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:14:51.560865 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5cf39316-10fd-47ac-bec9-0a6d69765909 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:51.561475 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5cf39316-10fd-47ac-bec9-0a6d69765909 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:51.567440 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5cf39316-10fd-47ac-bec9-0a6d69765909 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:51.567916 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5cf39316-10fd-47ac-bec9-0a6d69765909 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:51.568701 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5cf39316-10fd-47ac-bec9-0a6d69765909 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:51.569135 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5cf39316-10fd-47ac-bec9-0a6d69765909 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:51.631165 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5cf39316-10fd-47ac-bec9-0a6d69765909 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:51.639318 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5cf39316-10fd-47ac-bec9-0a6d69765909 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082206 Feb 21 01:14:51.639917 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 372/771] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:51 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:52.294459 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d94179d3-d65d-43c5-843d-b64c09441299 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:52.295036 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d94179d3-d65d-43c5-843d-b64c09441299 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:52.301221 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d94179d3-d65d-43c5-843d-b64c09441299 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:52.301659 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d94179d3-d65d-43c5-843d-b64c09441299 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:52.302427 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d94179d3-d65d-43c5-843d-b64c09441299 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:52.302854 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d94179d3-d65d-43c5-843d-b64c09441299 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:52.311640 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-60dd7203-b815-4f6b-83ad-c4959fb617c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:52.312616 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-60dd7203-b815-4f6b-83ad-c4959fb617c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:52.318810 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-60dd7203-b815-4f6b-83ad-c4959fb617c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:52.319259 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-60dd7203-b815-4f6b-83ad-c4959fb617c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:52.320080 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-60dd7203-b815-4f6b-83ad-c4959fb617c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:52.320517 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-60dd7203-b815-4f6b-83ad-c4959fb617c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:52.351270 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-60dd7203-b815-4f6b-83ad-c4959fb617c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044669 Feb 21 01:14:52.355555 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 373/772] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:52 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:14:52.437178 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d94179d3-d65d-43c5-843d-b64c09441299 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:52.445108 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d94179d3-d65d-43c5-843d-b64c09441299 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:52.446599 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d94179d3-d65d-43c5-843d-b64c09441299 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:52.447790 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d94179d3-d65d-43c5-843d-b64c09441299 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157152 Feb 21 01:14:52.448407 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 400/773] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:52 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:52.656022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-594ccfbe-745d-4ee3-b0b4-b9e1f1951a90 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:52.656820 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-594ccfbe-745d-4ee3-b0b4-b9e1f1951a90 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:52.662644 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-594ccfbe-745d-4ee3-b0b4-b9e1f1951a90 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:52.663081 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-594ccfbe-745d-4ee3-b0b4-b9e1f1951a90 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:52.663863 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-594ccfbe-745d-4ee3-b0b4-b9e1f1951a90 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:52.664290 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-594ccfbe-745d-4ee3-b0b4-b9e1f1951a90 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:52.726021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-594ccfbe-745d-4ee3-b0b4-b9e1f1951a90 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:52.734143 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-594ccfbe-745d-4ee3-b0b4-b9e1f1951a90 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081817 Feb 21 01:14:52.734695 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 374/774] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:52 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:53.362281 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d68ba995-a1b7-4629-9b20-43c858ca2d4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:53.363195 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d68ba995-a1b7-4629-9b20-43c858ca2d4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:53.369558 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d68ba995-a1b7-4629-9b20-43c858ca2d4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:53.369952 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d68ba995-a1b7-4629-9b20-43c858ca2d4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:53.370736 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d68ba995-a1b7-4629-9b20-43c858ca2d4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:53.371160 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d68ba995-a1b7-4629-9b20-43c858ca2d4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:53.400058 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d68ba995-a1b7-4629-9b20-43c858ca2d4f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041535 Feb 21 01:14:53.400609 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 401/775] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:53 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:53.467560 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5b8c6a70-5276-40b7-95c4-863d53495281 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:53.468214 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5b8c6a70-5276-40b7-95c4-863d53495281 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:53.474585 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5b8c6a70-5276-40b7-95c4-863d53495281 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:53.475034 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5b8c6a70-5276-40b7-95c4-863d53495281 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:53.475816 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5b8c6a70-5276-40b7-95c4-863d53495281 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:53.476273 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5b8c6a70-5276-40b7-95c4-863d53495281 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:53.610491 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5b8c6a70-5276-40b7-95c4-863d53495281 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:53.618569 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5b8c6a70-5276-40b7-95c4-863d53495281 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:53.620593 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5b8c6a70-5276-40b7-95c4-863d53495281 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:53.621741 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5b8c6a70-5276-40b7-95c4-863d53495281 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159856 Feb 21 01:14:53.622299 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 375/776] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:53 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:53.750519 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-105d9bc4-0880-496a-b584-6360c241a82d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:53.751154 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-105d9bc4-0880-496a-b584-6360c241a82d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:53.757010 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-105d9bc4-0880-496a-b584-6360c241a82d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:53.757450 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-105d9bc4-0880-496a-b584-6360c241a82d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:53.758226 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-105d9bc4-0880-496a-b584-6360c241a82d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:53.758650 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-105d9bc4-0880-496a-b584-6360c241a82d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:53.820910 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-105d9bc4-0880-496a-b584-6360c241a82d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:53.829017 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-105d9bc4-0880-496a-b584-6360c241a82d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082215 Feb 21 01:14:53.829578 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 402/777] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:53 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:54.412450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ca7854c9-e6c3-49ca-ac9f-10476756043c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:54.413419 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ca7854c9-e6c3-49ca-ac9f-10476756043c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:54.419958 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ca7854c9-e6c3-49ca-ac9f-10476756043c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:54.420407 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ca7854c9-e6c3-49ca-ac9f-10476756043c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:54.421187 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ca7854c9-e6c3-49ca-ac9f-10476756043c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:54.421619 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ca7854c9-e6c3-49ca-ac9f-10476756043c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:54.450233 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ca7854c9-e6c3-49ca-ac9f-10476756043c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041502 Feb 21 01:14:54.450801 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 376/778] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:54 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:54.639784 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-dca748a5-73fe-48c5-b86d-7fd48a428164 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:54.640376 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-dca748a5-73fe-48c5-b86d-7fd48a428164 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:54.646657 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dca748a5-73fe-48c5-b86d-7fd48a428164 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:54.647109 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dca748a5-73fe-48c5-b86d-7fd48a428164 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:54.647923 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dca748a5-73fe-48c5-b86d-7fd48a428164 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:54.648360 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dca748a5-73fe-48c5-b86d-7fd48a428164 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:54.784492 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-dca748a5-73fe-48c5-b86d-7fd48a428164 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:54.793065 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-dca748a5-73fe-48c5-b86d-7fd48a428164 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:54.794544 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-dca748a5-73fe-48c5-b86d-7fd48a428164 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:54.795678 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-dca748a5-73fe-48c5-b86d-7fd48a428164 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159781 Feb 21 01:14:54.796257 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 403/779] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:54 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:54.845369 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-697819bb-8bcc-43ad-b02e-7aff5b58b4e3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:54.845971 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-697819bb-8bcc-43ad-b02e-7aff5b58b4e3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:54.852150 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-697819bb-8bcc-43ad-b02e-7aff5b58b4e3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:54.852592 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-697819bb-8bcc-43ad-b02e-7aff5b58b4e3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:54.853362 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-697819bb-8bcc-43ad-b02e-7aff5b58b4e3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:54.854285 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-697819bb-8bcc-43ad-b02e-7aff5b58b4e3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:54.917891 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-697819bb-8bcc-43ad-b02e-7aff5b58b4e3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:54.925335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-697819bb-8bcc-43ad-b02e-7aff5b58b4e3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083654 Feb 21 01:14:54.925905 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 377/780] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:54 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:14:55.461032 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8c3b99f6-7425-400c-ba42-99826cb09645 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:55.461941 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8c3b99f6-7425-400c-ba42-99826cb09645 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:55.468715 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8c3b99f6-7425-400c-ba42-99826cb09645 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:55.469165 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8c3b99f6-7425-400c-ba42-99826cb09645 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:55.469947 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8c3b99f6-7425-400c-ba42-99826cb09645 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:55.470385 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8c3b99f6-7425-400c-ba42-99826cb09645 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:55.500799 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8c3b99f6-7425-400c-ba42-99826cb09645 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043415 Feb 21 01:14:55.501369 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 404/781] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:55 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:55.813939 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7bb6f5ed-f5f7-4d79-8737-f801bf0bdcd0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:55.814534 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7bb6f5ed-f5f7-4d79-8737-f801bf0bdcd0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:55.820583 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7bb6f5ed-f5f7-4d79-8737-f801bf0bdcd0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:55.821029 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7bb6f5ed-f5f7-4d79-8737-f801bf0bdcd0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:55.821852 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7bb6f5ed-f5f7-4d79-8737-f801bf0bdcd0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:55.822284 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7bb6f5ed-f5f7-4d79-8737-f801bf0bdcd0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:55.943411 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-930cc405-a545-496b-835f-7d28ab5d1842 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:55.944255 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-930cc405-a545-496b-835f-7d28ab5d1842 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:55.951569 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-930cc405-a545-496b-835f-7d28ab5d1842 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:55.952058 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-930cc405-a545-496b-835f-7d28ab5d1842 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:55.953051 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-930cc405-a545-496b-835f-7d28ab5d1842 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:55.953666 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-930cc405-a545-496b-835f-7d28ab5d1842 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:55.975301 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7bb6f5ed-f5f7-4d79-8737-f801bf0bdcd0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:55.984335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7bb6f5ed-f5f7-4d79-8737-f801bf0bdcd0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:55.985918 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7bb6f5ed-f5f7-4d79-8737-f801bf0bdcd0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:55.987140 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7bb6f5ed-f5f7-4d79-8737-f801bf0bdcd0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.176957 Feb 21 01:14:55.996777 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 378/782] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:55 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:56.028406 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-930cc405-a545-496b-835f-7d28ab5d1842 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:56.037261 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-930cc405-a545-496b-835f-7d28ab5d1842 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.097322 Feb 21 01:14:56.037826 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 405/783] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:55 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:14:56.512495 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-813302e9-8c70-4632-aabf-87c801bb9895 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:56.513399 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-813302e9-8c70-4632-aabf-87c801bb9895 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:56.519490 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-813302e9-8c70-4632-aabf-87c801bb9895 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:56.519983 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-813302e9-8c70-4632-aabf-87c801bb9895 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:56.520771 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-813302e9-8c70-4632-aabf-87c801bb9895 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:56.521209 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-813302e9-8c70-4632-aabf-87c801bb9895 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:56.550233 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-813302e9-8c70-4632-aabf-87c801bb9895 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042131 Feb 21 01:14:56.550788 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 379/784] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:56 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:57.006097 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5f2b536e-34dd-4a62-b9d9-f86dbc4d1cc2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:57.006702 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5f2b536e-34dd-4a62-b9d9-f86dbc4d1cc2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:57.013202 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5f2b536e-34dd-4a62-b9d9-f86dbc4d1cc2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:57.013660 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5f2b536e-34dd-4a62-b9d9-f86dbc4d1cc2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:57.014440 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5f2b536e-34dd-4a62-b9d9-f86dbc4d1cc2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:57.014874 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5f2b536e-34dd-4a62-b9d9-f86dbc4d1cc2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:57.053628 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cc0012e3-fb85-43c7-bc68-8a041ca58283 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:57.054242 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cc0012e3-fb85-43c7-bc68-8a041ca58283 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:57.061609 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc0012e3-fb85-43c7-bc68-8a041ca58283 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:57.062059 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc0012e3-fb85-43c7-bc68-8a041ca58283 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:57.062853 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc0012e3-fb85-43c7-bc68-8a041ca58283 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:57.063292 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc0012e3-fb85-43c7-bc68-8a041ca58283 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:57.127917 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cc0012e3-fb85-43c7-bc68-8a041ca58283 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:57.135498 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cc0012e3-fb85-43c7-bc68-8a041ca58283 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.085427 Feb 21 01:14:57.136915 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 380/785] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:57 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:14:57.150198 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5f2b536e-34dd-4a62-b9d9-f86dbc4d1cc2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:57.158712 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5f2b536e-34dd-4a62-b9d9-f86dbc4d1cc2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:57.165633 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5f2b536e-34dd-4a62-b9d9-f86dbc4d1cc2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:57.165633 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5f2b536e-34dd-4a62-b9d9-f86dbc4d1cc2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158931 Feb 21 01:14:57.165633 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 406/786] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:57 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:57.562550 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-62b2ec70-95b2-476b-89ef-3a0be678d239 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:57.563376 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-62b2ec70-95b2-476b-89ef-3a0be678d239 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:57.569326 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-62b2ec70-95b2-476b-89ef-3a0be678d239 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:57.569777 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-62b2ec70-95b2-476b-89ef-3a0be678d239 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:57.570557 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-62b2ec70-95b2-476b-89ef-3a0be678d239 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:57.571022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-62b2ec70-95b2-476b-89ef-3a0be678d239 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:57.601277 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-62b2ec70-95b2-476b-89ef-3a0be678d239 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042700 Feb 21 01:14:57.601826 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 381/787] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:57 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:58.152462 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c326eb1f-9aaf-4814-a864-750828967851 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:58.153074 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c326eb1f-9aaf-4814-a864-750828967851 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:58.159606 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c326eb1f-9aaf-4814-a864-750828967851 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:58.160090 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c326eb1f-9aaf-4814-a864-750828967851 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:58.160875 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c326eb1f-9aaf-4814-a864-750828967851 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:58.161313 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c326eb1f-9aaf-4814-a864-750828967851 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:58.183052 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-58dafa8e-a416-4ac0-994a-efde1c055334 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:58.184111 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-58dafa8e-a416-4ac0-994a-efde1c055334 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:58.190355 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-58dafa8e-a416-4ac0-994a-efde1c055334 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:58.190804 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-58dafa8e-a416-4ac0-994a-efde1c055334 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:58.191627 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-58dafa8e-a416-4ac0-994a-efde1c055334 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:58.192097 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-58dafa8e-a416-4ac0-994a-efde1c055334 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:58.220521 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c326eb1f-9aaf-4814-a864-750828967851 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:58.228089 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c326eb1f-9aaf-4814-a864-750828967851 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079447 Feb 21 01:14:58.228899 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 407/788] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:58 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:58.330079 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-58dafa8e-a416-4ac0-994a-efde1c055334 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:58.338259 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-58dafa8e-a416-4ac0-994a-efde1c055334 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:58.339759 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-58dafa8e-a416-4ac0-994a-efde1c055334 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:58.340931 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-58dafa8e-a416-4ac0-994a-efde1c055334 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.162439 Feb 21 01:14:58.341503 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 382/789] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:58 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:14:58.613422 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fdf7d62d-fb51-4abc-9419-70e57968a1d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:58.614336 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fdf7d62d-fb51-4abc-9419-70e57968a1d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:58.621099 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fdf7d62d-fb51-4abc-9419-70e57968a1d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:58.621545 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fdf7d62d-fb51-4abc-9419-70e57968a1d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:58.622370 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fdf7d62d-fb51-4abc-9419-70e57968a1d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:58.622805 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fdf7d62d-fb51-4abc-9419-70e57968a1d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:58.654506 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-fdf7d62d-fb51-4abc-9419-70e57968a1d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044853 Feb 21 01:14:58.655085 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 408/790] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:58 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:59.246024 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ea9c38e5-2284-43f1-8cb0-58797213ced8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:59.246639 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ea9c38e5-2284-43f1-8cb0-58797213ced8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:59.253111 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ea9c38e5-2284-43f1-8cb0-58797213ced8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:59.253555 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ea9c38e5-2284-43f1-8cb0-58797213ced8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:59.254343 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ea9c38e5-2284-43f1-8cb0-58797213ced8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:59.254774 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ea9c38e5-2284-43f1-8cb0-58797213ced8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:59.315802 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ea9c38e5-2284-43f1-8cb0-58797213ced8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:59.323541 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ea9c38e5-2284-43f1-8cb0-58797213ced8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082602 Feb 21 01:14:59.324179 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 383/791] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:59 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:59.359650 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d748c4c6-ddfb-4cd2-8b6f-5db3042bb93d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:59.360318 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d748c4c6-ddfb-4cd2-8b6f-5db3042bb93d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:59.366636 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d748c4c6-ddfb-4cd2-8b6f-5db3042bb93d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:59.367083 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d748c4c6-ddfb-4cd2-8b6f-5db3042bb93d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:59.367891 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d748c4c6-ddfb-4cd2-8b6f-5db3042bb93d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:59.368330 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d748c4c6-ddfb-4cd2-8b6f-5db3042bb93d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:59.503655 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d748c4c6-ddfb-4cd2-8b6f-5db3042bb93d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:59.512346 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d748c4c6-ddfb-4cd2-8b6f-5db3042bb93d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:59.513954 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d748c4c6-ddfb-4cd2-8b6f-5db3042bb93d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:59.515105 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d748c4c6-ddfb-4cd2-8b6f-5db3042bb93d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159188 Feb 21 01:14:59.515659 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 409/792] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:14:59 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:14:59.667479 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ac7131d2-8d3c-4777-add0-45a4a876e558 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:59.668437 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ac7131d2-8d3c-4777-add0-45a4a876e558 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:59.674271 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ac7131d2-8d3c-4777-add0-45a4a876e558 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:59.674724 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ac7131d2-8d3c-4777-add0-45a4a876e558 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:59.675505 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ac7131d2-8d3c-4777-add0-45a4a876e558 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:59.675967 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ac7131d2-8d3c-4777-add0-45a4a876e558 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:59.704849 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ac7131d2-8d3c-4777-add0-45a4a876e558 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042264 Feb 21 01:14:59.705416 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 384/793] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:14:59 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:15:00.339954 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-42578cd0-8736-4b5c-bebc-34cb902f8f49 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:00.340587 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-42578cd0-8736-4b5c-bebc-34cb902f8f49 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:00.346386 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-42578cd0-8736-4b5c-bebc-34cb902f8f49 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:00.346824 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-42578cd0-8736-4b5c-bebc-34cb902f8f49 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:00.347587 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-42578cd0-8736-4b5c-bebc-34cb902f8f49 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:00.348042 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-42578cd0-8736-4b5c-bebc-34cb902f8f49 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:00.410798 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-42578cd0-8736-4b5c-bebc-34cb902f8f49 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:00.418165 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-42578cd0-8736-4b5c-bebc-34cb902f8f49 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082120 Feb 21 01:15:00.418717 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 410/794] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:00 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:00.534229 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-45ff92d5-16ff-44c5-8f1c-99582d857c5c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:00.534835 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-45ff92d5-16ff-44c5-8f1c-99582d857c5c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:00.541213 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-45ff92d5-16ff-44c5-8f1c-99582d857c5c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:00.542278 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-45ff92d5-16ff-44c5-8f1c-99582d857c5c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:00.543070 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-45ff92d5-16ff-44c5-8f1c-99582d857c5c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:00.543508 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-45ff92d5-16ff-44c5-8f1c-99582d857c5c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:00.680683 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-45ff92d5-16ff-44c5-8f1c-99582d857c5c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:00.689388 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-45ff92d5-16ff-44c5-8f1c-99582d857c5c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:00.690871 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-45ff92d5-16ff-44c5-8f1c-99582d857c5c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:00.692049 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-45ff92d5-16ff-44c5-8f1c-99582d857c5c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.161743 Feb 21 01:15:00.692607 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 385/795] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:00 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:00.715448 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6ecd2841-4789-4d26-8a1c-9a1e13d832cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:00.716418 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6ecd2841-4789-4d26-8a1c-9a1e13d832cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:00.722139 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6ecd2841-4789-4d26-8a1c-9a1e13d832cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:00.722578 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6ecd2841-4789-4d26-8a1c-9a1e13d832cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:00.723345 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6ecd2841-4789-4d26-8a1c-9a1e13d832cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:00.723771 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6ecd2841-4789-4d26-8a1c-9a1e13d832cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:00.752591 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6ecd2841-4789-4d26-8a1c-9a1e13d832cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040858 Feb 21 01:15:00.753134 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 411/796] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:00 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:01.435039 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3d71646a-e1cd-4b66-b4a6-a39e81af0951 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:01.435667 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3d71646a-e1cd-4b66-b4a6-a39e81af0951 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:01.441492 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3d71646a-e1cd-4b66-b4a6-a39e81af0951 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:01.441930 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3d71646a-e1cd-4b66-b4a6-a39e81af0951 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:01.442695 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3d71646a-e1cd-4b66-b4a6-a39e81af0951 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:01.443121 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3d71646a-e1cd-4b66-b4a6-a39e81af0951 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:01.502184 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3d71646a-e1cd-4b66-b4a6-a39e81af0951 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:01.509568 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3d71646a-e1cd-4b66-b4a6-a39e81af0951 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.078700 Feb 21 01:15:01.510785 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 386/797] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:01 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:01.710347 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c2ca3da8-4f93-47e7-9c46-1c4192a1bd53 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:01.710895 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c2ca3da8-4f93-47e7-9c46-1c4192a1bd53 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:01.717824 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c2ca3da8-4f93-47e7-9c46-1c4192a1bd53 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:01.718267 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c2ca3da8-4f93-47e7-9c46-1c4192a1bd53 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:01.719092 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c2ca3da8-4f93-47e7-9c46-1c4192a1bd53 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:01.719526 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c2ca3da8-4f93-47e7-9c46-1c4192a1bd53 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:01.764720 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fd0f1013-b850-43c4-8207-5140c2e31260 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:01.765652 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fd0f1013-b850-43c4-8207-5140c2e31260 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:01.771438 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fd0f1013-b850-43c4-8207-5140c2e31260 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:01.771901 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fd0f1013-b850-43c4-8207-5140c2e31260 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:01.772682 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fd0f1013-b850-43c4-8207-5140c2e31260 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:01.773110 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fd0f1013-b850-43c4-8207-5140c2e31260 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:01.803400 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fd0f1013-b850-43c4-8207-5140c2e31260 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043236 Feb 21 01:15:01.803993 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 387/798] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:01 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:15:01.859182 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c2ca3da8-4f93-47e7-9c46-1c4192a1bd53 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:01.867351 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c2ca3da8-4f93-47e7-9c46-1c4192a1bd53 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:01.868841 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c2ca3da8-4f93-47e7-9c46-1c4192a1bd53 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:01.870132 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c2ca3da8-4f93-47e7-9c46-1c4192a1bd53 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.163622 Feb 21 01:15:01.870671 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 412/799] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:01 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:02.527739 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f9de48e9-52ba-4766-9ab1-531a0ac8b6dd tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:02.528367 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f9de48e9-52ba-4766-9ab1-531a0ac8b6dd tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:02.534420 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f9de48e9-52ba-4766-9ab1-531a0ac8b6dd tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:02.534865 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f9de48e9-52ba-4766-9ab1-531a0ac8b6dd tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:02.535645 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f9de48e9-52ba-4766-9ab1-531a0ac8b6dd tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:02.536106 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f9de48e9-52ba-4766-9ab1-531a0ac8b6dd tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:02.597579 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f9de48e9-52ba-4766-9ab1-531a0ac8b6dd tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:02.606247 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f9de48e9-52ba-4766-9ab1-531a0ac8b6dd tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083255 Feb 21 01:15:02.606816 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 388/800] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:02 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:02.815100 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c5269344-7549-4fd6-a755-d20deacf4ce8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:02.815983 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c5269344-7549-4fd6-a755-d20deacf4ce8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:02.822274 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c5269344-7549-4fd6-a755-d20deacf4ce8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:02.823890 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c5269344-7549-4fd6-a755-d20deacf4ce8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:02.824836 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c5269344-7549-4fd6-a755-d20deacf4ce8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:02.825391 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c5269344-7549-4fd6-a755-d20deacf4ce8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:02.856839 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c5269344-7549-4fd6-a755-d20deacf4ce8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045664 Feb 21 01:15:02.857407 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 413/801] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:02 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:02.889144 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3475c72d-8a8f-4afa-85dd-0515f60d5d88 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:02.889776 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3475c72d-8a8f-4afa-85dd-0515f60d5d88 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:02.895989 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3475c72d-8a8f-4afa-85dd-0515f60d5d88 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:02.896441 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3475c72d-8a8f-4afa-85dd-0515f60d5d88 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:02.897225 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3475c72d-8a8f-4afa-85dd-0515f60d5d88 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:02.897658 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3475c72d-8a8f-4afa-85dd-0515f60d5d88 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:03.031965 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3475c72d-8a8f-4afa-85dd-0515f60d5d88 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:03.040080 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3475c72d-8a8f-4afa-85dd-0515f60d5d88 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:03.041588 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3475c72d-8a8f-4afa-85dd-0515f60d5d88 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:03.042738 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3475c72d-8a8f-4afa-85dd-0515f60d5d88 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158230 Feb 21 01:15:03.043290 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 389/802] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:02 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:03.623307 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a2fa1cad-8ac3-4db4-bb20-473b6b02a8aa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:03.623852 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a2fa1cad-8ac3-4db4-bb20-473b6b02a8aa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:03.629827 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a2fa1cad-8ac3-4db4-bb20-473b6b02a8aa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:03.630277 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a2fa1cad-8ac3-4db4-bb20-473b6b02a8aa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:03.631062 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a2fa1cad-8ac3-4db4-bb20-473b6b02a8aa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:03.631496 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a2fa1cad-8ac3-4db4-bb20-473b6b02a8aa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:03.692653 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a2fa1cad-8ac3-4db4-bb20-473b6b02a8aa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:03.700079 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a2fa1cad-8ac3-4db4-bb20-473b6b02a8aa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081577 Feb 21 01:15:03.700639 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 414/803] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:03 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:03.868272 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-306a445b-4db2-49f8-b989-c1e9e24fe4f9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:03.869181 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-306a445b-4db2-49f8-b989-c1e9e24fe4f9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:03.875670 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-306a445b-4db2-49f8-b989-c1e9e24fe4f9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:03.876093 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-306a445b-4db2-49f8-b989-c1e9e24fe4f9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:03.876860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-306a445b-4db2-49f8-b989-c1e9e24fe4f9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:03.877283 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-306a445b-4db2-49f8-b989-c1e9e24fe4f9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:03.905393 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-306a445b-4db2-49f8-b989-c1e9e24fe4f9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040913 Feb 21 01:15:03.906293 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 390/804] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:03 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:04.061524 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-23e8a2e0-38be-4337-9865-ff2c45039b92 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:04.062116 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-23e8a2e0-38be-4337-9865-ff2c45039b92 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:04.068474 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-23e8a2e0-38be-4337-9865-ff2c45039b92 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:04.068921 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-23e8a2e0-38be-4337-9865-ff2c45039b92 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:04.069701 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-23e8a2e0-38be-4337-9865-ff2c45039b92 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:04.070134 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-23e8a2e0-38be-4337-9865-ff2c45039b92 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:04.203401 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-23e8a2e0-38be-4337-9865-ff2c45039b92 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:04.212288 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-23e8a2e0-38be-4337-9865-ff2c45039b92 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:04.215077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-23e8a2e0-38be-4337-9865-ff2c45039b92 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:04.216276 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-23e8a2e0-38be-4337-9865-ff2c45039b92 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158524 Feb 21 01:15:04.216863 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 415/805] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:04 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:04.717335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8be1b565-c4e4-4b2a-9175-c02adf12a4ca tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:04.717791 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8be1b565-c4e4-4b2a-9175-c02adf12a4ca tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:04.723597 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8be1b565-c4e4-4b2a-9175-c02adf12a4ca tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:04.724080 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8be1b565-c4e4-4b2a-9175-c02adf12a4ca tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:04.724863 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8be1b565-c4e4-4b2a-9175-c02adf12a4ca tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:04.725300 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8be1b565-c4e4-4b2a-9175-c02adf12a4ca tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:04.785179 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8be1b565-c4e4-4b2a-9175-c02adf12a4ca tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:04.792523 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8be1b565-c4e4-4b2a-9175-c02adf12a4ca tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079805 Feb 21 01:15:04.793152 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 391/806] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:04 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:04.917140 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1dce954a-9c5e-47ca-acff-f0f13bc0d788 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:04.918081 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1dce954a-9c5e-47ca-acff-f0f13bc0d788 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:04.923972 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1dce954a-9c5e-47ca-acff-f0f13bc0d788 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:04.924465 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1dce954a-9c5e-47ca-acff-f0f13bc0d788 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:04.925243 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1dce954a-9c5e-47ca-acff-f0f13bc0d788 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:04.925678 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1dce954a-9c5e-47ca-acff-f0f13bc0d788 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:04.956120 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1dce954a-9c5e-47ca-acff-f0f13bc0d788 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042835 Feb 21 01:15:04.956785 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 416/807] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:04 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:05.233939 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-15ac5018-3a70-4a89-9aef-5d585f394604 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:05.234545 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-15ac5018-3a70-4a89-9aef-5d585f394604 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:05.240759 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-15ac5018-3a70-4a89-9aef-5d585f394604 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:05.241210 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-15ac5018-3a70-4a89-9aef-5d585f394604 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:05.241979 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-15ac5018-3a70-4a89-9aef-5d585f394604 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:05.242408 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-15ac5018-3a70-4a89-9aef-5d585f394604 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:05.379057 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-15ac5018-3a70-4a89-9aef-5d585f394604 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:05.387533 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-15ac5018-3a70-4a89-9aef-5d585f394604 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:05.389067 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-15ac5018-3a70-4a89-9aef-5d585f394604 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:05.390218 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-15ac5018-3a70-4a89-9aef-5d585f394604 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160069 Feb 21 01:15:05.390769 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 392/808] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:05 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:15:05.809486 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ff19846f-702b-4e58-b200-6314fd01b14c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:05.810089 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ff19846f-702b-4e58-b200-6314fd01b14c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:05.816361 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ff19846f-702b-4e58-b200-6314fd01b14c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:05.816809 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ff19846f-702b-4e58-b200-6314fd01b14c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:05.817594 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ff19846f-702b-4e58-b200-6314fd01b14c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:05.818028 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ff19846f-702b-4e58-b200-6314fd01b14c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:05.880685 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ff19846f-702b-4e58-b200-6314fd01b14c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:05.888711 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ff19846f-702b-4e58-b200-6314fd01b14c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083453 Feb 21 01:15:05.890249 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 417/809] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:05 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:05.968008 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ef5a1236-c6ba-4b78-b814-6eedc2df18d1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:05.968919 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ef5a1236-c6ba-4b78-b814-6eedc2df18d1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:05.974757 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ef5a1236-c6ba-4b78-b814-6eedc2df18d1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:05.975197 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ef5a1236-c6ba-4b78-b814-6eedc2df18d1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:05.976010 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ef5a1236-c6ba-4b78-b814-6eedc2df18d1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:05.976434 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ef5a1236-c6ba-4b78-b814-6eedc2df18d1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:06.005740 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ef5a1236-c6ba-4b78-b814-6eedc2df18d1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041959 Feb 21 01:15:06.006295 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 393/810] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:05 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:06.408766 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b4382e28-3db4-4746-906d-9b1cd65abf9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:06.409371 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b4382e28-3db4-4746-906d-9b1cd65abf9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:06.415225 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b4382e28-3db4-4746-906d-9b1cd65abf9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:06.415675 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b4382e28-3db4-4746-906d-9b1cd65abf9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:06.416496 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b4382e28-3db4-4746-906d-9b1cd65abf9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:06.416931 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b4382e28-3db4-4746-906d-9b1cd65abf9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:06.554973 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b4382e28-3db4-4746-906d-9b1cd65abf9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:06.563233 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b4382e28-3db4-4746-906d-9b1cd65abf9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:06.564767 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b4382e28-3db4-4746-906d-9b1cd65abf9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:06.566073 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b4382e28-3db4-4746-906d-9b1cd65abf9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.161331 Feb 21 01:15:06.566629 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 418/811] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:06 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:06.905732 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1a815a3a-1cf7-43c1-ad5e-54e9f315896f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:06.906632 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1a815a3a-1cf7-43c1-ad5e-54e9f315896f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:06.912922 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1a815a3a-1cf7-43c1-ad5e-54e9f315896f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:06.913364 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1a815a3a-1cf7-43c1-ad5e-54e9f315896f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:06.914138 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1a815a3a-1cf7-43c1-ad5e-54e9f315896f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:06.914569 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1a815a3a-1cf7-43c1-ad5e-54e9f315896f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:06.975993 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1a815a3a-1cf7-43c1-ad5e-54e9f315896f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:06.983379 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1a815a3a-1cf7-43c1-ad5e-54e9f315896f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081816 Feb 21 01:15:06.983954 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 394/812] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:06 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:07.017489 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-db9099ea-a6db-4b48-a158-546db3670132 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:07.018407 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-db9099ea-a6db-4b48-a158-546db3670132 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:07.024695 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db9099ea-a6db-4b48-a158-546db3670132 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:07.025140 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db9099ea-a6db-4b48-a158-546db3670132 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:07.025923 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db9099ea-a6db-4b48-a158-546db3670132 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:07.026357 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db9099ea-a6db-4b48-a158-546db3670132 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:07.056052 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-db9099ea-a6db-4b48-a158-546db3670132 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041994 Feb 21 01:15:07.056612 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 419/813] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:07 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:07.585375 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-bf1569e7-61ce-4528-8a79-96675100b995 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:07.585931 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-bf1569e7-61ce-4528-8a79-96675100b995 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:07.592049 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bf1569e7-61ce-4528-8a79-96675100b995 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:07.592502 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bf1569e7-61ce-4528-8a79-96675100b995 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:07.593283 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bf1569e7-61ce-4528-8a79-96675100b995 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:07.593719 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bf1569e7-61ce-4528-8a79-96675100b995 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:07.725706 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bf1569e7-61ce-4528-8a79-96675100b995 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:07.734674 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bf1569e7-61ce-4528-8a79-96675100b995 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:07.736187 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bf1569e7-61ce-4528-8a79-96675100b995 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:07.737343 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-bf1569e7-61ce-4528-8a79-96675100b995 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155835 Feb 21 01:15:07.737908 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 395/814] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:07 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:08.000311 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0cf8aff3-348c-4e0f-b0b4-bcb29e54e233 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:08.000918 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0cf8aff3-348c-4e0f-b0b4-bcb29e54e233 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:08.006692 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0cf8aff3-348c-4e0f-b0b4-bcb29e54e233 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:08.007130 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0cf8aff3-348c-4e0f-b0b4-bcb29e54e233 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:08.007914 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0cf8aff3-348c-4e0f-b0b4-bcb29e54e233 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:08.008340 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0cf8aff3-348c-4e0f-b0b4-bcb29e54e233 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:08.068416 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0cf8aff3-348c-4e0f-b0b4-bcb29e54e233 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:08.068978 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ec0debc1-2325-4831-862f-b581199d259a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:08.069410 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ec0debc1-2325-4831-862f-b581199d259a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:08.075814 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec0debc1-2325-4831-862f-b581199d259a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:08.076071 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0cf8aff3-348c-4e0f-b0b4-bcb29e54e233 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080080 Feb 21 01:15:08.076287 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec0debc1-2325-4831-862f-b581199d259a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:08.076636 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 420/815] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:07 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:08.077152 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec0debc1-2325-4831-862f-b581199d259a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:08.077661 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec0debc1-2325-4831-862f-b581199d259a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:08.108719 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ec0debc1-2325-4831-862f-b581199d259a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044026 Feb 21 01:15:08.109273 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 396/816] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:08 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:15:08.756144 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d38a620d-8dc9-41cc-987e-cc184afaf5c2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:08.756776 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d38a620d-8dc9-41cc-987e-cc184afaf5c2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:08.763528 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d38a620d-8dc9-41cc-987e-cc184afaf5c2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:08.764003 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d38a620d-8dc9-41cc-987e-cc184afaf5c2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:08.764786 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d38a620d-8dc9-41cc-987e-cc184afaf5c2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:08.765251 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d38a620d-8dc9-41cc-987e-cc184afaf5c2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:08.901354 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d38a620d-8dc9-41cc-987e-cc184afaf5c2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:08.910165 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d38a620d-8dc9-41cc-987e-cc184afaf5c2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:08.911695 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d38a620d-8dc9-41cc-987e-cc184afaf5c2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:08.912887 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d38a620d-8dc9-41cc-987e-cc184afaf5c2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160479 Feb 21 01:15:08.913438 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 421/817] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:08 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:09.092636 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-645fe58b-62dc-48b8-a3d0-d8ef56859a88 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:09.093537 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-645fe58b-62dc-48b8-a3d0-d8ef56859a88 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:09.099809 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-645fe58b-62dc-48b8-a3d0-d8ef56859a88 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:09.100293 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-645fe58b-62dc-48b8-a3d0-d8ef56859a88 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:09.101080 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-645fe58b-62dc-48b8-a3d0-d8ef56859a88 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:09.101514 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-645fe58b-62dc-48b8-a3d0-d8ef56859a88 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:09.120024 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1de0f7a2-5b29-422b-94c1-0cb7a17c6343 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:09.121786 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1de0f7a2-5b29-422b-94c1-0cb7a17c6343 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:09.128457 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1de0f7a2-5b29-422b-94c1-0cb7a17c6343 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:09.129062 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1de0f7a2-5b29-422b-94c1-0cb7a17c6343 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:09.129853 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1de0f7a2-5b29-422b-94c1-0cb7a17c6343 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:09.130436 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1de0f7a2-5b29-422b-94c1-0cb7a17c6343 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:09.162118 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1de0f7a2-5b29-422b-94c1-0cb7a17c6343 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045860 Feb 21 01:15:09.162675 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 422/818] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:09 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:15:09.166870 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-645fe58b-62dc-48b8-a3d0-d8ef56859a88 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:09.174823 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-645fe58b-62dc-48b8-a3d0-d8ef56859a88 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.085929 Feb 21 01:15:09.175390 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 397/819] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:09 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:09.931145 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4af0e24e-0a67-4431-92ea-93ac9d42940e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:09.931738 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4af0e24e-0a67-4431-92ea-93ac9d42940e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:09.938280 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4af0e24e-0a67-4431-92ea-93ac9d42940e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:09.938729 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4af0e24e-0a67-4431-92ea-93ac9d42940e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:09.939492 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4af0e24e-0a67-4431-92ea-93ac9d42940e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:09.939945 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4af0e24e-0a67-4431-92ea-93ac9d42940e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:10.073041 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4af0e24e-0a67-4431-92ea-93ac9d42940e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:10.081611 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4af0e24e-0a67-4431-92ea-93ac9d42940e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:10.083110 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4af0e24e-0a67-4431-92ea-93ac9d42940e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:10.084294 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4af0e24e-0a67-4431-92ea-93ac9d42940e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156822 Feb 21 01:15:10.084857 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 423/820] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:09 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:10.174287 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ca4fc24d-b91e-48be-919b-1ada128043e4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:10.175200 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ca4fc24d-b91e-48be-919b-1ada128043e4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:10.181499 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ca4fc24d-b91e-48be-919b-1ada128043e4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:10.181894 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ca4fc24d-b91e-48be-919b-1ada128043e4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:10.182677 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ca4fc24d-b91e-48be-919b-1ada128043e4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:10.183114 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ca4fc24d-b91e-48be-919b-1ada128043e4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:10.190823 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9dc70917-2328-4461-819e-1c5e47e5e4e4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:10.191433 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9dc70917-2328-4461-819e-1c5e47e5e4e4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:10.197683 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9dc70917-2328-4461-819e-1c5e47e5e4e4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:10.198132 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9dc70917-2328-4461-819e-1c5e47e5e4e4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:10.198916 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9dc70917-2328-4461-819e-1c5e47e5e4e4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:10.199356 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9dc70917-2328-4461-819e-1c5e47e5e4e4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:10.213101 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ca4fc24d-b91e-48be-919b-1ada128043e4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042554 Feb 21 01:15:10.216627 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 398/821] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:10 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:15:10.262304 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9dc70917-2328-4461-819e-1c5e47e5e4e4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:10.269543 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9dc70917-2328-4461-819e-1c5e47e5e4e4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082319 Feb 21 01:15:10.270097 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 424/822] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:10 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:15:11.102223 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9555066b-930f-4a36-96e1-f4261e75a891 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:11.102827 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9555066b-930f-4a36-96e1-f4261e75a891 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:11.109688 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9555066b-930f-4a36-96e1-f4261e75a891 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:11.110136 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9555066b-930f-4a36-96e1-f4261e75a891 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:11.110994 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9555066b-930f-4a36-96e1-f4261e75a891 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:11.111429 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9555066b-930f-4a36-96e1-f4261e75a891 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:11.226246 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-593d8772-5432-4ac5-b609-ededfabb1c1c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:11.227515 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-593d8772-5432-4ac5-b609-ededfabb1c1c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:11.234255 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-593d8772-5432-4ac5-b609-ededfabb1c1c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:11.237446 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-593d8772-5432-4ac5-b609-ededfabb1c1c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:11.237446 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-593d8772-5432-4ac5-b609-ededfabb1c1c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:11.237446 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-593d8772-5432-4ac5-b609-ededfabb1c1c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:11.247191 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9555066b-930f-4a36-96e1-f4261e75a891 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:11.255445 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9555066b-930f-4a36-96e1-f4261e75a891 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:11.256968 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9555066b-930f-4a36-96e1-f4261e75a891 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:11.258133 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9555066b-930f-4a36-96e1-f4261e75a891 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159618 Feb 21 01:15:11.258692 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 399/823] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:11 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:11.265652 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-593d8772-5432-4ac5-b609-ededfabb1c1c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043104 Feb 21 01:15:11.266388 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 425/824] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:11 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:15:11.286031 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7b649776-a59e-4c1d-99f2-5dc669416695 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:11.286645 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7b649776-a59e-4c1d-99f2-5dc669416695 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:11.292401 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7b649776-a59e-4c1d-99f2-5dc669416695 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:11.292847 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7b649776-a59e-4c1d-99f2-5dc669416695 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:11.294659 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7b649776-a59e-4c1d-99f2-5dc669416695 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:11.294659 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7b649776-a59e-4c1d-99f2-5dc669416695 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:11.355021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7b649776-a59e-4c1d-99f2-5dc669416695 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:11.363165 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7b649776-a59e-4c1d-99f2-5dc669416695 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080737 Feb 21 01:15:11.363741 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 400/825] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:11 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:12.276371 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f4829866-0950-4be6-a28f-2aaf19cf37e4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:12.276926 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c8e7441c-7e82-4774-996e-98f4d8804883 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:12.277360 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f4829866-0950-4be6-a28f-2aaf19cf37e4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:12.278405 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c8e7441c-7e82-4774-996e-98f4d8804883 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:12.284374 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f4829866-0950-4be6-a28f-2aaf19cf37e4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:12.284828 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f4829866-0950-4be6-a28f-2aaf19cf37e4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:12.284945 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c8e7441c-7e82-4774-996e-98f4d8804883 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:12.285304 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c8e7441c-7e82-4774-996e-98f4d8804883 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:12.285617 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f4829866-0950-4be6-a28f-2aaf19cf37e4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:12.286051 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f4829866-0950-4be6-a28f-2aaf19cf37e4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:12.286180 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c8e7441c-7e82-4774-996e-98f4d8804883 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:12.286540 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c8e7441c-7e82-4774-996e-98f4d8804883 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:12.316262 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c8e7441c-7e82-4774-996e-98f4d8804883 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043107 Feb 21 01:15:12.316817 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 401/826] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:12 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:15:12.379921 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7d6113d1-b389-41fa-93f0-e9a7d2a78bf4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:12.380533 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7d6113d1-b389-41fa-93f0-e9a7d2a78bf4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:12.386473 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7d6113d1-b389-41fa-93f0-e9a7d2a78bf4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:12.386968 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7d6113d1-b389-41fa-93f0-e9a7d2a78bf4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:12.387761 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7d6113d1-b389-41fa-93f0-e9a7d2a78bf4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:12.388222 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7d6113d1-b389-41fa-93f0-e9a7d2a78bf4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:12.425625 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f4829866-0950-4be6-a28f-2aaf19cf37e4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:12.434673 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f4829866-0950-4be6-a28f-2aaf19cf37e4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:12.436167 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f4829866-0950-4be6-a28f-2aaf19cf37e4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:12.437311 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f4829866-0950-4be6-a28f-2aaf19cf37e4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.164846 Feb 21 01:15:12.437867 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 426/827] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:12 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:15:12.450716 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7d6113d1-b389-41fa-93f0-e9a7d2a78bf4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:12.458112 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7d6113d1-b389-41fa-93f0-e9a7d2a78bf4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081876 Feb 21 01:15:12.458672 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 402/828] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:12 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:15:13.327903 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1ae1133b-1673-467a-afb8-a4f075c4d2e0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:13.328815 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1ae1133b-1673-467a-afb8-a4f075c4d2e0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:13.335027 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1ae1133b-1673-467a-afb8-a4f075c4d2e0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:13.335465 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1ae1133b-1673-467a-afb8-a4f075c4d2e0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:13.336264 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1ae1133b-1673-467a-afb8-a4f075c4d2e0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:13.336688 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1ae1133b-1673-467a-afb8-a4f075c4d2e0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:13.369060 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1ae1133b-1673-467a-afb8-a4f075c4d2e0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045315 Feb 21 01:15:13.369630 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 427/829] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:13 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:13.455847 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d4b0b697-ef05-40a4-a46b-1cfd8b75f1fc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:13.456469 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d4b0b697-ef05-40a4-a46b-1cfd8b75f1fc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:13.462734 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d4b0b697-ef05-40a4-a46b-1cfd8b75f1fc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:13.463241 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d4b0b697-ef05-40a4-a46b-1cfd8b75f1fc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:13.464002 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d4b0b697-ef05-40a4-a46b-1cfd8b75f1fc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:13.464442 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d4b0b697-ef05-40a4-a46b-1cfd8b75f1fc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:13.475628 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ab5feeb7-180c-4f6c-ab88-93216d0bc862 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:13.476275 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ab5feeb7-180c-4f6c-ab88-93216d0bc862 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:13.482344 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ab5feeb7-180c-4f6c-ab88-93216d0bc862 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:13.482797 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ab5feeb7-180c-4f6c-ab88-93216d0bc862 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:13.483590 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ab5feeb7-180c-4f6c-ab88-93216d0bc862 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:13.484063 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ab5feeb7-180c-4f6c-ab88-93216d0bc862 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:13.547365 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ab5feeb7-180c-4f6c-ab88-93216d0bc862 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:13.555888 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ab5feeb7-180c-4f6c-ab88-93216d0bc862 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.085058 Feb 21 01:15:13.556630 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 428/830] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:13 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:15:13.687656 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d4b0b697-ef05-40a4-a46b-1cfd8b75f1fc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:13.695824 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d4b0b697-ef05-40a4-a46b-1cfd8b75f1fc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:13.697364 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d4b0b697-ef05-40a4-a46b-1cfd8b75f1fc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:13.698523 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d4b0b697-ef05-40a4-a46b-1cfd8b75f1fc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.246420 Feb 21 01:15:13.699110 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 403/831] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:13 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:14.380504 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-856a4e40-caea-4d36-8e68-76e0014f26aa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:14.381417 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-856a4e40-caea-4d36-8e68-76e0014f26aa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:14.388806 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-856a4e40-caea-4d36-8e68-76e0014f26aa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:14.389184 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-856a4e40-caea-4d36-8e68-76e0014f26aa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:14.390135 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-856a4e40-caea-4d36-8e68-76e0014f26aa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:14.390569 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-856a4e40-caea-4d36-8e68-76e0014f26aa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:14.423046 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-856a4e40-caea-4d36-8e68-76e0014f26aa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046193 Feb 21 01:15:14.423605 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 429/832] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:14 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:14.573410 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f9ea5646-f43f-4e0a-8e21-3f328d63a559 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:14.574023 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f9ea5646-f43f-4e0a-8e21-3f328d63a559 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:14.580588 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f9ea5646-f43f-4e0a-8e21-3f328d63a559 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:14.581038 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f9ea5646-f43f-4e0a-8e21-3f328d63a559 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:14.581821 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f9ea5646-f43f-4e0a-8e21-3f328d63a559 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:14.582253 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f9ea5646-f43f-4e0a-8e21-3f328d63a559 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:14.647268 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f9ea5646-f43f-4e0a-8e21-3f328d63a559 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:14.654795 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f9ea5646-f43f-4e0a-8e21-3f328d63a559 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.085001 Feb 21 01:15:14.655584 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 404/833] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:14 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:14.716997 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-85d29770-14bd-499b-824a-95db9028150f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:14.717632 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-85d29770-14bd-499b-824a-95db9028150f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:14.723489 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-85d29770-14bd-499b-824a-95db9028150f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:14.723965 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-85d29770-14bd-499b-824a-95db9028150f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:14.724762 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-85d29770-14bd-499b-824a-95db9028150f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:14.725197 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-85d29770-14bd-499b-824a-95db9028150f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:14.866608 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-85d29770-14bd-499b-824a-95db9028150f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:14.875676 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-85d29770-14bd-499b-824a-95db9028150f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:14.877189 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-85d29770-14bd-499b-824a-95db9028150f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:14.878336 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-85d29770-14bd-499b-824a-95db9028150f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.165041 Feb 21 01:15:14.878887 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 430/834] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:14 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:15.434719 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0d4b6ff3-210b-4ddb-a0a3-48fc19d38477 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:15.436308 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0d4b6ff3-210b-4ddb-a0a3-48fc19d38477 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:15.442746 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0d4b6ff3-210b-4ddb-a0a3-48fc19d38477 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:15.443188 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0d4b6ff3-210b-4ddb-a0a3-48fc19d38477 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:15.444003 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0d4b6ff3-210b-4ddb-a0a3-48fc19d38477 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:15.444433 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0d4b6ff3-210b-4ddb-a0a3-48fc19d38477 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:15.474233 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0d4b6ff3-210b-4ddb-a0a3-48fc19d38477 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043390 Feb 21 01:15:15.474791 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 405/835] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:15 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:15.671105 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d61a9697-53fa-4727-852f-72fee4b60b6a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:15.671664 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d61a9697-53fa-4727-852f-72fee4b60b6a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:15.677857 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d61a9697-53fa-4727-852f-72fee4b60b6a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:15.678306 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d61a9697-53fa-4727-852f-72fee4b60b6a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:15.679074 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d61a9697-53fa-4727-852f-72fee4b60b6a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:15.679517 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d61a9697-53fa-4727-852f-72fee4b60b6a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:15.740079 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d61a9697-53fa-4727-852f-72fee4b60b6a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:15.747576 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d61a9697-53fa-4727-852f-72fee4b60b6a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080988 Feb 21 01:15:15.748590 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 431/836] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:15 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:15.897324 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b8095e8e-c0eb-4615-908f-f4c21476ec00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:15.897910 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b8095e8e-c0eb-4615-908f-f4c21476ec00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:15.905342 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b8095e8e-c0eb-4615-908f-f4c21476ec00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:15.906048 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b8095e8e-c0eb-4615-908f-f4c21476ec00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:15.906856 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b8095e8e-c0eb-4615-908f-f4c21476ec00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:15.907294 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b8095e8e-c0eb-4615-908f-f4c21476ec00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:16.044174 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b8095e8e-c0eb-4615-908f-f4c21476ec00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:16.052705 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b8095e8e-c0eb-4615-908f-f4c21476ec00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:16.054171 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b8095e8e-c0eb-4615-908f-f4c21476ec00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:16.055308 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b8095e8e-c0eb-4615-908f-f4c21476ec00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.161796 Feb 21 01:15:16.055881 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 406/837] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:15 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:15:16.485711 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-69cb7aa5-0020-46b5-9780-d855f90b361c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:16.486652 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-69cb7aa5-0020-46b5-9780-d855f90b361c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:16.493553 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-69cb7aa5-0020-46b5-9780-d855f90b361c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:16.493993 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-69cb7aa5-0020-46b5-9780-d855f90b361c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:16.494765 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-69cb7aa5-0020-46b5-9780-d855f90b361c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:16.495224 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-69cb7aa5-0020-46b5-9780-d855f90b361c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:16.524453 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-69cb7aa5-0020-46b5-9780-d855f90b361c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042526 Feb 21 01:15:16.524996 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 432/838] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:16 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:15:16.763579 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1d05c72b-c87b-4e1e-a497-84c98ae121e1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:16.764333 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1d05c72b-c87b-4e1e-a497-84c98ae121e1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:16.770131 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1d05c72b-c87b-4e1e-a497-84c98ae121e1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:16.770573 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1d05c72b-c87b-4e1e-a497-84c98ae121e1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:16.771347 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1d05c72b-c87b-4e1e-a497-84c98ae121e1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:16.771776 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1d05c72b-c87b-4e1e-a497-84c98ae121e1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:16.831067 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1d05c72b-c87b-4e1e-a497-84c98ae121e1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:16.838404 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1d05c72b-c87b-4e1e-a497-84c98ae121e1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.078499 Feb 21 01:15:16.838957 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 407/839] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:16 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:17.073489 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-aca88732-4a7d-4ea3-b491-eb656f7c300b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:17.074036 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-aca88732-4a7d-4ea3-b491-eb656f7c300b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:17.080386 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aca88732-4a7d-4ea3-b491-eb656f7c300b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:17.080830 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aca88732-4a7d-4ea3-b491-eb656f7c300b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:17.081610 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aca88732-4a7d-4ea3-b491-eb656f7c300b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:17.082035 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aca88732-4a7d-4ea3-b491-eb656f7c300b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:17.216711 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-aca88732-4a7d-4ea3-b491-eb656f7c300b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:17.224969 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-aca88732-4a7d-4ea3-b491-eb656f7c300b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:17.226456 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-aca88732-4a7d-4ea3-b491-eb656f7c300b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:17.227602 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-aca88732-4a7d-4ea3-b491-eb656f7c300b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157934 Feb 21 01:15:17.228195 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 433/840] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:17 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:17.536543 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b0759e1a-46f3-4d7d-a8c0-e1de7e11473e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:17.537450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b0759e1a-46f3-4d7d-a8c0-e1de7e11473e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:17.543361 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b0759e1a-46f3-4d7d-a8c0-e1de7e11473e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:17.543796 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b0759e1a-46f3-4d7d-a8c0-e1de7e11473e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:17.544742 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b0759e1a-46f3-4d7d-a8c0-e1de7e11473e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:17.545174 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b0759e1a-46f3-4d7d-a8c0-e1de7e11473e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:17.573413 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b0759e1a-46f3-4d7d-a8c0-e1de7e11473e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040658 Feb 21 01:15:17.573961 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 408/841] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:17 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:17.854221 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-173142cb-a112-48b7-9980-77de9f36eaa7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:17.854893 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-173142cb-a112-48b7-9980-77de9f36eaa7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:17.861371 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-173142cb-a112-48b7-9980-77de9f36eaa7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:17.861819 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-173142cb-a112-48b7-9980-77de9f36eaa7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:17.862607 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-173142cb-a112-48b7-9980-77de9f36eaa7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:17.863039 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-173142cb-a112-48b7-9980-77de9f36eaa7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:17.923724 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-173142cb-a112-48b7-9980-77de9f36eaa7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:17.931698 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-173142cb-a112-48b7-9980-77de9f36eaa7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081103 Feb 21 01:15:17.932331 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 434/842] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:17 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:18.245774 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f1ab8911-df72-4734-8afe-87a49bee7874 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:18.246384 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f1ab8911-df72-4734-8afe-87a49bee7874 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:18.253132 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f1ab8911-df72-4734-8afe-87a49bee7874 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:18.253582 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f1ab8911-df72-4734-8afe-87a49bee7874 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:18.254355 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f1ab8911-df72-4734-8afe-87a49bee7874 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:18.254789 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f1ab8911-df72-4734-8afe-87a49bee7874 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:18.389896 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f1ab8911-df72-4734-8afe-87a49bee7874 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:18.398077 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f1ab8911-df72-4734-8afe-87a49bee7874 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:18.399571 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f1ab8911-df72-4734-8afe-87a49bee7874 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:18.400753 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f1ab8911-df72-4734-8afe-87a49bee7874 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158703 Feb 21 01:15:18.401317 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 409/843] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:18 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:18.585480 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f9e6dbe8-2d65-4581-906f-bc846475c785 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:18.586315 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f9e6dbe8-2d65-4581-906f-bc846475c785 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:18.593160 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f9e6dbe8-2d65-4581-906f-bc846475c785 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:18.593613 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f9e6dbe8-2d65-4581-906f-bc846475c785 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:18.594396 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f9e6dbe8-2d65-4581-906f-bc846475c785 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:18.594831 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f9e6dbe8-2d65-4581-906f-bc846475c785 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:18.625354 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f9e6dbe8-2d65-4581-906f-bc846475c785 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043761 Feb 21 01:15:18.625920 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 435/844] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:18 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:18.948935 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5db4eac0-6f74-41f5-9fd5-8f0e0d822c53 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:18.949476 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5db4eac0-6f74-41f5-9fd5-8f0e0d822c53 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:18.955855 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5db4eac0-6f74-41f5-9fd5-8f0e0d822c53 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:18.956317 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5db4eac0-6f74-41f5-9fd5-8f0e0d822c53 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:18.957087 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5db4eac0-6f74-41f5-9fd5-8f0e0d822c53 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:18.957508 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5db4eac0-6f74-41f5-9fd5-8f0e0d822c53 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:19.016660 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5db4eac0-6f74-41f5-9fd5-8f0e0d822c53 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:19.024050 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5db4eac0-6f74-41f5-9fd5-8f0e0d822c53 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.078806 Feb 21 01:15:19.024702 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 410/845] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:18 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:19.420310 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c829d675-736d-42f0-a43a-d34611227377 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:19.420979 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c829d675-736d-42f0-a43a-d34611227377 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:19.427272 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c829d675-736d-42f0-a43a-d34611227377 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:19.427752 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c829d675-736d-42f0-a43a-d34611227377 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:19.428581 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c829d675-736d-42f0-a43a-d34611227377 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:19.429017 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c829d675-736d-42f0-a43a-d34611227377 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:19.579436 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c829d675-736d-42f0-a43a-d34611227377 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:19.579436 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c829d675-736d-42f0-a43a-d34611227377 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:19.579675 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c829d675-736d-42f0-a43a-d34611227377 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:19.579675 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c829d675-736d-42f0-a43a-d34611227377 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.163515 Feb 21 01:15:19.579950 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 436/846] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:19 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:19.637275 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-00ad68db-4983-4545-84c3-72e89097d8ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:19.638291 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-00ad68db-4983-4545-84c3-72e89097d8ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:19.645017 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-00ad68db-4983-4545-84c3-72e89097d8ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:19.645462 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-00ad68db-4983-4545-84c3-72e89097d8ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:19.646248 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-00ad68db-4983-4545-84c3-72e89097d8ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:19.646681 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-00ad68db-4983-4545-84c3-72e89097d8ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:19.677205 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-00ad68db-4983-4545-84c3-72e89097d8ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043697 Feb 21 01:15:19.677758 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 411/847] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:19 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:20.040904 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0c2c4afb-4cc1-455a-a3eb-53425f3a58a6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:20.041535 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0c2c4afb-4cc1-455a-a3eb-53425f3a58a6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:20.048038 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0c2c4afb-4cc1-455a-a3eb-53425f3a58a6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:20.048489 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0c2c4afb-4cc1-455a-a3eb-53425f3a58a6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:20.049274 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0c2c4afb-4cc1-455a-a3eb-53425f3a58a6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:20.049713 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0c2c4afb-4cc1-455a-a3eb-53425f3a58a6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:20.109502 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0c2c4afb-4cc1-455a-a3eb-53425f3a58a6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:20.116897 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0c2c4afb-4cc1-455a-a3eb-53425f3a58a6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079711 Feb 21 01:15:20.117473 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 437/848] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:20 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:20.598295 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-bcab15b9-4c63-4eb2-9e48-934f3e67a192 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:20.598892 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-bcab15b9-4c63-4eb2-9e48-934f3e67a192 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:20.605060 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bcab15b9-4c63-4eb2-9e48-934f3e67a192 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:20.605498 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bcab15b9-4c63-4eb2-9e48-934f3e67a192 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:20.606266 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bcab15b9-4c63-4eb2-9e48-934f3e67a192 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:20.606692 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bcab15b9-4c63-4eb2-9e48-934f3e67a192 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:20.690201 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-98dd8c54-2e00-41a7-8dd1-0d2b3745cb6c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:20.691117 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-98dd8c54-2e00-41a7-8dd1-0d2b3745cb6c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:20.697045 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-98dd8c54-2e00-41a7-8dd1-0d2b3745cb6c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:20.697496 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-98dd8c54-2e00-41a7-8dd1-0d2b3745cb6c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:20.698291 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-98dd8c54-2e00-41a7-8dd1-0d2b3745cb6c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:20.698727 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-98dd8c54-2e00-41a7-8dd1-0d2b3745cb6c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:20.729909 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-98dd8c54-2e00-41a7-8dd1-0d2b3745cb6c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044559 Feb 21 01:15:20.730481 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 438/849] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:20 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:15:20.740216 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bcab15b9-4c63-4eb2-9e48-934f3e67a192 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:20.748737 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bcab15b9-4c63-4eb2-9e48-934f3e67a192 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:20.750222 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bcab15b9-4c63-4eb2-9e48-934f3e67a192 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:20.751369 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-bcab15b9-4c63-4eb2-9e48-934f3e67a192 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156809 Feb 21 01:15:20.751952 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 412/850] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:20 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:21.133687 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0f42eb13-00e8-4e13-9034-fe19a0c62144 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:21.134840 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0f42eb13-00e8-4e13-9034-fe19a0c62144 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:21.142312 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0f42eb13-00e8-4e13-9034-fe19a0c62144 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:21.142769 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0f42eb13-00e8-4e13-9034-fe19a0c62144 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:21.143576 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0f42eb13-00e8-4e13-9034-fe19a0c62144 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:21.144032 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0f42eb13-00e8-4e13-9034-fe19a0c62144 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:21.203743 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0f42eb13-00e8-4e13-9034-fe19a0c62144 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:21.211296 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0f42eb13-00e8-4e13-9034-fe19a0c62144 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081264 Feb 21 01:15:21.211866 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 439/851] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:21 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:21.741869 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b2dbfb71-4600-4862-a6de-4f8bef0fdec3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:21.742824 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b2dbfb71-4600-4862-a6de-4f8bef0fdec3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:21.751756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b2dbfb71-4600-4862-a6de-4f8bef0fdec3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:21.752235 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b2dbfb71-4600-4862-a6de-4f8bef0fdec3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:21.753022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b2dbfb71-4600-4862-a6de-4f8bef0fdec3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:21.753454 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b2dbfb71-4600-4862-a6de-4f8bef0fdec3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:21.770503 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8fb9faa0-a4ed-442c-8bb6-54e57fef771a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:21.771101 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8fb9faa0-a4ed-442c-8bb6-54e57fef771a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:21.777247 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8fb9faa0-a4ed-442c-8bb6-54e57fef771a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:21.777682 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8fb9faa0-a4ed-442c-8bb6-54e57fef771a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:21.778469 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8fb9faa0-a4ed-442c-8bb6-54e57fef771a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:21.779299 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8fb9faa0-a4ed-442c-8bb6-54e57fef771a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:21.783760 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b2dbfb71-4600-4862-a6de-4f8bef0fdec3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045774 Feb 21 01:15:21.784679 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 413/852] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:21 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:21.913765 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8fb9faa0-a4ed-442c-8bb6-54e57fef771a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:21.922516 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8fb9faa0-a4ed-442c-8bb6-54e57fef771a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:21.924032 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8fb9faa0-a4ed-442c-8bb6-54e57fef771a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:21.925172 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8fb9faa0-a4ed-442c-8bb6-54e57fef771a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158528 Feb 21 01:15:21.925718 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 440/853] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:21 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:15:22.227809 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ff513fcf-02a4-4a06-8d5a-264069c3572f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:22.228432 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ff513fcf-02a4-4a06-8d5a-264069c3572f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:22.235233 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ff513fcf-02a4-4a06-8d5a-264069c3572f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:22.237021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ff513fcf-02a4-4a06-8d5a-264069c3572f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:22.237021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ff513fcf-02a4-4a06-8d5a-264069c3572f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:22.237021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ff513fcf-02a4-4a06-8d5a-264069c3572f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:22.296833 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ff513fcf-02a4-4a06-8d5a-264069c3572f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:22.304207 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ff513fcf-02a4-4a06-8d5a-264069c3572f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080078 Feb 21 01:15:22.304754 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 414/854] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:22 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:22.795493 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-90bc9051-2654-4018-884a-f0a0ca6acd45 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:22.796487 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-90bc9051-2654-4018-884a-f0a0ca6acd45 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:22.803059 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-90bc9051-2654-4018-884a-f0a0ca6acd45 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:22.803508 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-90bc9051-2654-4018-884a-f0a0ca6acd45 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:22.804333 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-90bc9051-2654-4018-884a-f0a0ca6acd45 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:22.804772 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-90bc9051-2654-4018-884a-f0a0ca6acd45 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:22.835499 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-90bc9051-2654-4018-884a-f0a0ca6acd45 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044054 Feb 21 01:15:22.836096 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 441/855] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:22 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:23.047414 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-17abdba8-f016-4b36-a7fb-6f42d0e20a37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:23.047983 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-17abdba8-f016-4b36-a7fb-6f42d0e20a37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:23.053803 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-17abdba8-f016-4b36-a7fb-6f42d0e20a37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:23.054245 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-17abdba8-f016-4b36-a7fb-6f42d0e20a37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:23.055010 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-17abdba8-f016-4b36-a7fb-6f42d0e20a37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:23.055434 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-17abdba8-f016-4b36-a7fb-6f42d0e20a37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:23.192084 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-17abdba8-f016-4b36-a7fb-6f42d0e20a37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:23.200128 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-17abdba8-f016-4b36-a7fb-6f42d0e20a37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:23.202238 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-17abdba8-f016-4b36-a7fb-6f42d0e20a37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:23.203375 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-17abdba8-f016-4b36-a7fb-6f42d0e20a37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.263921 Feb 21 01:15:23.203941 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 415/856] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:22 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:23.321868 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ba88bdfb-0a87-47cb-b38b-7e2ce710d4eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:23.322519 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ba88bdfb-0a87-47cb-b38b-7e2ce710d4eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:23.329305 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ba88bdfb-0a87-47cb-b38b-7e2ce710d4eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:23.329758 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ba88bdfb-0a87-47cb-b38b-7e2ce710d4eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:23.330544 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ba88bdfb-0a87-47cb-b38b-7e2ce710d4eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:23.330983 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ba88bdfb-0a87-47cb-b38b-7e2ce710d4eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:23.391634 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ba88bdfb-0a87-47cb-b38b-7e2ce710d4eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:23.399081 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ba88bdfb-0a87-47cb-b38b-7e2ce710d4eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080931 Feb 21 01:15:23.399651 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 442/857] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:23 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:23.846506 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-601cc7b3-7741-4b89-9bf8-aa173680121f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:23.847478 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-601cc7b3-7741-4b89-9bf8-aa173680121f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:23.853324 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-601cc7b3-7741-4b89-9bf8-aa173680121f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:23.853766 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-601cc7b3-7741-4b89-9bf8-aa173680121f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:23.854574 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-601cc7b3-7741-4b89-9bf8-aa173680121f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:23.855005 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-601cc7b3-7741-4b89-9bf8-aa173680121f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:23.885155 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-601cc7b3-7741-4b89-9bf8-aa173680121f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042358 Feb 21 01:15:23.885706 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 416/858] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:23 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:24.221635 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8fa0975a-6f6f-4886-b4e8-7e663ee499e0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:24.222245 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8fa0975a-6f6f-4886-b4e8-7e663ee499e0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:24.228533 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8fa0975a-6f6f-4886-b4e8-7e663ee499e0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:24.228980 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8fa0975a-6f6f-4886-b4e8-7e663ee499e0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:24.229786 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8fa0975a-6f6f-4886-b4e8-7e663ee499e0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:24.230217 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8fa0975a-6f6f-4886-b4e8-7e663ee499e0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:24.362910 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8fa0975a-6f6f-4886-b4e8-7e663ee499e0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:24.371066 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8fa0975a-6f6f-4886-b4e8-7e663ee499e0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:24.373283 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8fa0975a-6f6f-4886-b4e8-7e663ee499e0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:24.374425 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8fa0975a-6f6f-4886-b4e8-7e663ee499e0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156550 Feb 21 01:15:24.374971 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 443/859] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:24 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:24.416497 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cf3fb69c-76bc-4001-861f-2f0f0cde111b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:24.417108 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cf3fb69c-76bc-4001-861f-2f0f0cde111b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:24.423986 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cf3fb69c-76bc-4001-861f-2f0f0cde111b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:24.424435 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cf3fb69c-76bc-4001-861f-2f0f0cde111b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:24.425243 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cf3fb69c-76bc-4001-861f-2f0f0cde111b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:24.425690 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cf3fb69c-76bc-4001-861f-2f0f0cde111b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:24.485654 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cf3fb69c-76bc-4001-861f-2f0f0cde111b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:24.493139 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cf3fb69c-76bc-4001-861f-2f0f0cde111b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080362 Feb 21 01:15:24.493732 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 417/860] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:24 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:24.897351 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a2a0cb2e-0b5c-43f2-9d17-59ee0659a64b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:24.898198 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a2a0cb2e-0b5c-43f2-9d17-59ee0659a64b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:24.904607 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a2a0cb2e-0b5c-43f2-9d17-59ee0659a64b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:24.905167 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a2a0cb2e-0b5c-43f2-9d17-59ee0659a64b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:24.906205 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a2a0cb2e-0b5c-43f2-9d17-59ee0659a64b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:24.906635 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a2a0cb2e-0b5c-43f2-9d17-59ee0659a64b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:24.935527 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a2a0cb2e-0b5c-43f2-9d17-59ee0659a64b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041933 Feb 21 01:15:24.936123 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 444/861] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:24 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:25.393073 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5b58291e-85b9-4bb2-9dae-9653d855b7a3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:25.393686 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5b58291e-85b9-4bb2-9dae-9653d855b7a3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:25.399650 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5b58291e-85b9-4bb2-9dae-9653d855b7a3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:25.400128 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5b58291e-85b9-4bb2-9dae-9653d855b7a3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:25.400911 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5b58291e-85b9-4bb2-9dae-9653d855b7a3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:25.401345 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5b58291e-85b9-4bb2-9dae-9653d855b7a3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:25.510490 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3af64a6b-f2e2-4e64-a29a-ec022177c426 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:25.511077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3af64a6b-f2e2-4e64-a29a-ec022177c426 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:25.519224 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3af64a6b-f2e2-4e64-a29a-ec022177c426 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:25.519757 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3af64a6b-f2e2-4e64-a29a-ec022177c426 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:25.520610 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3af64a6b-f2e2-4e64-a29a-ec022177c426 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:25.521041 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3af64a6b-f2e2-4e64-a29a-ec022177c426 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:25.541377 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5b58291e-85b9-4bb2-9dae-9653d855b7a3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:25.550462 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5b58291e-85b9-4bb2-9dae-9653d855b7a3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:25.551977 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5b58291e-85b9-4bb2-9dae-9653d855b7a3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:25.553177 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5b58291e-85b9-4bb2-9dae-9653d855b7a3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.163899 Feb 21 01:15:25.553728 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 418/862] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:25 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:25.587124 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3af64a6b-f2e2-4e64-a29a-ec022177c426 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:25.594660 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3af64a6b-f2e2-4e64-a29a-ec022177c426 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.088060 Feb 21 01:15:25.595220 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 445/863] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:25 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:15:25.946785 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ae77e0c9-278a-44ed-8f48-3dc70ec9c306 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:25.947636 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ae77e0c9-278a-44ed-8f48-3dc70ec9c306 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:25.953709 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ae77e0c9-278a-44ed-8f48-3dc70ec9c306 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:25.954084 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ae77e0c9-278a-44ed-8f48-3dc70ec9c306 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:25.954912 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ae77e0c9-278a-44ed-8f48-3dc70ec9c306 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:25.955348 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ae77e0c9-278a-44ed-8f48-3dc70ec9c306 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:25.984783 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ae77e0c9-278a-44ed-8f48-3dc70ec9c306 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041986 Feb 21 01:15:25.985356 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 419/864] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:25 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:26.572089 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-669f7a55-66cf-44e6-8bca-bb8c24a5955c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:26.572730 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-669f7a55-66cf-44e6-8bca-bb8c24a5955c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:26.579598 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-669f7a55-66cf-44e6-8bca-bb8c24a5955c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:26.580080 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-669f7a55-66cf-44e6-8bca-bb8c24a5955c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:26.580861 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-669f7a55-66cf-44e6-8bca-bb8c24a5955c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:26.581294 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-669f7a55-66cf-44e6-8bca-bb8c24a5955c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:26.611448 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ee43583e-9ec1-41f5-9884-55ea94b1a490 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:26.612167 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ee43583e-9ec1-41f5-9884-55ea94b1a490 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:26.618546 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee43583e-9ec1-41f5-9884-55ea94b1a490 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:26.618998 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee43583e-9ec1-41f5-9884-55ea94b1a490 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:26.619804 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee43583e-9ec1-41f5-9884-55ea94b1a490 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:26.620274 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee43583e-9ec1-41f5-9884-55ea94b1a490 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:26.718422 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-669f7a55-66cf-44e6-8bca-bb8c24a5955c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:26.727095 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-669f7a55-66cf-44e6-8bca-bb8c24a5955c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:26.728630 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-669f7a55-66cf-44e6-8bca-bb8c24a5955c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:26.729804 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-669f7a55-66cf-44e6-8bca-bb8c24a5955c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.161382 Feb 21 01:15:26.730375 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 446/865] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:26 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:26.905455 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ee43583e-9ec1-41f5-9884-55ea94b1a490 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:26.913179 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ee43583e-9ec1-41f5-9884-55ea94b1a490 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.305428 Feb 21 01:15:26.913743 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 420/866] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:26 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:15:26.996259 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ee9beabf-477e-4f2c-ae7f-6c86348d6daa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:26.997171 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ee9beabf-477e-4f2c-ae7f-6c86348d6daa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:27.003575 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ee9beabf-477e-4f2c-ae7f-6c86348d6daa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:27.004053 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ee9beabf-477e-4f2c-ae7f-6c86348d6daa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:27.004832 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ee9beabf-477e-4f2c-ae7f-6c86348d6daa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:27.005261 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ee9beabf-477e-4f2c-ae7f-6c86348d6daa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:27.034397 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ee9beabf-477e-4f2c-ae7f-6c86348d6daa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041852 Feb 21 01:15:27.034949 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 447/867] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:26 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:27.748615 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-973bd534-7129-4734-819d-06d22e972150 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:27.749219 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-973bd534-7129-4734-819d-06d22e972150 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:27.755313 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-973bd534-7129-4734-819d-06d22e972150 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:27.755752 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-973bd534-7129-4734-819d-06d22e972150 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:27.756558 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-973bd534-7129-4734-819d-06d22e972150 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:27.756985 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-973bd534-7129-4734-819d-06d22e972150 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:27.889080 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-973bd534-7129-4734-819d-06d22e972150 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:27.897666 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-973bd534-7129-4734-819d-06d22e972150 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:27.899179 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-973bd534-7129-4734-819d-06d22e972150 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:27.900452 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-973bd534-7129-4734-819d-06d22e972150 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156103 Feb 21 01:15:27.901047 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 421/868] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:27 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:15:27.928999 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6da8ec85-2c2c-42b7-8f60-52ccd8ac0ffa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:27.929615 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6da8ec85-2c2c-42b7-8f60-52ccd8ac0ffa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:27.936646 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6da8ec85-2c2c-42b7-8f60-52ccd8ac0ffa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:27.937100 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6da8ec85-2c2c-42b7-8f60-52ccd8ac0ffa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:27.942882 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6da8ec85-2c2c-42b7-8f60-52ccd8ac0ffa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:27.943479 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6da8ec85-2c2c-42b7-8f60-52ccd8ac0ffa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:28.005211 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-6da8ec85-2c2c-42b7-8f60-52ccd8ac0ffa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:28.012611 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6da8ec85-2c2c-42b7-8f60-52ccd8ac0ffa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.087238 Feb 21 01:15:28.013691 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 448/869] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:27 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:28.045823 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0c767369-2d25-4ea3-bc7d-1fc58db40238 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:28.046780 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0c767369-2d25-4ea3-bc7d-1fc58db40238 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:28.052848 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c767369-2d25-4ea3-bc7d-1fc58db40238 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:28.053297 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c767369-2d25-4ea3-bc7d-1fc58db40238 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:28.054089 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c767369-2d25-4ea3-bc7d-1fc58db40238 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:28.054612 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c767369-2d25-4ea3-bc7d-1fc58db40238 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:28.085139 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0c767369-2d25-4ea3-bc7d-1fc58db40238 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043179 Feb 21 01:15:28.085697 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 422/870] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:28 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:28.920551 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7e33f322-ad15-4bbd-8dc8-439778687195 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:28.921158 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7e33f322-ad15-4bbd-8dc8-439778687195 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:28.927214 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7e33f322-ad15-4bbd-8dc8-439778687195 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:28.927663 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7e33f322-ad15-4bbd-8dc8-439778687195 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:28.928606 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7e33f322-ad15-4bbd-8dc8-439778687195 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:28.929036 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7e33f322-ad15-4bbd-8dc8-439778687195 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:29.030163 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-616d18b1-ccdc-47e0-8a52-37d9590aeb2a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:29.031032 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-616d18b1-ccdc-47e0-8a52-37d9590aeb2a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:29.037532 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-616d18b1-ccdc-47e0-8a52-37d9590aeb2a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:29.037981 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-616d18b1-ccdc-47e0-8a52-37d9590aeb2a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:29.038793 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-616d18b1-ccdc-47e0-8a52-37d9590aeb2a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:29.039250 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-616d18b1-ccdc-47e0-8a52-37d9590aeb2a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:29.069487 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7e33f322-ad15-4bbd-8dc8-439778687195 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:29.077949 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7e33f322-ad15-4bbd-8dc8-439778687195 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:29.079444 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7e33f322-ad15-4bbd-8dc8-439778687195 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:29.081266 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7e33f322-ad15-4bbd-8dc8-439778687195 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.164527 Feb 21 01:15:29.081831 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 449/871] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:28 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:29.096932 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-47131398-7df3-435b-962f-53479bc5261e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:29.097843 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-47131398-7df3-435b-962f-53479bc5261e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:29.100820 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-616d18b1-ccdc-47e0-8a52-37d9590aeb2a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:29.103871 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-47131398-7df3-435b-962f-53479bc5261e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:29.104312 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-47131398-7df3-435b-962f-53479bc5261e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:29.105092 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-47131398-7df3-435b-962f-53479bc5261e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:29.105527 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-47131398-7df3-435b-962f-53479bc5261e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:29.108583 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-616d18b1-ccdc-47e0-8a52-37d9590aeb2a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082823 Feb 21 01:15:29.109157 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 423/872] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:29 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:15:29.135757 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-47131398-7df3-435b-962f-53479bc5261e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042441 Feb 21 01:15:29.137139 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 450/873] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:29 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:30.100706 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c0bcd40d-1420-4f57-bfb0-9194c1bd1570 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:30.101332 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c0bcd40d-1420-4f57-bfb0-9194c1bd1570 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:30.108169 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c0bcd40d-1420-4f57-bfb0-9194c1bd1570 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:30.108612 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c0bcd40d-1420-4f57-bfb0-9194c1bd1570 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:30.109384 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c0bcd40d-1420-4f57-bfb0-9194c1bd1570 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:30.109812 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c0bcd40d-1420-4f57-bfb0-9194c1bd1570 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:30.124825 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4b047b24-7395-4cc1-bc10-c5eb24ae4ffa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:30.125461 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4b047b24-7395-4cc1-bc10-c5eb24ae4ffa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:30.131660 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4b047b24-7395-4cc1-bc10-c5eb24ae4ffa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:30.132168 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4b047b24-7395-4cc1-bc10-c5eb24ae4ffa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:30.132967 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4b047b24-7395-4cc1-bc10-c5eb24ae4ffa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:30.133401 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4b047b24-7395-4cc1-bc10-c5eb24ae4ffa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:30.194299 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4b047b24-7395-4cc1-bc10-c5eb24ae4ffa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:30.202002 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4b047b24-7395-4cc1-bc10-c5eb24ae4ffa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081218 Feb 21 01:15:30.202555 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 451/874] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:30 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:15:30.206920 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6d3a9bae-5496-4882-9bd6-004f7ce69322 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:30.207870 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6d3a9bae-5496-4882-9bd6-004f7ce69322 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:30.213752 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6d3a9bae-5496-4882-9bd6-004f7ce69322 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:30.214198 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6d3a9bae-5496-4882-9bd6-004f7ce69322 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:30.214989 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6d3a9bae-5496-4882-9bd6-004f7ce69322 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:30.215421 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6d3a9bae-5496-4882-9bd6-004f7ce69322 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:30.246322 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6d3a9bae-5496-4882-9bd6-004f7ce69322 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042723 Feb 21 01:15:30.246886 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 452/875] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:30 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:30.251689 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c0bcd40d-1420-4f57-bfb0-9194c1bd1570 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:30.270597 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c0bcd40d-1420-4f57-bfb0-9194c1bd1570 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:30.272100 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c0bcd40d-1420-4f57-bfb0-9194c1bd1570 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:30.273264 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c0bcd40d-1420-4f57-bfb0-9194c1bd1570 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.176327 Feb 21 01:15:30.273817 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 424/876] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:30 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:31.218196 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-84c9f7a1-cecf-4ebf-8c7f-dd0ae7a25838 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:31.218805 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-84c9f7a1-cecf-4ebf-8c7f-dd0ae7a25838 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:31.225901 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84c9f7a1-cecf-4ebf-8c7f-dd0ae7a25838 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:31.226344 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84c9f7a1-cecf-4ebf-8c7f-dd0ae7a25838 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:31.227132 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84c9f7a1-cecf-4ebf-8c7f-dd0ae7a25838 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:31.227556 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84c9f7a1-cecf-4ebf-8c7f-dd0ae7a25838 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:31.258230 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5e6694d6-2eb0-4882-a52f-1d20980f1422 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:31.259153 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5e6694d6-2eb0-4882-a52f-1d20980f1422 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:31.266479 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5e6694d6-2eb0-4882-a52f-1d20980f1422 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:31.266929 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5e6694d6-2eb0-4882-a52f-1d20980f1422 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:31.267723 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5e6694d6-2eb0-4882-a52f-1d20980f1422 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:31.268194 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5e6694d6-2eb0-4882-a52f-1d20980f1422 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:31.288151 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-84c9f7a1-cecf-4ebf-8c7f-dd0ae7a25838 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:31.295650 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-84c9f7a1-cecf-4ebf-8c7f-dd0ae7a25838 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081012 Feb 21 01:15:31.296435 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 453/877] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:31 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:31.299243 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5e6694d6-2eb0-4882-a52f-1d20980f1422 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044657 Feb 21 01:15:31.299979 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 425/878] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:31 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:15:31.301004 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-29fc0de4-30bd-436f-80e6-dd6689960681 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:31.301676 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-29fc0de4-30bd-436f-80e6-dd6689960681 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:31.308375 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-29fc0de4-30bd-436f-80e6-dd6689960681 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:31.308765 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-29fc0de4-30bd-436f-80e6-dd6689960681 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:31.309547 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-29fc0de4-30bd-436f-80e6-dd6689960681 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:31.310645 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-29fc0de4-30bd-436f-80e6-dd6689960681 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:31.446159 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-29fc0de4-30bd-436f-80e6-dd6689960681 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:31.454896 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-29fc0de4-30bd-436f-80e6-dd6689960681 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:31.456402 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-29fc0de4-30bd-436f-80e6-dd6689960681 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:31.457532 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-29fc0de4-30bd-436f-80e6-dd6689960681 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160319 Feb 21 01:15:31.458079 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 454/879] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:31 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:32.310426 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-00d136b3-7b07-472a-8108-95c68458f6f5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:32.311339 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-00d136b3-7b07-472a-8108-95c68458f6f5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:32.312624 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-58f99fb1-428b-47b8-a281-ae0b46fe65b0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:32.313249 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-58f99fb1-428b-47b8-a281-ae0b46fe65b0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:32.317676 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-00d136b3-7b07-472a-8108-95c68458f6f5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:32.318201 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-00d136b3-7b07-472a-8108-95c68458f6f5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:32.318907 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-58f99fb1-428b-47b8-a281-ae0b46fe65b0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:32.319040 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-00d136b3-7b07-472a-8108-95c68458f6f5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:32.319366 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-58f99fb1-428b-47b8-a281-ae0b46fe65b0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:32.319491 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-00d136b3-7b07-472a-8108-95c68458f6f5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:32.320179 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-58f99fb1-428b-47b8-a281-ae0b46fe65b0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:32.320620 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-58f99fb1-428b-47b8-a281-ae0b46fe65b0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:32.349534 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-00d136b3-7b07-472a-8108-95c68458f6f5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042935 Feb 21 01:15:32.350077 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 426/880] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:32 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:32.384227 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-58f99fb1-428b-47b8-a281-ae0b46fe65b0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:32.392517 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-58f99fb1-428b-47b8-a281-ae0b46fe65b0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084453 Feb 21 01:15:32.393084 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 455/881] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:32 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:15:32.476053 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-edf70dc0-3102-4c71-a092-80bf1486cab2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:32.476665 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-edf70dc0-3102-4c71-a092-80bf1486cab2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:32.482622 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-edf70dc0-3102-4c71-a092-80bf1486cab2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:32.483057 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-edf70dc0-3102-4c71-a092-80bf1486cab2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:32.483854 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-edf70dc0-3102-4c71-a092-80bf1486cab2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:32.484286 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-edf70dc0-3102-4c71-a092-80bf1486cab2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:32.616125 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-edf70dc0-3102-4c71-a092-80bf1486cab2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:32.624664 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-edf70dc0-3102-4c71-a092-80bf1486cab2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:32.626159 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-edf70dc0-3102-4c71-a092-80bf1486cab2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:32.627319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-edf70dc0-3102-4c71-a092-80bf1486cab2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155122 Feb 21 01:15:32.627890 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 427/882] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:32 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:33.361306 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-05bc999b-f663-49a8-8c19-8560e95d0334 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:33.362255 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-05bc999b-f663-49a8-8c19-8560e95d0334 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:33.368553 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-05bc999b-f663-49a8-8c19-8560e95d0334 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:33.369001 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-05bc999b-f663-49a8-8c19-8560e95d0334 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:33.369785 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-05bc999b-f663-49a8-8c19-8560e95d0334 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:33.370219 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-05bc999b-f663-49a8-8c19-8560e95d0334 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:33.400198 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-05bc999b-f663-49a8-8c19-8560e95d0334 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043415 Feb 21 01:15:33.400755 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 456/883] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:33 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:33.409802 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3bcf6549-861c-4716-9c97-959f50f8c10f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:33.410418 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3bcf6549-861c-4716-9c97-959f50f8c10f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:33.416817 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3bcf6549-861c-4716-9c97-959f50f8c10f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:33.417272 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3bcf6549-861c-4716-9c97-959f50f8c10f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:33.418061 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3bcf6549-861c-4716-9c97-959f50f8c10f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:33.418501 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3bcf6549-861c-4716-9c97-959f50f8c10f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:33.481966 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3bcf6549-861c-4716-9c97-959f50f8c10f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:33.489341 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3bcf6549-861c-4716-9c97-959f50f8c10f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083596 Feb 21 01:15:33.489905 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 428/884] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:33 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:33.645613 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e4c17817-185a-4362-ad48-2a2ba420788a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:33.646127 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e4c17817-185a-4362-ad48-2a2ba420788a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:33.652010 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e4c17817-185a-4362-ad48-2a2ba420788a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:33.652460 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e4c17817-185a-4362-ad48-2a2ba420788a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:33.653231 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e4c17817-185a-4362-ad48-2a2ba420788a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:33.653660 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e4c17817-185a-4362-ad48-2a2ba420788a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:33.785892 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e4c17817-185a-4362-ad48-2a2ba420788a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:33.794016 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e4c17817-185a-4362-ad48-2a2ba420788a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:33.795626 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e4c17817-185a-4362-ad48-2a2ba420788a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:33.796794 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e4c17817-185a-4362-ad48-2a2ba420788a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.154998 Feb 21 01:15:33.797344 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 457/885] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:33 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:15:34.411706 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-07585c75-678c-4ef9-a2fa-f51a7b17ea6c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:34.412654 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-07585c75-678c-4ef9-a2fa-f51a7b17ea6c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:34.418921 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-07585c75-678c-4ef9-a2fa-f51a7b17ea6c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:34.420021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-07585c75-678c-4ef9-a2fa-f51a7b17ea6c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:34.421012 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-07585c75-678c-4ef9-a2fa-f51a7b17ea6c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:34.421448 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-07585c75-678c-4ef9-a2fa-f51a7b17ea6c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:34.451118 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-07585c75-678c-4ef9-a2fa-f51a7b17ea6c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042943 Feb 21 01:15:34.451787 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 429/886] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:34 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:34.505651 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-36e66817-000e-4cbf-9bd4-2ca9f61f56ef tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:34.506252 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-36e66817-000e-4cbf-9bd4-2ca9f61f56ef tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:34.512493 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-36e66817-000e-4cbf-9bd4-2ca9f61f56ef tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:34.512938 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-36e66817-000e-4cbf-9bd4-2ca9f61f56ef tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:34.513712 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-36e66817-000e-4cbf-9bd4-2ca9f61f56ef tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:34.514143 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-36e66817-000e-4cbf-9bd4-2ca9f61f56ef tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:34.576857 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-36e66817-000e-4cbf-9bd4-2ca9f61f56ef tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:34.584240 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-36e66817-000e-4cbf-9bd4-2ca9f61f56ef tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082158 Feb 21 01:15:34.584798 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 458/887] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:34 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:34.814715 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-01afac86-0c58-43f8-a9fd-a8f1dbdfe19e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:34.815319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-01afac86-0c58-43f8-a9fd-a8f1dbdfe19e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:34.821180 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-01afac86-0c58-43f8-a9fd-a8f1dbdfe19e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:34.821623 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-01afac86-0c58-43f8-a9fd-a8f1dbdfe19e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:34.822395 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-01afac86-0c58-43f8-a9fd-a8f1dbdfe19e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:34.822821 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-01afac86-0c58-43f8-a9fd-a8f1dbdfe19e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:34.956644 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-01afac86-0c58-43f8-a9fd-a8f1dbdfe19e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:34.964837 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-01afac86-0c58-43f8-a9fd-a8f1dbdfe19e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:34.966882 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-01afac86-0c58-43f8-a9fd-a8f1dbdfe19e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:34.968271 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-01afac86-0c58-43f8-a9fd-a8f1dbdfe19e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157252 Feb 21 01:15:34.968832 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 430/888] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:34 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:15:35.462226 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1630534a-3330-42fe-b065-5c2099aecb37 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:35.463130 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1630534a-3330-42fe-b065-5c2099aecb37 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:35.473028 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1630534a-3330-42fe-b065-5c2099aecb37 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:35.473471 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1630534a-3330-42fe-b065-5c2099aecb37 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:35.474258 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1630534a-3330-42fe-b065-5c2099aecb37 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:35.474692 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1630534a-3330-42fe-b065-5c2099aecb37 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:35.504092 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1630534a-3330-42fe-b065-5c2099aecb37 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045512 Feb 21 01:15:35.504642 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 459/889] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:35 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:35.600770 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-71af9f65-eeca-471e-967d-2d4d4a8ddebe tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:35.601318 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-71af9f65-eeca-471e-967d-2d4d4a8ddebe tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:35.608081 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-71af9f65-eeca-471e-967d-2d4d4a8ddebe tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:35.608528 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-71af9f65-eeca-471e-967d-2d4d4a8ddebe tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:35.609304 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-71af9f65-eeca-471e-967d-2d4d4a8ddebe tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:35.609729 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-71af9f65-eeca-471e-967d-2d4d4a8ddebe tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:35.671100 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-71af9f65-eeca-471e-967d-2d4d4a8ddebe tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:35.678503 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-71af9f65-eeca-471e-967d-2d4d4a8ddebe tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081454 Feb 21 01:15:35.679081 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 431/890] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:35 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:15:35.987304 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-829683dd-8978-4e37-bea1-05e80ea7b19f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:35.988065 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-829683dd-8978-4e37-bea1-05e80ea7b19f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:35.994269 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-829683dd-8978-4e37-bea1-05e80ea7b19f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:35.994707 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-829683dd-8978-4e37-bea1-05e80ea7b19f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:35.995502 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-829683dd-8978-4e37-bea1-05e80ea7b19f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:35.995969 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-829683dd-8978-4e37-bea1-05e80ea7b19f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:36.130789 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-829683dd-8978-4e37-bea1-05e80ea7b19f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:36.139399 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-829683dd-8978-4e37-bea1-05e80ea7b19f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:36.140944 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-829683dd-8978-4e37-bea1-05e80ea7b19f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:36.142096 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-829683dd-8978-4e37-bea1-05e80ea7b19f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158631 Feb 21 01:15:36.142649 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 460/891] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:35 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:36.515088 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9594d40d-79f0-4efd-af1e-4c251b776438 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:36.516020 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9594d40d-79f0-4efd-af1e-4c251b776438 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:36.521872 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9594d40d-79f0-4efd-af1e-4c251b776438 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:36.522314 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9594d40d-79f0-4efd-af1e-4c251b776438 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:36.523092 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9594d40d-79f0-4efd-af1e-4c251b776438 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:36.523522 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9594d40d-79f0-4efd-af1e-4c251b776438 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:36.552956 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9594d40d-79f0-4efd-af1e-4c251b776438 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042222 Feb 21 01:15:36.553496 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 432/892] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:36 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:36.695725 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-932d747a-6383-4d5a-96fb-6b7b8c7b8780 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:36.696274 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-932d747a-6383-4d5a-96fb-6b7b8c7b8780 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:36.702751 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-932d747a-6383-4d5a-96fb-6b7b8c7b8780 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:36.703218 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-932d747a-6383-4d5a-96fb-6b7b8c7b8780 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:36.704034 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-932d747a-6383-4d5a-96fb-6b7b8c7b8780 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:36.704467 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-932d747a-6383-4d5a-96fb-6b7b8c7b8780 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:36.762408 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-932d747a-6383-4d5a-96fb-6b7b8c7b8780 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:36.770447 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-932d747a-6383-4d5a-96fb-6b7b8c7b8780 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.078455 Feb 21 01:15:36.770994 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 461/893] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:36 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:37.160788 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b70833b9-988e-4b12-851e-c6f3273d5750 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:37.161367 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b70833b9-988e-4b12-851e-c6f3273d5750 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:37.167454 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b70833b9-988e-4b12-851e-c6f3273d5750 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:37.167927 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b70833b9-988e-4b12-851e-c6f3273d5750 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:37.168694 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b70833b9-988e-4b12-851e-c6f3273d5750 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:37.169126 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b70833b9-988e-4b12-851e-c6f3273d5750 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:37.308685 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b70833b9-988e-4b12-851e-c6f3273d5750 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:37.317675 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b70833b9-988e-4b12-851e-c6f3273d5750 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:37.319177 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b70833b9-988e-4b12-851e-c6f3273d5750 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:37.320380 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b70833b9-988e-4b12-851e-c6f3273d5750 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.163348 Feb 21 01:15:37.320972 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 433/894] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:37 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:37.564549 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-da39f9c0-b743-49d6-9eb9-27af607712c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:37.565460 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-da39f9c0-b743-49d6-9eb9-27af607712c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:37.571774 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-da39f9c0-b743-49d6-9eb9-27af607712c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:37.572260 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-da39f9c0-b743-49d6-9eb9-27af607712c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:37.573038 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-da39f9c0-b743-49d6-9eb9-27af607712c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:37.573471 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-da39f9c0-b743-49d6-9eb9-27af607712c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:37.601928 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-da39f9c0-b743-49d6-9eb9-27af607712c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041131 Feb 21 01:15:37.602479 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 462/895] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:37 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:37.786488 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-57147100-3fd5-4332-a662-9fd038c5241a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:37.787088 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-57147100-3fd5-4332-a662-9fd038c5241a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:37.793155 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-57147100-3fd5-4332-a662-9fd038c5241a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:37.793603 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-57147100-3fd5-4332-a662-9fd038c5241a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:37.794805 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-57147100-3fd5-4332-a662-9fd038c5241a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:37.795237 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-57147100-3fd5-4332-a662-9fd038c5241a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:37.854022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-57147100-3fd5-4332-a662-9fd038c5241a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:37.863739 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-57147100-3fd5-4332-a662-9fd038c5241a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080884 Feb 21 01:15:37.864329 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 434/896] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:37 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:15:38.338977 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8e295b52-13da-4f45-ac85-2cc1ec16b6e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:38.339642 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8e295b52-13da-4f45-ac85-2cc1ec16b6e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:38.345476 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8e295b52-13da-4f45-ac85-2cc1ec16b6e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:38.345914 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8e295b52-13da-4f45-ac85-2cc1ec16b6e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:38.346680 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8e295b52-13da-4f45-ac85-2cc1ec16b6e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:38.347103 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8e295b52-13da-4f45-ac85-2cc1ec16b6e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:38.480316 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8e295b52-13da-4f45-ac85-2cc1ec16b6e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:38.489661 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8e295b52-13da-4f45-ac85-2cc1ec16b6e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:38.491152 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8e295b52-13da-4f45-ac85-2cc1ec16b6e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:38.492355 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8e295b52-13da-4f45-ac85-2cc1ec16b6e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157066 Feb 21 01:15:38.492919 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 463/897] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:38 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:38.613637 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e93317d2-cfbd-439d-af29-af156534e31c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:38.614497 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e93317d2-cfbd-439d-af29-af156534e31c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:38.620976 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e93317d2-cfbd-439d-af29-af156534e31c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:38.621426 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e93317d2-cfbd-439d-af29-af156534e31c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:38.622251 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e93317d2-cfbd-439d-af29-af156534e31c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:38.623000 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e93317d2-cfbd-439d-af29-af156534e31c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:38.655629 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e93317d2-cfbd-439d-af29-af156534e31c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045301 Feb 21 01:15:38.656294 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 435/898] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:38 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:38.880387 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e9c7fe6d-02c7-43f0-864d-48ef6e33694d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:38.881024 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e9c7fe6d-02c7-43f0-864d-48ef6e33694d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:38.887632 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e9c7fe6d-02c7-43f0-864d-48ef6e33694d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:38.888089 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e9c7fe6d-02c7-43f0-864d-48ef6e33694d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:38.888969 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e9c7fe6d-02c7-43f0-864d-48ef6e33694d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:38.889417 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e9c7fe6d-02c7-43f0-864d-48ef6e33694d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:38.954269 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e9c7fe6d-02c7-43f0-864d-48ef6e33694d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:38.961706 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e9c7fe6d-02c7-43f0-864d-48ef6e33694d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.085077 Feb 21 01:15:38.962267 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 464/899] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:38 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:39.511399 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-96de7b34-71b0-4901-9bc3-8eb81dafa6f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:39.512027 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-96de7b34-71b0-4901-9bc3-8eb81dafa6f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:39.517844 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-96de7b34-71b0-4901-9bc3-8eb81dafa6f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:39.518285 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-96de7b34-71b0-4901-9bc3-8eb81dafa6f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:39.519058 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-96de7b34-71b0-4901-9bc3-8eb81dafa6f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:39.519489 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-96de7b34-71b0-4901-9bc3-8eb81dafa6f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:39.653260 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-96de7b34-71b0-4901-9bc3-8eb81dafa6f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:39.662704 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-96de7b34-71b0-4901-9bc3-8eb81dafa6f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:39.664244 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-96de7b34-71b0-4901-9bc3-8eb81dafa6f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:39.665393 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-96de7b34-71b0-4901-9bc3-8eb81dafa6f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157713 Feb 21 01:15:39.665943 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 436/900] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:39 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:39.666770 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ac13f1ee-586d-436e-97a4-43c8ca8b8f8e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:39.667700 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ac13f1ee-586d-436e-97a4-43c8ca8b8f8e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:39.674511 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ac13f1ee-586d-436e-97a4-43c8ca8b8f8e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:39.674960 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ac13f1ee-586d-436e-97a4-43c8ca8b8f8e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:39.675747 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ac13f1ee-586d-436e-97a4-43c8ca8b8f8e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:39.676203 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ac13f1ee-586d-436e-97a4-43c8ca8b8f8e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:39.704483 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ac13f1ee-586d-436e-97a4-43c8ca8b8f8e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041587 Feb 21 01:15:39.704940 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 465/901] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:39 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:15:39.979795 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-24da4266-77a9-40cd-bae4-bdfdb4fa592e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:39.980434 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-24da4266-77a9-40cd-bae4-bdfdb4fa592e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:39.986679 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-24da4266-77a9-40cd-bae4-bdfdb4fa592e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:39.987132 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-24da4266-77a9-40cd-bae4-bdfdb4fa592e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:39.987950 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-24da4266-77a9-40cd-bae4-bdfdb4fa592e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:39.988385 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-24da4266-77a9-40cd-bae4-bdfdb4fa592e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:40.049967 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-24da4266-77a9-40cd-bae4-bdfdb4fa592e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:40.057351 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-24da4266-77a9-40cd-bae4-bdfdb4fa592e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081280 Feb 21 01:15:40.057907 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 437/902] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:39 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:40.684544 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7f311bc7-a7db-4d15-8896-85ee9619c982 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:40.685092 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7f311bc7-a7db-4d15-8896-85ee9619c982 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:40.692450 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7f311bc7-a7db-4d15-8896-85ee9619c982 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:40.692900 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7f311bc7-a7db-4d15-8896-85ee9619c982 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:40.693680 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7f311bc7-a7db-4d15-8896-85ee9619c982 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:40.694113 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7f311bc7-a7db-4d15-8896-85ee9619c982 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:40.715347 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-34f86a40-ec45-4830-a95c-0ce7bc528f45 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:40.716374 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-34f86a40-ec45-4830-a95c-0ce7bc528f45 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:40.722695 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-34f86a40-ec45-4830-a95c-0ce7bc528f45 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:40.723128 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-34f86a40-ec45-4830-a95c-0ce7bc528f45 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:40.723937 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-34f86a40-ec45-4830-a95c-0ce7bc528f45 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:40.724364 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-34f86a40-ec45-4830-a95c-0ce7bc528f45 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:40.754387 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-34f86a40-ec45-4830-a95c-0ce7bc528f45 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042709 Feb 21 01:15:40.754954 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 438/903] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:40 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:15:40.826678 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7f311bc7-a7db-4d15-8896-85ee9619c982 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:40.835158 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7f311bc7-a7db-4d15-8896-85ee9619c982 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:40.836719 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7f311bc7-a7db-4d15-8896-85ee9619c982 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:40.837898 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7f311bc7-a7db-4d15-8896-85ee9619c982 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157611 Feb 21 01:15:40.838450 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 466/904] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:40 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:41.074295 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d344eda0-9bad-4c28-8265-dd6fd8f8280a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:41.074905 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d344eda0-9bad-4c28-8265-dd6fd8f8280a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:41.080898 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d344eda0-9bad-4c28-8265-dd6fd8f8280a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:41.081345 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d344eda0-9bad-4c28-8265-dd6fd8f8280a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:41.082125 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d344eda0-9bad-4c28-8265-dd6fd8f8280a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:41.082562 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d344eda0-9bad-4c28-8265-dd6fd8f8280a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:41.145130 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d344eda0-9bad-4c28-8265-dd6fd8f8280a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:41.152475 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d344eda0-9bad-4c28-8265-dd6fd8f8280a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081881 Feb 21 01:15:41.153037 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 439/905] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:41 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:41.766890 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-996d08d8-337e-4d80-b4d2-0bfb02d5c163 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:41.767802 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-996d08d8-337e-4d80-b4d2-0bfb02d5c163 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:41.774237 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-996d08d8-337e-4d80-b4d2-0bfb02d5c163 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:41.774675 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-996d08d8-337e-4d80-b4d2-0bfb02d5c163 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:41.775504 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-996d08d8-337e-4d80-b4d2-0bfb02d5c163 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:41.775964 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-996d08d8-337e-4d80-b4d2-0bfb02d5c163 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:41.805513 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-996d08d8-337e-4d80-b4d2-0bfb02d5c163 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043045 Feb 21 01:15:41.806061 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 467/906] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:41 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:41.855877 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b46be028-eb0f-4116-8043-593276f23784 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:41.856507 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b46be028-eb0f-4116-8043-593276f23784 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:41.862806 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b46be028-eb0f-4116-8043-593276f23784 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:41.863246 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b46be028-eb0f-4116-8043-593276f23784 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:41.864044 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b46be028-eb0f-4116-8043-593276f23784 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:41.864473 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b46be028-eb0f-4116-8043-593276f23784 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:41.996292 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b46be028-eb0f-4116-8043-593276f23784 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:42.005080 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b46be028-eb0f-4116-8043-593276f23784 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:42.006568 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b46be028-eb0f-4116-8043-593276f23784 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:42.007728 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b46be028-eb0f-4116-8043-593276f23784 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155553 Feb 21 01:15:42.008324 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 440/907] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:41 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:42.169982 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b641b2d7-2eb5-4aae-a63b-8318642a02e7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:42.170513 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b641b2d7-2eb5-4aae-a63b-8318642a02e7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:42.177095 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b641b2d7-2eb5-4aae-a63b-8318642a02e7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:42.177548 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b641b2d7-2eb5-4aae-a63b-8318642a02e7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:42.178325 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b641b2d7-2eb5-4aae-a63b-8318642a02e7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:42.178756 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b641b2d7-2eb5-4aae-a63b-8318642a02e7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:42.239152 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b641b2d7-2eb5-4aae-a63b-8318642a02e7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:42.246440 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b641b2d7-2eb5-4aae-a63b-8318642a02e7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080232 Feb 21 01:15:42.246990 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 468/908] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:42 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:42.817271 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-274b7489-f5a5-46d2-a3cb-bcd9ad0119d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:42.818164 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-274b7489-f5a5-46d2-a3cb-bcd9ad0119d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:42.824070 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-274b7489-f5a5-46d2-a3cb-bcd9ad0119d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:42.824512 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-274b7489-f5a5-46d2-a3cb-bcd9ad0119d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:42.825290 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-274b7489-f5a5-46d2-a3cb-bcd9ad0119d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:42.825719 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-274b7489-f5a5-46d2-a3cb-bcd9ad0119d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:42.854723 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-274b7489-f5a5-46d2-a3cb-bcd9ad0119d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041194 Feb 21 01:15:42.855276 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 441/909] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:42 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:43.026312 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d78a8a3a-bcb1-40a7-8d4d-ffb2fd928315 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:43.026922 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d78a8a3a-bcb1-40a7-8d4d-ffb2fd928315 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:43.034564 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d78a8a3a-bcb1-40a7-8d4d-ffb2fd928315 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:43.035018 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d78a8a3a-bcb1-40a7-8d4d-ffb2fd928315 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:43.035804 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d78a8a3a-bcb1-40a7-8d4d-ffb2fd928315 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:43.036268 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d78a8a3a-bcb1-40a7-8d4d-ffb2fd928315 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:43.171616 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d78a8a3a-bcb1-40a7-8d4d-ffb2fd928315 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:43.180030 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d78a8a3a-bcb1-40a7-8d4d-ffb2fd928315 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:43.181508 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d78a8a3a-bcb1-40a7-8d4d-ffb2fd928315 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:43.182644 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d78a8a3a-bcb1-40a7-8d4d-ffb2fd928315 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160058 Feb 21 01:15:43.183197 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 469/910] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:43 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:43.263446 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-179fdfa3-5d2a-4493-a6dc-6973e24bf418 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:43.264085 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-179fdfa3-5d2a-4493-a6dc-6973e24bf418 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:43.271519 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-179fdfa3-5d2a-4493-a6dc-6973e24bf418 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:43.272012 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-179fdfa3-5d2a-4493-a6dc-6973e24bf418 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:43.272798 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-179fdfa3-5d2a-4493-a6dc-6973e24bf418 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:43.273236 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-179fdfa3-5d2a-4493-a6dc-6973e24bf418 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:43.335009 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-179fdfa3-5d2a-4493-a6dc-6973e24bf418 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:43.342365 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-179fdfa3-5d2a-4493-a6dc-6973e24bf418 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082532 Feb 21 01:15:43.342918 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 442/911] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:43 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:43.866153 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1cacb4ee-804a-4859-90f2-270c3559fdda tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:43.867098 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1cacb4ee-804a-4859-90f2-270c3559fdda tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:43.873026 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1cacb4ee-804a-4859-90f2-270c3559fdda tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:43.873480 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1cacb4ee-804a-4859-90f2-270c3559fdda tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:43.874251 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1cacb4ee-804a-4859-90f2-270c3559fdda tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:43.874718 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1cacb4ee-804a-4859-90f2-270c3559fdda tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:43.903515 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1cacb4ee-804a-4859-90f2-270c3559fdda tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041044 Feb 21 01:15:43.904117 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 470/912] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:43 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:44.200899 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-da278ab1-b317-46f0-b144-4732d3ff4a3b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:44.201423 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-da278ab1-b317-46f0-b144-4732d3ff4a3b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:44.208296 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-da278ab1-b317-46f0-b144-4732d3ff4a3b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:44.208746 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-da278ab1-b317-46f0-b144-4732d3ff4a3b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:44.209527 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-da278ab1-b317-46f0-b144-4732d3ff4a3b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:44.209962 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-da278ab1-b317-46f0-b144-4732d3ff4a3b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:44.346680 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-da278ab1-b317-46f0-b144-4732d3ff4a3b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:44.355072 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-da278ab1-b317-46f0-b144-4732d3ff4a3b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:44.356526 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-da278ab1-b317-46f0-b144-4732d3ff4a3b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:44.358151 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-da278ab1-b317-46f0-b144-4732d3ff4a3b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160763 Feb 21 01:15:44.368921 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 443/913] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:44 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:44.369084 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-35b9a6eb-68b7-41bf-9c74-6a2565da0a18 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:44.369084 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-35b9a6eb-68b7-41bf-9c74-6a2565da0a18 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:44.369084 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-35b9a6eb-68b7-41bf-9c74-6a2565da0a18 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:44.369084 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-35b9a6eb-68b7-41bf-9c74-6a2565da0a18 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:44.369702 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-35b9a6eb-68b7-41bf-9c74-6a2565da0a18 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:44.369702 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-35b9a6eb-68b7-41bf-9c74-6a2565da0a18 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:44.429709 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-35b9a6eb-68b7-41bf-9c74-6a2565da0a18 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:44.437002 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-35b9a6eb-68b7-41bf-9c74-6a2565da0a18 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082421 Feb 21 01:15:44.438288 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 471/914] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:44 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:15:44.914490 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cb7056e2-c199-4a84-847e-d8da4dc404bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:44.915415 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cb7056e2-c199-4a84-847e-d8da4dc404bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:44.921462 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cb7056e2-c199-4a84-847e-d8da4dc404bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:44.922818 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cb7056e2-c199-4a84-847e-d8da4dc404bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:44.923711 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cb7056e2-c199-4a84-847e-d8da4dc404bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:44.924183 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cb7056e2-c199-4a84-847e-d8da4dc404bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:44.953022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cb7056e2-c199-4a84-847e-d8da4dc404bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042238 Feb 21 01:15:44.953859 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 444/915] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:44 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:45.376396 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8ca294b9-1657-470d-b942-79bdcde81def tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:45.377001 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8ca294b9-1657-470d-b942-79bdcde81def tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:45.383181 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8ca294b9-1657-470d-b942-79bdcde81def tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:45.383619 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8ca294b9-1657-470d-b942-79bdcde81def tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:45.384417 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8ca294b9-1657-470d-b942-79bdcde81def tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:45.384844 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8ca294b9-1657-470d-b942-79bdcde81def tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:45.456235 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1499751e-4568-45eb-a09e-9811b0067666 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:45.456872 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1499751e-4568-45eb-a09e-9811b0067666 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:45.463418 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1499751e-4568-45eb-a09e-9811b0067666 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:45.463898 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1499751e-4568-45eb-a09e-9811b0067666 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:45.464731 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1499751e-4568-45eb-a09e-9811b0067666 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:45.465165 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1499751e-4568-45eb-a09e-9811b0067666 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:45.520151 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8ca294b9-1657-470d-b942-79bdcde81def tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:45.528690 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8ca294b9-1657-470d-b942-79bdcde81def tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:45.530203 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8ca294b9-1657-470d-b942-79bdcde81def tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:45.531515 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1499751e-4568-45eb-a09e-9811b0067666 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:45.531721 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8ca294b9-1657-470d-b942-79bdcde81def tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159002 Feb 21 01:15:45.532199 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 472/916] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:45 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:45.539089 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1499751e-4568-45eb-a09e-9811b0067666 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.088372 Feb 21 01:15:45.539864 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 445/917] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:45 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:45.964640 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9fad3807-ad82-4f96-bb43-e82edbb929ab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:45.965557 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9fad3807-ad82-4f96-bb43-e82edbb929ab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:45.972075 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9fad3807-ad82-4f96-bb43-e82edbb929ab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:45.972555 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9fad3807-ad82-4f96-bb43-e82edbb929ab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:45.973343 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9fad3807-ad82-4f96-bb43-e82edbb929ab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:45.973779 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9fad3807-ad82-4f96-bb43-e82edbb929ab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:46.003728 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9fad3807-ad82-4f96-bb43-e82edbb929ab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042855 Feb 21 01:15:46.004331 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 473/918] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:45 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:46.550145 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-062e519c-b569-4390-8c88-f1e4519d2d63 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:46.550739 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-062e519c-b569-4390-8c88-f1e4519d2d63 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:46.556985 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-062e519c-b569-4390-8c88-f1e4519d2d63 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:46.557429 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-062e519c-b569-4390-8c88-f1e4519d2d63 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:46.558208 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-062e519c-b569-4390-8c88-f1e4519d2d63 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:46.558630 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-062e519c-b569-4390-8c88-f1e4519d2d63 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:46.658775 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-47b7995d-86df-4cf2-a423-3451206a97e2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:46.659508 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-47b7995d-86df-4cf2-a423-3451206a97e2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:46.665721 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-47b7995d-86df-4cf2-a423-3451206a97e2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:46.666169 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-47b7995d-86df-4cf2-a423-3451206a97e2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:46.666960 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-47b7995d-86df-4cf2-a423-3451206a97e2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:46.667390 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-47b7995d-86df-4cf2-a423-3451206a97e2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:46.696809 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-062e519c-b569-4390-8c88-f1e4519d2d63 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:46.705748 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-062e519c-b569-4390-8c88-f1e4519d2d63 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:46.707208 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-062e519c-b569-4390-8c88-f1e4519d2d63 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:46.708402 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-062e519c-b569-4390-8c88-f1e4519d2d63 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.162574 Feb 21 01:15:46.708965 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 446/919] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:46 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:46.731619 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-47b7995d-86df-4cf2-a423-3451206a97e2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:46.740474 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-47b7995d-86df-4cf2-a423-3451206a97e2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.187529 Feb 21 01:15:46.741061 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 474/920] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:46 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:15:47.014766 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-705e6b70-cb4a-48d5-8b98-46656d52aa66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:47.015722 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-705e6b70-cb4a-48d5-8b98-46656d52aa66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:47.021640 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-705e6b70-cb4a-48d5-8b98-46656d52aa66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:47.022079 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-705e6b70-cb4a-48d5-8b98-46656d52aa66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:47.022852 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-705e6b70-cb4a-48d5-8b98-46656d52aa66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:47.023286 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-705e6b70-cb4a-48d5-8b98-46656d52aa66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:47.053381 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-705e6b70-cb4a-48d5-8b98-46656d52aa66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042510 Feb 21 01:15:47.053939 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 447/921] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:47 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:47.726411 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7a0c5976-96fa-490a-981a-efd9708bc749 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:47.727024 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7a0c5976-96fa-490a-981a-efd9708bc749 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:47.733362 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7a0c5976-96fa-490a-981a-efd9708bc749 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:47.733813 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7a0c5976-96fa-490a-981a-efd9708bc749 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:47.735488 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7a0c5976-96fa-490a-981a-efd9708bc749 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:47.735953 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7a0c5976-96fa-490a-981a-efd9708bc749 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:47.757116 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f434f110-3a5b-4351-aec0-1215bdfd81cc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:47.757727 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f434f110-3a5b-4351-aec0-1215bdfd81cc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:47.763476 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f434f110-3a5b-4351-aec0-1215bdfd81cc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:47.763990 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f434f110-3a5b-4351-aec0-1215bdfd81cc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:47.764778 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f434f110-3a5b-4351-aec0-1215bdfd81cc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:47.765259 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f434f110-3a5b-4351-aec0-1215bdfd81cc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:47.835187 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f434f110-3a5b-4351-aec0-1215bdfd81cc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:47.842761 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f434f110-3a5b-4351-aec0-1215bdfd81cc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.089495 Feb 21 01:15:47.843860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 448/922] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:47 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:15:47.872008 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7a0c5976-96fa-490a-981a-efd9708bc749 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:47.881202 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7a0c5976-96fa-490a-981a-efd9708bc749 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:47.883060 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7a0c5976-96fa-490a-981a-efd9708bc749 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:47.884266 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7a0c5976-96fa-490a-981a-efd9708bc749 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.161552 Feb 21 01:15:47.884872 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 475/923] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:47 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:48.065386 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3bf145ef-c7a2-4b93-a662-f6f4bc6c7161 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:48.066247 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3bf145ef-c7a2-4b93-a662-f6f4bc6c7161 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:48.072241 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3bf145ef-c7a2-4b93-a662-f6f4bc6c7161 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:48.072692 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3bf145ef-c7a2-4b93-a662-f6f4bc6c7161 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:48.073495 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3bf145ef-c7a2-4b93-a662-f6f4bc6c7161 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:48.073914 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3bf145ef-c7a2-4b93-a662-f6f4bc6c7161 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:48.102745 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3bf145ef-c7a2-4b93-a662-f6f4bc6c7161 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041651 Feb 21 01:15:48.103291 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 449/924] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:48 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:48.860966 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e472bc4e-0fe1-4faf-82e2-362698ed57b9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:48.861762 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e472bc4e-0fe1-4faf-82e2-362698ed57b9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:48.868127 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e472bc4e-0fe1-4faf-82e2-362698ed57b9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:48.868556 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e472bc4e-0fe1-4faf-82e2-362698ed57b9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:48.869339 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e472bc4e-0fe1-4faf-82e2-362698ed57b9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:48.869775 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e472bc4e-0fe1-4faf-82e2-362698ed57b9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:48.902338 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6df08e4a-033d-4956-9430-b98192189830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:48.902949 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6df08e4a-033d-4956-9430-b98192189830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:48.909775 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6df08e4a-033d-4956-9430-b98192189830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:48.910227 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6df08e4a-033d-4956-9430-b98192189830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:48.911027 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6df08e4a-033d-4956-9430-b98192189830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:48.911460 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6df08e4a-033d-4956-9430-b98192189830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:48.932076 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e472bc4e-0fe1-4faf-82e2-362698ed57b9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:48.940101 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e472bc4e-0fe1-4faf-82e2-362698ed57b9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083454 Feb 21 01:15:48.940680 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 476/925] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:48 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:49.049764 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6df08e4a-033d-4956-9430-b98192189830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:49.058027 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6df08e4a-033d-4956-9430-b98192189830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:49.059489 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6df08e4a-033d-4956-9430-b98192189830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:49.060723 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6df08e4a-033d-4956-9430-b98192189830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.162141 Feb 21 01:15:49.061272 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 450/926] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:48 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:15:49.114895 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-16f3cedb-cc29-4727-8903-523b4e9cdaae tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:49.115859 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-16f3cedb-cc29-4727-8903-523b4e9cdaae tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:49.121943 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-16f3cedb-cc29-4727-8903-523b4e9cdaae tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:49.122385 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-16f3cedb-cc29-4727-8903-523b4e9cdaae tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:49.123165 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-16f3cedb-cc29-4727-8903-523b4e9cdaae tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:49.123607 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-16f3cedb-cc29-4727-8903-523b4e9cdaae tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:49.154277 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-16f3cedb-cc29-4727-8903-523b4e9cdaae tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043131 Feb 21 01:15:49.154842 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 477/927] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:49 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:49.957582 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-18ba1cf5-988f-4491-a9a5-0144795eecca tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:49.958192 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-18ba1cf5-988f-4491-a9a5-0144795eecca tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:49.964456 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-18ba1cf5-988f-4491-a9a5-0144795eecca tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:49.964903 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-18ba1cf5-988f-4491-a9a5-0144795eecca tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:49.965676 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-18ba1cf5-988f-4491-a9a5-0144795eecca tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:49.966100 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-18ba1cf5-988f-4491-a9a5-0144795eecca tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:50.026296 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-18ba1cf5-988f-4491-a9a5-0144795eecca tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:50.034432 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-18ba1cf5-988f-4491-a9a5-0144795eecca tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080835 Feb 21 01:15:50.035004 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 451/928] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:49 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:50.080712 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7d3b6bdf-cb4f-4b63-bc84-c9c64d227b20 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:50.081324 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7d3b6bdf-cb4f-4b63-bc84-c9c64d227b20 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:50.087249 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7d3b6bdf-cb4f-4b63-bc84-c9c64d227b20 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:50.087712 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7d3b6bdf-cb4f-4b63-bc84-c9c64d227b20 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:50.088525 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7d3b6bdf-cb4f-4b63-bc84-c9c64d227b20 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:50.088962 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7d3b6bdf-cb4f-4b63-bc84-c9c64d227b20 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:50.166466 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-dab12433-8d3c-4d2e-870d-3f25ff3efee5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:50.167414 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-dab12433-8d3c-4d2e-870d-3f25ff3efee5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:50.173791 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dab12433-8d3c-4d2e-870d-3f25ff3efee5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:50.174235 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dab12433-8d3c-4d2e-870d-3f25ff3efee5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:50.175023 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dab12433-8d3c-4d2e-870d-3f25ff3efee5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:50.175458 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dab12433-8d3c-4d2e-870d-3f25ff3efee5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:50.205992 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-dab12433-8d3c-4d2e-870d-3f25ff3efee5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043244 Feb 21 01:15:50.206542 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 452/929] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:50 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:15:50.224180 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7d3b6bdf-cb4f-4b63-bc84-c9c64d227b20 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:50.232305 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7d3b6bdf-cb4f-4b63-bc84-c9c64d227b20 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:50.233795 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7d3b6bdf-cb4f-4b63-bc84-c9c64d227b20 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:50.234948 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7d3b6bdf-cb4f-4b63-bc84-c9c64d227b20 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158799 Feb 21 01:15:50.235496 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 478/930] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:50 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:50.777435 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:15:50.777723 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:15:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:15:51.051633 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0705031f-0fa3-458c-b971-46fc003f50eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:51.052236 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0705031f-0fa3-458c-b971-46fc003f50eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:51.058381 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0705031f-0fa3-458c-b971-46fc003f50eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:51.058824 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0705031f-0fa3-458c-b971-46fc003f50eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:51.059595 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0705031f-0fa3-458c-b971-46fc003f50eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:51.060061 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0705031f-0fa3-458c-b971-46fc003f50eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:51.121480 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0705031f-0fa3-458c-b971-46fc003f50eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:51.128934 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0705031f-0fa3-458c-b971-46fc003f50eb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081124 Feb 21 01:15:51.129493 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 453/931] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:51 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:51.217121 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-428da0b6-2d7d-47f7-9b43-c94d2794a7d4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:51.218099 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-428da0b6-2d7d-47f7-9b43-c94d2794a7d4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:51.224991 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-428da0b6-2d7d-47f7-9b43-c94d2794a7d4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:51.225435 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-428da0b6-2d7d-47f7-9b43-c94d2794a7d4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:51.226209 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-428da0b6-2d7d-47f7-9b43-c94d2794a7d4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:51.226637 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-428da0b6-2d7d-47f7-9b43-c94d2794a7d4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:51.253048 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d013379f-7aa2-4688-a614-8ad82506f04e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:51.253648 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d013379f-7aa2-4688-a614-8ad82506f04e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:51.255214 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-428da0b6-2d7d-47f7-9b43-c94d2794a7d4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041785 Feb 21 01:15:51.255965 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 479/932] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:51 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:51.259466 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d013379f-7aa2-4688-a614-8ad82506f04e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:51.259942 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d013379f-7aa2-4688-a614-8ad82506f04e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:51.260718 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d013379f-7aa2-4688-a614-8ad82506f04e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:51.261149 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d013379f-7aa2-4688-a614-8ad82506f04e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:51.551737 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d013379f-7aa2-4688-a614-8ad82506f04e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:51.560142 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d013379f-7aa2-4688-a614-8ad82506f04e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:51.561627 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d013379f-7aa2-4688-a614-8ad82506f04e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:51.562855 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d013379f-7aa2-4688-a614-8ad82506f04e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.313662 Feb 21 01:15:51.563454 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 454/933] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:51 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:15:52.147172 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-471688e9-5132-4109-9585-6b0c8d0b77b8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:52.147694 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-471688e9-5132-4109-9585-6b0c8d0b77b8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:52.153587 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-471688e9-5132-4109-9585-6b0c8d0b77b8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:52.154037 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-471688e9-5132-4109-9585-6b0c8d0b77b8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:52.154810 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-471688e9-5132-4109-9585-6b0c8d0b77b8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:52.155500 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-471688e9-5132-4109-9585-6b0c8d0b77b8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:52.214148 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-471688e9-5132-4109-9585-6b0c8d0b77b8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:52.221962 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-471688e9-5132-4109-9585-6b0c8d0b77b8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.078501 Feb 21 01:15:52.222527 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 480/934] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:52 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:52.267226 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3e4c7d6b-c402-4bce-9698-259a7b255358 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:52.268215 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3e4c7d6b-c402-4bce-9698-259a7b255358 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:52.274379 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3e4c7d6b-c402-4bce-9698-259a7b255358 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:52.274830 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3e4c7d6b-c402-4bce-9698-259a7b255358 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:52.275615 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3e4c7d6b-c402-4bce-9698-259a7b255358 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:52.276079 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3e4c7d6b-c402-4bce-9698-259a7b255358 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:52.305023 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3e4c7d6b-c402-4bce-9698-259a7b255358 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042455 Feb 21 01:15:52.305567 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 455/935] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:52 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:52.582321 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-14c3691a-5d58-47b4-a3ea-f219fb32540a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:52.582933 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-14c3691a-5d58-47b4-a3ea-f219fb32540a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:52.588819 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-14c3691a-5d58-47b4-a3ea-f219fb32540a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:52.589266 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-14c3691a-5d58-47b4-a3ea-f219fb32540a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:52.590052 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-14c3691a-5d58-47b4-a3ea-f219fb32540a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:52.590482 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-14c3691a-5d58-47b4-a3ea-f219fb32540a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:52.721980 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-14c3691a-5d58-47b4-a3ea-f219fb32540a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:52.730127 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-14c3691a-5d58-47b4-a3ea-f219fb32540a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:52.731616 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-14c3691a-5d58-47b4-a3ea-f219fb32540a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:52.732783 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-14c3691a-5d58-47b4-a3ea-f219fb32540a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155499 Feb 21 01:15:52.733341 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 481/936] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:52 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:53.238908 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-26604f84-ada2-4477-9ae2-4ea852c86226 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:53.239515 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-26604f84-ada2-4477-9ae2-4ea852c86226 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:53.245311 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-26604f84-ada2-4477-9ae2-4ea852c86226 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:53.245756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-26604f84-ada2-4477-9ae2-4ea852c86226 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:53.246526 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-26604f84-ada2-4477-9ae2-4ea852c86226 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:53.246960 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-26604f84-ada2-4477-9ae2-4ea852c86226 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:53.306896 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-26604f84-ada2-4477-9ae2-4ea852c86226 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:53.314718 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-26604f84-ada2-4477-9ae2-4ea852c86226 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079528 Feb 21 01:15:53.315268 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 456/937] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:53 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:53.316589 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-afe0138a-a8e1-4bf3-8366-fa018c8c08a8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:53.317542 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-afe0138a-a8e1-4bf3-8366-fa018c8c08a8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:53.323862 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-afe0138a-a8e1-4bf3-8366-fa018c8c08a8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:53.324350 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-afe0138a-a8e1-4bf3-8366-fa018c8c08a8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:53.325130 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-afe0138a-a8e1-4bf3-8366-fa018c8c08a8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:53.325560 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-afe0138a-a8e1-4bf3-8366-fa018c8c08a8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:53.354717 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-afe0138a-a8e1-4bf3-8366-fa018c8c08a8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042087 Feb 21 01:15:53.355269 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 482/938] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:53 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:15:53.752295 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f0262802-c650-4bdf-be3f-fba5d0ab7f87 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:53.752895 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f0262802-c650-4bdf-be3f-fba5d0ab7f87 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:53.758940 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f0262802-c650-4bdf-be3f-fba5d0ab7f87 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:53.759394 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f0262802-c650-4bdf-be3f-fba5d0ab7f87 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:53.760216 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f0262802-c650-4bdf-be3f-fba5d0ab7f87 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:53.760659 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f0262802-c650-4bdf-be3f-fba5d0ab7f87 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:53.897626 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f0262802-c650-4bdf-be3f-fba5d0ab7f87 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:53.906146 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f0262802-c650-4bdf-be3f-fba5d0ab7f87 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:53.907631 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f0262802-c650-4bdf-be3f-fba5d0ab7f87 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:53.908806 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f0262802-c650-4bdf-be3f-fba5d0ab7f87 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.161230 Feb 21 01:15:53.909360 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 457/939] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:53 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:54.331529 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fa0c74fb-5fc4-4d59-9a9a-043e4b5127a2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:54.332166 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fa0c74fb-5fc4-4d59-9a9a-043e4b5127a2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:54.338372 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fa0c74fb-5fc4-4d59-9a9a-043e4b5127a2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:54.338844 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fa0c74fb-5fc4-4d59-9a9a-043e4b5127a2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:54.339636 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fa0c74fb-5fc4-4d59-9a9a-043e4b5127a2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:54.340102 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fa0c74fb-5fc4-4d59-9a9a-043e4b5127a2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:54.367490 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f40fa601-7f57-48ed-b7df-0000ceb15489 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:54.368441 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f40fa601-7f57-48ed-b7df-0000ceb15489 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:54.375635 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f40fa601-7f57-48ed-b7df-0000ceb15489 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:54.376143 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f40fa601-7f57-48ed-b7df-0000ceb15489 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:54.376937 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f40fa601-7f57-48ed-b7df-0000ceb15489 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:54.377378 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f40fa601-7f57-48ed-b7df-0000ceb15489 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:54.405318 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fa0c74fb-5fc4-4d59-9a9a-043e4b5127a2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:54.408930 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f40fa601-7f57-48ed-b7df-0000ceb15489 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044649 Feb 21 01:15:54.409379 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 458/940] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:54 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:15:54.416266 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-fa0c74fb-5fc4-4d59-9a9a-043e4b5127a2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.088743 Feb 21 01:15:54.416824 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 483/941] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:54 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:54.926711 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-57271f87-8001-4746-ae4a-41236507b582 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:54.927345 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-57271f87-8001-4746-ae4a-41236507b582 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:54.933178 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-57271f87-8001-4746-ae4a-41236507b582 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:54.933633 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-57271f87-8001-4746-ae4a-41236507b582 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:54.934412 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-57271f87-8001-4746-ae4a-41236507b582 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:54.934843 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-57271f87-8001-4746-ae4a-41236507b582 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:55.066286 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-57271f87-8001-4746-ae4a-41236507b582 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:55.074489 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-57271f87-8001-4746-ae4a-41236507b582 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:55.076001 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-57271f87-8001-4746-ae4a-41236507b582 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:55.077157 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-57271f87-8001-4746-ae4a-41236507b582 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.154163 Feb 21 01:15:55.078247 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 459/942] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:54 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:15:55.420126 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4f9e2d3d-e304-4d17-ba6b-5dbc082e1c68 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:55.421062 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4f9e2d3d-e304-4d17-ba6b-5dbc082e1c68 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:55.427408 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f9e2d3d-e304-4d17-ba6b-5dbc082e1c68 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:55.427877 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f9e2d3d-e304-4d17-ba6b-5dbc082e1c68 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:55.428659 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f9e2d3d-e304-4d17-ba6b-5dbc082e1c68 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:55.429088 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f9e2d3d-e304-4d17-ba6b-5dbc082e1c68 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:55.432971 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-209643f6-48dd-4d9d-9ffe-95c1c8022592 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:55.433617 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-209643f6-48dd-4d9d-9ffe-95c1c8022592 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:55.440809 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-209643f6-48dd-4d9d-9ffe-95c1c8022592 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:55.441263 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-209643f6-48dd-4d9d-9ffe-95c1c8022592 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:55.442050 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-209643f6-48dd-4d9d-9ffe-95c1c8022592 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:55.442502 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-209643f6-48dd-4d9d-9ffe-95c1c8022592 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:55.460054 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4f9e2d3d-e304-4d17-ba6b-5dbc082e1c68 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043664 Feb 21 01:15:55.460621 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 484/943] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:55 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:55.505588 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-209643f6-48dd-4d9d-9ffe-95c1c8022592 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:55.512970 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-209643f6-48dd-4d9d-9ffe-95c1c8022592 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083693 Feb 21 01:15:55.513532 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 460/944] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:55 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:15:56.096295 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7d656acb-88e9-4bfd-bb3d-20cee52f5762 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:56.096938 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7d656acb-88e9-4bfd-bb3d-20cee52f5762 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:56.102982 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7d656acb-88e9-4bfd-bb3d-20cee52f5762 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:56.103431 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7d656acb-88e9-4bfd-bb3d-20cee52f5762 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:56.104272 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7d656acb-88e9-4bfd-bb3d-20cee52f5762 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:56.104707 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7d656acb-88e9-4bfd-bb3d-20cee52f5762 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:56.239806 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7d656acb-88e9-4bfd-bb3d-20cee52f5762 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:56.248530 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7d656acb-88e9-4bfd-bb3d-20cee52f5762 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:56.250474 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7d656acb-88e9-4bfd-bb3d-20cee52f5762 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:56.251631 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7d656acb-88e9-4bfd-bb3d-20cee52f5762 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159589 Feb 21 01:15:56.252438 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 485/945] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:56 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:56.472172 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6cd17fb8-daf4-4fe1-9ef6-c79f5394c3e0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:56.473077 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6cd17fb8-daf4-4fe1-9ef6-c79f5394c3e0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:56.479205 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6cd17fb8-daf4-4fe1-9ef6-c79f5394c3e0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:56.479646 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6cd17fb8-daf4-4fe1-9ef6-c79f5394c3e0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:56.480444 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6cd17fb8-daf4-4fe1-9ef6-c79f5394c3e0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:56.480871 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6cd17fb8-daf4-4fe1-9ef6-c79f5394c3e0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:56.510022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6cd17fb8-daf4-4fe1-9ef6-c79f5394c3e0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042210 Feb 21 01:15:56.510567 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 461/946] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:56 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:56.530298 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e148ae29-9b07-4aa7-a13a-85718d265713 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:56.531676 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e148ae29-9b07-4aa7-a13a-85718d265713 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:56.538094 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e148ae29-9b07-4aa7-a13a-85718d265713 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:56.538544 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e148ae29-9b07-4aa7-a13a-85718d265713 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:56.539320 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e148ae29-9b07-4aa7-a13a-85718d265713 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:56.539758 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e148ae29-9b07-4aa7-a13a-85718d265713 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:56.599106 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e148ae29-9b07-4aa7-a13a-85718d265713 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:56.606389 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e148ae29-9b07-4aa7-a13a-85718d265713 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080003 Feb 21 01:15:56.607008 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 486/947] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:56 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:57.270771 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8898fad0-4421-4817-815b-aa6976f7a249 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:57.271385 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8898fad0-4421-4817-815b-aa6976f7a249 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:57.277894 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8898fad0-4421-4817-815b-aa6976f7a249 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:57.278344 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8898fad0-4421-4817-815b-aa6976f7a249 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:57.279124 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8898fad0-4421-4817-815b-aa6976f7a249 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:57.279558 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8898fad0-4421-4817-815b-aa6976f7a249 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:57.415690 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8898fad0-4421-4817-815b-aa6976f7a249 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:57.424396 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8898fad0-4421-4817-815b-aa6976f7a249 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:57.425873 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8898fad0-4421-4817-815b-aa6976f7a249 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:57.427004 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8898fad0-4421-4817-815b-aa6976f7a249 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160108 Feb 21 01:15:57.427546 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 462/948] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:57 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:57.520327 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6196fbdb-0598-43a8-a5d8-9dab7ad44e3a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:57.521318 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6196fbdb-0598-43a8-a5d8-9dab7ad44e3a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:57.527021 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6196fbdb-0598-43a8-a5d8-9dab7ad44e3a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:57.527444 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6196fbdb-0598-43a8-a5d8-9dab7ad44e3a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:57.528238 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6196fbdb-0598-43a8-a5d8-9dab7ad44e3a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:57.528666 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6196fbdb-0598-43a8-a5d8-9dab7ad44e3a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:57.557871 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6196fbdb-0598-43a8-a5d8-9dab7ad44e3a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041212 Feb 21 01:15:57.558467 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 487/949] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:57 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:57.622110 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2b6090d7-0df7-4e05-b846-ea0a2358a1c7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:57.622713 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2b6090d7-0df7-4e05-b846-ea0a2358a1c7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:57.629112 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b6090d7-0df7-4e05-b846-ea0a2358a1c7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:57.629557 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b6090d7-0df7-4e05-b846-ea0a2358a1c7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:57.630332 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b6090d7-0df7-4e05-b846-ea0a2358a1c7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:57.630761 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b6090d7-0df7-4e05-b846-ea0a2358a1c7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:57.691985 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2b6090d7-0df7-4e05-b846-ea0a2358a1c7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:57.699447 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2b6090d7-0df7-4e05-b846-ea0a2358a1c7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080940 Feb 21 01:15:57.700046 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 463/950] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:57 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:58.445645 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fc3197d3-07da-4bbd-9531-b5fa6a349ef5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:58.446241 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fc3197d3-07da-4bbd-9531-b5fa6a349ef5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:58.452050 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fc3197d3-07da-4bbd-9531-b5fa6a349ef5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:58.452494 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fc3197d3-07da-4bbd-9531-b5fa6a349ef5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:58.453264 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fc3197d3-07da-4bbd-9531-b5fa6a349ef5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:58.453688 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fc3197d3-07da-4bbd-9531-b5fa6a349ef5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:58.569247 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3abc3024-6a30-4530-ad7b-11dd7fed9a58 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:58.570168 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3abc3024-6a30-4530-ad7b-11dd7fed9a58 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:58.576022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3abc3024-6a30-4530-ad7b-11dd7fed9a58 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:58.576480 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3abc3024-6a30-4530-ad7b-11dd7fed9a58 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:58.577274 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3abc3024-6a30-4530-ad7b-11dd7fed9a58 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:58.577712 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3abc3024-6a30-4530-ad7b-11dd7fed9a58 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:58.589711 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fc3197d3-07da-4bbd-9531-b5fa6a349ef5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:58.598912 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fc3197d3-07da-4bbd-9531-b5fa6a349ef5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:58.600477 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fc3197d3-07da-4bbd-9531-b5fa6a349ef5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:58.601589 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-fc3197d3-07da-4bbd-9531-b5fa6a349ef5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159606 Feb 21 01:15:58.602139 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 488/951] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:58 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:58.608975 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3abc3024-6a30-4530-ad7b-11dd7fed9a58 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043409 Feb 21 01:15:58.609499 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 464/952] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:58 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:15:58.716045 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-82d01af3-4d3e-4a3c-aaa2-1954f6dda20c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:58.716653 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-82d01af3-4d3e-4a3c-aaa2-1954f6dda20c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:58.723982 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-82d01af3-4d3e-4a3c-aaa2-1954f6dda20c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:58.724434 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-82d01af3-4d3e-4a3c-aaa2-1954f6dda20c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:58.725217 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-82d01af3-4d3e-4a3c-aaa2-1954f6dda20c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:58.725656 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-82d01af3-4d3e-4a3c-aaa2-1954f6dda20c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:58.785948 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-82d01af3-4d3e-4a3c-aaa2-1954f6dda20c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:58.793244 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-82d01af3-4d3e-4a3c-aaa2-1954f6dda20c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080826 Feb 21 01:15:58.793803 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 489/953] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:58 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:59.620167 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d8cf5a4c-ad0e-48f8-a6d0-fbb81b860d10 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:59.620839 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-89bf7aa3-b17b-4c28-b3f4-83c032b8455d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:59.621229 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d8cf5a4c-ad0e-48f8-a6d0-fbb81b860d10 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:59.621340 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-89bf7aa3-b17b-4c28-b3f4-83c032b8455d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:59.628113 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d8cf5a4c-ad0e-48f8-a6d0-fbb81b860d10 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:59.628311 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-89bf7aa3-b17b-4c28-b3f4-83c032b8455d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:59.628560 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d8cf5a4c-ad0e-48f8-a6d0-fbb81b860d10 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:59.628700 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-89bf7aa3-b17b-4c28-b3f4-83c032b8455d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:59.629341 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-89bf7aa3-b17b-4c28-b3f4-83c032b8455d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:59.629449 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d8cf5a4c-ad0e-48f8-a6d0-fbb81b860d10 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:59.629778 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-89bf7aa3-b17b-4c28-b3f4-83c032b8455d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:59.629908 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d8cf5a4c-ad0e-48f8-a6d0-fbb81b860d10 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:59.659505 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-89bf7aa3-b17b-4c28-b3f4-83c032b8455d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042994 Feb 21 01:15:59.660357 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 465/954] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:15:59 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:59.761242 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d8cf5a4c-ad0e-48f8-a6d0-fbb81b860d10 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:59.769839 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d8cf5a4c-ad0e-48f8-a6d0-fbb81b860d10 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:59.771307 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d8cf5a4c-ad0e-48f8-a6d0-fbb81b860d10 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:59.772487 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d8cf5a4c-ad0e-48f8-a6d0-fbb81b860d10 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156116 Feb 21 01:15:59.773033 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 490/955] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:15:59 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:15:59.809513 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e7d52d8c-da46-499b-906a-5d2546ce013a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:59.810131 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e7d52d8c-da46-499b-906a-5d2546ce013a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:59.816119 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e7d52d8c-da46-499b-906a-5d2546ce013a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:59.816566 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e7d52d8c-da46-499b-906a-5d2546ce013a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:59.817350 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e7d52d8c-da46-499b-906a-5d2546ce013a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:59.817785 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e7d52d8c-da46-499b-906a-5d2546ce013a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:59.878430 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e7d52d8c-da46-499b-906a-5d2546ce013a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:59.885766 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e7d52d8c-da46-499b-906a-5d2546ce013a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079908 Feb 21 01:15:59.886317 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 466/956] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:59 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:00.670557 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1c4f93be-4f6a-4a32-9a69-af936f46dc12 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:00.671361 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1c4f93be-4f6a-4a32-9a69-af936f46dc12 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:00.678869 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c4f93be-4f6a-4a32-9a69-af936f46dc12 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:00.679320 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c4f93be-4f6a-4a32-9a69-af936f46dc12 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:00.680142 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c4f93be-4f6a-4a32-9a69-af936f46dc12 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:00.680580 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c4f93be-4f6a-4a32-9a69-af936f46dc12 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:00.710163 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1c4f93be-4f6a-4a32-9a69-af936f46dc12 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043467 Feb 21 01:16:00.710724 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 491/957] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:00 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:00.791659 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b7edd3f0-5d90-4ac0-87cc-b0d4695b0412 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:00.792296 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b7edd3f0-5d90-4ac0-87cc-b0d4695b0412 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:00.799589 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b7edd3f0-5d90-4ac0-87cc-b0d4695b0412 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:00.800075 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b7edd3f0-5d90-4ac0-87cc-b0d4695b0412 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:00.800858 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b7edd3f0-5d90-4ac0-87cc-b0d4695b0412 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:00.801294 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b7edd3f0-5d90-4ac0-87cc-b0d4695b0412 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:00.902700 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b43a7dc5-df7d-4643-9643-949a606061ce tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:00.903449 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b43a7dc5-df7d-4643-9643-949a606061ce tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:00.910522 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b43a7dc5-df7d-4643-9643-949a606061ce tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:00.910970 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b43a7dc5-df7d-4643-9643-949a606061ce tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:00.911760 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b43a7dc5-df7d-4643-9643-949a606061ce tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:00.912245 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b43a7dc5-df7d-4643-9643-949a606061ce tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:00.934593 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b7edd3f0-5d90-4ac0-87cc-b0d4695b0412 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:00.943083 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b7edd3f0-5d90-4ac0-87cc-b0d4695b0412 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:00.944615 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b7edd3f0-5d90-4ac0-87cc-b0d4695b0412 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:00.945800 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b7edd3f0-5d90-4ac0-87cc-b0d4695b0412 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157869 Feb 21 01:16:00.946358 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 467/958] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:00 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:00.973684 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b43a7dc5-df7d-4643-9643-949a606061ce tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:00.981150 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b43a7dc5-df7d-4643-9643-949a606061ce tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082159 Feb 21 01:16:00.981715 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 492/959] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:00 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:01.722087 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-663fcfed-75eb-43fb-9ed8-d9f2b711732e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:01.723069 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-663fcfed-75eb-43fb-9ed8-d9f2b711732e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:01.728967 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-663fcfed-75eb-43fb-9ed8-d9f2b711732e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:01.729417 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-663fcfed-75eb-43fb-9ed8-d9f2b711732e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:01.730199 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-663fcfed-75eb-43fb-9ed8-d9f2b711732e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:01.730635 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-663fcfed-75eb-43fb-9ed8-d9f2b711732e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:01.759013 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-663fcfed-75eb-43fb-9ed8-d9f2b711732e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041374 Feb 21 01:16:01.759557 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 468/960] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:01 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:01.965767 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f272ff00-9b1b-476b-bc55-31e4d60d6070 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:01.966381 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f272ff00-9b1b-476b-bc55-31e4d60d6070 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:01.973825 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f272ff00-9b1b-476b-bc55-31e4d60d6070 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:01.974278 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f272ff00-9b1b-476b-bc55-31e4d60d6070 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:01.975063 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f272ff00-9b1b-476b-bc55-31e4d60d6070 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:01.975501 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f272ff00-9b1b-476b-bc55-31e4d60d6070 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:01.997429 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ea1d3837-7d17-4e16-ac69-14776703f7a2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:01.998054 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ea1d3837-7d17-4e16-ac69-14776703f7a2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:02.004771 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ea1d3837-7d17-4e16-ac69-14776703f7a2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:02.005223 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ea1d3837-7d17-4e16-ac69-14776703f7a2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:02.005993 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ea1d3837-7d17-4e16-ac69-14776703f7a2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:02.006425 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ea1d3837-7d17-4e16-ac69-14776703f7a2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:02.073937 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ea1d3837-7d17-4e16-ac69-14776703f7a2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:02.083211 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ea1d3837-7d17-4e16-ac69-14776703f7a2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.089327 Feb 21 01:16:02.090422 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 469/961] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:01 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:16:02.120604 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f272ff00-9b1b-476b-bc55-31e4d60d6070 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:02.130122 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f272ff00-9b1b-476b-bc55-31e4d60d6070 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:02.134644 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f272ff00-9b1b-476b-bc55-31e4d60d6070 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:02.134644 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f272ff00-9b1b-476b-bc55-31e4d60d6070 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.171365 Feb 21 01:16:02.134644 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 493/962] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:01 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:02.770623 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d33767ea-da57-4e3e-99d8-483617e9d4c1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:02.771549 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d33767ea-da57-4e3e-99d8-483617e9d4c1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:02.777509 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d33767ea-da57-4e3e-99d8-483617e9d4c1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:02.777955 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d33767ea-da57-4e3e-99d8-483617e9d4c1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:02.778744 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d33767ea-da57-4e3e-99d8-483617e9d4c1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:02.779178 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d33767ea-da57-4e3e-99d8-483617e9d4c1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:02.809538 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d33767ea-da57-4e3e-99d8-483617e9d4c1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042731 Feb 21 01:16:02.810099 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 470/963] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:02 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:03.105770 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f0fe68a8-3f5b-43c7-b390-4cce39d1db5a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:03.106308 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f0fe68a8-3f5b-43c7-b390-4cce39d1db5a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:03.113082 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f0fe68a8-3f5b-43c7-b390-4cce39d1db5a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:03.113525 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f0fe68a8-3f5b-43c7-b390-4cce39d1db5a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:03.114304 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f0fe68a8-3f5b-43c7-b390-4cce39d1db5a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:03.114830 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f0fe68a8-3f5b-43c7-b390-4cce39d1db5a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:03.152414 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0982ad83-9f52-4e9d-b7b6-11c384efbf8c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:03.153005 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0982ad83-9f52-4e9d-b7b6-11c384efbf8c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:03.160688 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0982ad83-9f52-4e9d-b7b6-11c384efbf8c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:03.161138 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0982ad83-9f52-4e9d-b7b6-11c384efbf8c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:03.161930 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0982ad83-9f52-4e9d-b7b6-11c384efbf8c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:03.162368 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0982ad83-9f52-4e9d-b7b6-11c384efbf8c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:03.179054 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f0fe68a8-3f5b-43c7-b390-4cce39d1db5a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:03.188157 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f0fe68a8-3f5b-43c7-b390-4cce39d1db5a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.085935 Feb 21 01:16:03.188721 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 494/964] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:03 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:03.295484 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0982ad83-9f52-4e9d-b7b6-11c384efbf8c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:03.304028 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0982ad83-9f52-4e9d-b7b6-11c384efbf8c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:03.305521 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0982ad83-9f52-4e9d-b7b6-11c384efbf8c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:03.306712 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0982ad83-9f52-4e9d-b7b6-11c384efbf8c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157942 Feb 21 01:16:03.307262 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 471/965] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:03 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:16:03.821486 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d7f5ac5d-ec1d-4358-b4b2-ea39c8acb905 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:03.822427 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d7f5ac5d-ec1d-4358-b4b2-ea39c8acb905 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:03.828276 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d7f5ac5d-ec1d-4358-b4b2-ea39c8acb905 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:03.829384 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d7f5ac5d-ec1d-4358-b4b2-ea39c8acb905 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:03.830163 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d7f5ac5d-ec1d-4358-b4b2-ea39c8acb905 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:03.830588 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d7f5ac5d-ec1d-4358-b4b2-ea39c8acb905 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:03.858587 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d7f5ac5d-ec1d-4358-b4b2-ea39c8acb905 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040854 Feb 21 01:16:03.859125 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 495/966] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:03 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:04.205259 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1bb0050e-b553-4ac6-b4e7-168803ea5eb0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:04.205802 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1bb0050e-b553-4ac6-b4e7-168803ea5eb0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:04.211977 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1bb0050e-b553-4ac6-b4e7-168803ea5eb0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:04.212432 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1bb0050e-b553-4ac6-b4e7-168803ea5eb0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:04.213212 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1bb0050e-b553-4ac6-b4e7-168803ea5eb0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:04.213639 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1bb0050e-b553-4ac6-b4e7-168803ea5eb0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:04.274119 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1bb0050e-b553-4ac6-b4e7-168803ea5eb0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:04.281760 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1bb0050e-b553-4ac6-b4e7-168803ea5eb0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080741 Feb 21 01:16:04.282309 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 472/967] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:04 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:16:04.324498 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-48bee869-8e8f-4162-853d-45c578deeefc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:04.325102 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-48bee869-8e8f-4162-853d-45c578deeefc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:04.332293 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-48bee869-8e8f-4162-853d-45c578deeefc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:04.332738 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-48bee869-8e8f-4162-853d-45c578deeefc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:04.333515 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-48bee869-8e8f-4162-853d-45c578deeefc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:04.333944 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-48bee869-8e8f-4162-853d-45c578deeefc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:04.479080 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-48bee869-8e8f-4162-853d-45c578deeefc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:04.488517 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-48bee869-8e8f-4162-853d-45c578deeefc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:04.490011 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-48bee869-8e8f-4162-853d-45c578deeefc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:04.491158 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-48bee869-8e8f-4162-853d-45c578deeefc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.170291 Feb 21 01:16:04.491708 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 496/968] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:04 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:04.870339 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-bea68135-a06c-460e-b8f4-c0c0f6ed4114 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:04.872661 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-bea68135-a06c-460e-b8f4-c0c0f6ed4114 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:04.878246 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bea68135-a06c-460e-b8f4-c0c0f6ed4114 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:04.878705 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bea68135-a06c-460e-b8f4-c0c0f6ed4114 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:04.879499 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bea68135-a06c-460e-b8f4-c0c0f6ed4114 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:04.879994 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bea68135-a06c-460e-b8f4-c0c0f6ed4114 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:04.912032 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-bea68135-a06c-460e-b8f4-c0c0f6ed4114 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045239 Feb 21 01:16:04.912599 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 473/969] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:04 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:05.298203 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1c59cd86-8bfc-4c23-a0a9-7fc96e84c991 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:05.298809 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1c59cd86-8bfc-4c23-a0a9-7fc96e84c991 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:05.304730 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c59cd86-8bfc-4c23-a0a9-7fc96e84c991 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:05.305176 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c59cd86-8bfc-4c23-a0a9-7fc96e84c991 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:05.305948 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c59cd86-8bfc-4c23-a0a9-7fc96e84c991 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:05.306382 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c59cd86-8bfc-4c23-a0a9-7fc96e84c991 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:05.368291 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1c59cd86-8bfc-4c23-a0a9-7fc96e84c991 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:05.376657 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1c59cd86-8bfc-4c23-a0a9-7fc96e84c991 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082003 Feb 21 01:16:05.377212 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 497/970] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:05 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:05.509532 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4e2c3b8c-f26d-4696-8fbc-a596d12fc9f6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:05.510120 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4e2c3b8c-f26d-4696-8fbc-a596d12fc9f6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:05.516745 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4e2c3b8c-f26d-4696-8fbc-a596d12fc9f6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:05.517189 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4e2c3b8c-f26d-4696-8fbc-a596d12fc9f6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:05.517966 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4e2c3b8c-f26d-4696-8fbc-a596d12fc9f6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:05.518395 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4e2c3b8c-f26d-4696-8fbc-a596d12fc9f6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:05.661197 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4e2c3b8c-f26d-4696-8fbc-a596d12fc9f6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:05.669537 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4e2c3b8c-f26d-4696-8fbc-a596d12fc9f6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:05.671149 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4e2c3b8c-f26d-4696-8fbc-a596d12fc9f6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:05.673553 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4e2c3b8c-f26d-4696-8fbc-a596d12fc9f6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.167603 Feb 21 01:16:05.678029 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 474/971] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:05 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:05.923767 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d77e6b8c-be48-4130-9195-baa10c56f0f8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:05.924716 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d77e6b8c-be48-4130-9195-baa10c56f0f8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:05.930553 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d77e6b8c-be48-4130-9195-baa10c56f0f8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:05.931003 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d77e6b8c-be48-4130-9195-baa10c56f0f8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:05.931779 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d77e6b8c-be48-4130-9195-baa10c56f0f8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:05.932232 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d77e6b8c-be48-4130-9195-baa10c56f0f8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:05.961192 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d77e6b8c-be48-4130-9195-baa10c56f0f8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041821 Feb 21 01:16:05.961736 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 498/972] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:05 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:06.393435 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fb1f5fc0-3c58-4d33-a2ee-75ea1564abbf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:06.394053 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fb1f5fc0-3c58-4d33-a2ee-75ea1564abbf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:06.399926 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fb1f5fc0-3c58-4d33-a2ee-75ea1564abbf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:06.400383 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fb1f5fc0-3c58-4d33-a2ee-75ea1564abbf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:06.401165 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fb1f5fc0-3c58-4d33-a2ee-75ea1564abbf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:06.401600 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fb1f5fc0-3c58-4d33-a2ee-75ea1564abbf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:06.461903 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fb1f5fc0-3c58-4d33-a2ee-75ea1564abbf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:06.470091 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fb1f5fc0-3c58-4d33-a2ee-75ea1564abbf tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081319 Feb 21 01:16:06.470657 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 475/973] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:06 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:06.692287 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-677fca7e-39b3-43c1-9011-43255f57c2c4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:06.692845 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-677fca7e-39b3-43c1-9011-43255f57c2c4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:06.698981 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-677fca7e-39b3-43c1-9011-43255f57c2c4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:06.699425 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-677fca7e-39b3-43c1-9011-43255f57c2c4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:06.700232 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-677fca7e-39b3-43c1-9011-43255f57c2c4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:06.700663 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-677fca7e-39b3-43c1-9011-43255f57c2c4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:06.835880 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-677fca7e-39b3-43c1-9011-43255f57c2c4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:06.844169 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-677fca7e-39b3-43c1-9011-43255f57c2c4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:06.845799 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-677fca7e-39b3-43c1-9011-43255f57c2c4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:06.846928 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-677fca7e-39b3-43c1-9011-43255f57c2c4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159040 Feb 21 01:16:06.847485 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 499/974] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:06 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:06.972406 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-85ce13fe-e521-4fa6-954e-2143f5bce9bf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:06.973335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-85ce13fe-e521-4fa6-954e-2143f5bce9bf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:06.979607 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-85ce13fe-e521-4fa6-954e-2143f5bce9bf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:06.980098 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-85ce13fe-e521-4fa6-954e-2143f5bce9bf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:06.980885 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-85ce13fe-e521-4fa6-954e-2143f5bce9bf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:06.981323 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-85ce13fe-e521-4fa6-954e-2143f5bce9bf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:07.011222 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-85ce13fe-e521-4fa6-954e-2143f5bce9bf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043115 Feb 21 01:16:07.011777 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 476/975] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:06 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:07.486413 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-236d8cbc-f3ee-40f6-b005-498402f44ec3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:07.487004 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-236d8cbc-f3ee-40f6-b005-498402f44ec3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:07.492842 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-236d8cbc-f3ee-40f6-b005-498402f44ec3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:07.493285 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-236d8cbc-f3ee-40f6-b005-498402f44ec3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:07.494053 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-236d8cbc-f3ee-40f6-b005-498402f44ec3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:07.494479 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-236d8cbc-f3ee-40f6-b005-498402f44ec3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:07.556085 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-236d8cbc-f3ee-40f6-b005-498402f44ec3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:07.563853 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-236d8cbc-f3ee-40f6-b005-498402f44ec3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081079 Feb 21 01:16:07.564398 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 500/976] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:07 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:07.865591 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9922655f-9aa9-4efb-82ea-b37b965715f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:07.866223 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9922655f-9aa9-4efb-82ea-b37b965715f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:07.872150 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9922655f-9aa9-4efb-82ea-b37b965715f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:07.872601 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9922655f-9aa9-4efb-82ea-b37b965715f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:07.873379 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9922655f-9aa9-4efb-82ea-b37b965715f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:07.873816 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9922655f-9aa9-4efb-82ea-b37b965715f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:08.004559 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9922655f-9aa9-4efb-82ea-b37b965715f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:08.012696 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9922655f-9aa9-4efb-82ea-b37b965715f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:08.014177 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9922655f-9aa9-4efb-82ea-b37b965715f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:08.015322 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9922655f-9aa9-4efb-82ea-b37b965715f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.153506 Feb 21 01:16:08.015900 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 477/977] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:07 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:08.021828 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-de220fc7-b630-4bef-b512-189b00a15359 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:08.022749 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-de220fc7-b630-4bef-b512-189b00a15359 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:08.028960 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-de220fc7-b630-4bef-b512-189b00a15359 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:08.029403 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-de220fc7-b630-4bef-b512-189b00a15359 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:08.030426 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-de220fc7-b630-4bef-b512-189b00a15359 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:08.030850 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-de220fc7-b630-4bef-b512-189b00a15359 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:08.059738 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-de220fc7-b630-4bef-b512-189b00a15359 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041564 Feb 21 01:16:08.060313 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 501/978] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:08 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:08.580347 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-22e45599-345c-4ee4-b512-28db72989ab3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:08.580960 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-22e45599-345c-4ee4-b512-28db72989ab3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:08.586846 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-22e45599-345c-4ee4-b512-28db72989ab3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:08.587294 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-22e45599-345c-4ee4-b512-28db72989ab3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:08.588122 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-22e45599-345c-4ee4-b512-28db72989ab3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:08.588557 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-22e45599-345c-4ee4-b512-28db72989ab3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:08.651913 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-22e45599-345c-4ee4-b512-28db72989ab3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:08.659767 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-22e45599-345c-4ee4-b512-28db72989ab3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083172 Feb 21 01:16:08.660362 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 478/979] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:08 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:09.034583 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f82f72b4-c155-41d7-8c13-2046153c7a51 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:09.035174 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f82f72b4-c155-41d7-8c13-2046153c7a51 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:09.041504 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f82f72b4-c155-41d7-8c13-2046153c7a51 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:09.041947 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f82f72b4-c155-41d7-8c13-2046153c7a51 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:09.045028 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f82f72b4-c155-41d7-8c13-2046153c7a51 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:09.045028 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f82f72b4-c155-41d7-8c13-2046153c7a51 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:09.070601 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f1260f46-43ab-4ff4-99ca-3f05b81e6904 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:09.073796 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f1260f46-43ab-4ff4-99ca-3f05b81e6904 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:09.080007 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f1260f46-43ab-4ff4-99ca-3f05b81e6904 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:09.080451 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f1260f46-43ab-4ff4-99ca-3f05b81e6904 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:09.081240 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f1260f46-43ab-4ff4-99ca-3f05b81e6904 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:09.081668 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f1260f46-43ab-4ff4-99ca-3f05b81e6904 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:09.112277 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f1260f46-43ab-4ff4-99ca-3f05b81e6904 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045449 Feb 21 01:16:09.119668 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 479/980] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:09 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:16:09.186096 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f82f72b4-c155-41d7-8c13-2046153c7a51 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:09.189659 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f82f72b4-c155-41d7-8c13-2046153c7a51 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:09.191169 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f82f72b4-c155-41d7-8c13-2046153c7a51 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:09.192348 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f82f72b4-c155-41d7-8c13-2046153c7a51 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.162358 Feb 21 01:16:09.192897 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 502/981] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:09 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:16:09.676472 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-16ebed67-db5f-492c-9536-79f6f801f92c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:09.677015 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-16ebed67-db5f-492c-9536-79f6f801f92c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:09.682774 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-16ebed67-db5f-492c-9536-79f6f801f92c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:09.683214 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-16ebed67-db5f-492c-9536-79f6f801f92c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:09.684008 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-16ebed67-db5f-492c-9536-79f6f801f92c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:09.684439 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-16ebed67-db5f-492c-9536-79f6f801f92c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:09.747387 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-16ebed67-db5f-492c-9536-79f6f801f92c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:09.755344 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-16ebed67-db5f-492c-9536-79f6f801f92c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082569 Feb 21 01:16:09.755931 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 480/982] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:09 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:10.123303 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-63386058-e9ed-4d61-9bb6-8f9fcfdab4b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:10.124265 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-63386058-e9ed-4d61-9bb6-8f9fcfdab4b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:10.131229 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-63386058-e9ed-4d61-9bb6-8f9fcfdab4b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:10.131604 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-63386058-e9ed-4d61-9bb6-8f9fcfdab4b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:10.132428 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-63386058-e9ed-4d61-9bb6-8f9fcfdab4b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:10.132872 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-63386058-e9ed-4d61-9bb6-8f9fcfdab4b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:10.160856 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-63386058-e9ed-4d61-9bb6-8f9fcfdab4b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041338 Feb 21 01:16:10.161397 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 503/983] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:10 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:10.210347 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ffd8f5e5-e76a-46f3-bcf4-b2a930282e8d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:10.210945 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ffd8f5e5-e76a-46f3-bcf4-b2a930282e8d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:10.217144 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ffd8f5e5-e76a-46f3-bcf4-b2a930282e8d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:10.217584 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ffd8f5e5-e76a-46f3-bcf4-b2a930282e8d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:10.218356 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ffd8f5e5-e76a-46f3-bcf4-b2a930282e8d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:10.219284 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ffd8f5e5-e76a-46f3-bcf4-b2a930282e8d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:10.350498 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ffd8f5e5-e76a-46f3-bcf4-b2a930282e8d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:10.358818 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ffd8f5e5-e76a-46f3-bcf4-b2a930282e8d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:10.361139 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ffd8f5e5-e76a-46f3-bcf4-b2a930282e8d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:10.362293 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ffd8f5e5-e76a-46f3-bcf4-b2a930282e8d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155669 Feb 21 01:16:10.362842 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 481/984] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:10 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:10.772530 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4c7b9b3d-0cf3-48bd-aac6-11cf98850f0e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:10.773164 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4c7b9b3d-0cf3-48bd-aac6-11cf98850f0e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:10.778926 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4c7b9b3d-0cf3-48bd-aac6-11cf98850f0e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:10.779363 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4c7b9b3d-0cf3-48bd-aac6-11cf98850f0e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:10.780411 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4c7b9b3d-0cf3-48bd-aac6-11cf98850f0e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:10.780836 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4c7b9b3d-0cf3-48bd-aac6-11cf98850f0e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:10.840474 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4c7b9b3d-0cf3-48bd-aac6-11cf98850f0e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:10.849323 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4c7b9b3d-0cf3-48bd-aac6-11cf98850f0e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080424 Feb 21 01:16:10.849892 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 504/985] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:10 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:11.172616 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e0bbfe64-c5f5-4e79-80ee-04e50388ef0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:11.173451 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e0bbfe64-c5f5-4e79-80ee-04e50388ef0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:11.179393 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e0bbfe64-c5f5-4e79-80ee-04e50388ef0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:11.179856 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e0bbfe64-c5f5-4e79-80ee-04e50388ef0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:11.180660 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e0bbfe64-c5f5-4e79-80ee-04e50388ef0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:11.181094 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e0bbfe64-c5f5-4e79-80ee-04e50388ef0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:11.211082 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e0bbfe64-c5f5-4e79-80ee-04e50388ef0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042370 Feb 21 01:16:11.211746 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 482/986] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:11 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:11.381051 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7e12eb41-1386-406d-aaf3-d80daf3423af tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:11.381659 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7e12eb41-1386-406d-aaf3-d80daf3423af tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:11.388106 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7e12eb41-1386-406d-aaf3-d80daf3423af tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:11.388574 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7e12eb41-1386-406d-aaf3-d80daf3423af tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:11.389344 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7e12eb41-1386-406d-aaf3-d80daf3423af tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:11.389767 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7e12eb41-1386-406d-aaf3-d80daf3423af tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:11.522506 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7e12eb41-1386-406d-aaf3-d80daf3423af tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:11.531007 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7e12eb41-1386-406d-aaf3-d80daf3423af tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:11.532801 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7e12eb41-1386-406d-aaf3-d80daf3423af tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:11.533953 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7e12eb41-1386-406d-aaf3-d80daf3423af tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156605 Feb 21 01:16:11.534500 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 505/987] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:11 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:11.866549 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6275d549-133d-4d10-967b-7b4d1dbef4e9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:11.867082 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6275d549-133d-4d10-967b-7b4d1dbef4e9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:11.873390 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6275d549-133d-4d10-967b-7b4d1dbef4e9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:11.873839 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6275d549-133d-4d10-967b-7b4d1dbef4e9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:11.874627 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6275d549-133d-4d10-967b-7b4d1dbef4e9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:11.875370 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6275d549-133d-4d10-967b-7b4d1dbef4e9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:11.935100 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6275d549-133d-4d10-967b-7b4d1dbef4e9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:11.942396 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6275d549-133d-4d10-967b-7b4d1dbef4e9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079670 Feb 21 01:16:11.942942 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 483/988] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:11 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:12.222360 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-58a63b8c-898f-43fd-983f-1eebab388915 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:12.223324 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-58a63b8c-898f-43fd-983f-1eebab388915 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:12.229235 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-58a63b8c-898f-43fd-983f-1eebab388915 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:12.229673 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-58a63b8c-898f-43fd-983f-1eebab388915 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:12.230447 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-58a63b8c-898f-43fd-983f-1eebab388915 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:12.230875 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-58a63b8c-898f-43fd-983f-1eebab388915 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:12.260595 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-58a63b8c-898f-43fd-983f-1eebab388915 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042805 Feb 21 01:16:12.261149 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 506/989] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:12 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:12.552857 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-76324d02-7deb-42c6-98c3-33d389959c92 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:12.553401 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-76324d02-7deb-42c6-98c3-33d389959c92 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:12.559305 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-76324d02-7deb-42c6-98c3-33d389959c92 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:12.568440 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-76324d02-7deb-42c6-98c3-33d389959c92 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:12.568440 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-76324d02-7deb-42c6-98c3-33d389959c92 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:12.568440 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-76324d02-7deb-42c6-98c3-33d389959c92 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:12.699361 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-76324d02-7deb-42c6-98c3-33d389959c92 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:12.708698 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-76324d02-7deb-42c6-98c3-33d389959c92 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:12.710189 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-76324d02-7deb-42c6-98c3-33d389959c92 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:12.711454 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-76324d02-7deb-42c6-98c3-33d389959c92 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.162471 Feb 21 01:16:12.712104 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 484/990] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:12 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:12.959299 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8c5bae98-15b8-4919-8b88-0e6c8cf90c6d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:12.959863 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8c5bae98-15b8-4919-8b88-0e6c8cf90c6d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:12.966009 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8c5bae98-15b8-4919-8b88-0e6c8cf90c6d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:12.966454 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8c5bae98-15b8-4919-8b88-0e6c8cf90c6d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:12.967228 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8c5bae98-15b8-4919-8b88-0e6c8cf90c6d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:12.967659 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8c5bae98-15b8-4919-8b88-0e6c8cf90c6d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:13.030132 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8c5bae98-15b8-4919-8b88-0e6c8cf90c6d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:13.037477 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8c5bae98-15b8-4919-8b88-0e6c8cf90c6d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081989 Feb 21 01:16:13.038035 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 507/991] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:12 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:13.272086 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-51616015-39bc-4ce7-b8a6-b98fc355f7d7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:13.273022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-51616015-39bc-4ce7-b8a6-b98fc355f7d7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:13.279272 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51616015-39bc-4ce7-b8a6-b98fc355f7d7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:13.280012 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51616015-39bc-4ce7-b8a6-b98fc355f7d7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:13.280830 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51616015-39bc-4ce7-b8a6-b98fc355f7d7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:13.281785 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51616015-39bc-4ce7-b8a6-b98fc355f7d7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:13.310573 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-51616015-39bc-4ce7-b8a6-b98fc355f7d7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042275 Feb 21 01:16:13.311111 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 485/992] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:13 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:13.730241 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1673d32e-6d26-4846-a46d-af987db5cc88 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:13.730851 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1673d32e-6d26-4846-a46d-af987db5cc88 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:13.737907 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1673d32e-6d26-4846-a46d-af987db5cc88 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:13.738359 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1673d32e-6d26-4846-a46d-af987db5cc88 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:13.739141 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1673d32e-6d26-4846-a46d-af987db5cc88 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:13.739575 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1673d32e-6d26-4846-a46d-af987db5cc88 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:13.873832 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1673d32e-6d26-4846-a46d-af987db5cc88 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:13.882594 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1673d32e-6d26-4846-a46d-af987db5cc88 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:13.884098 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1673d32e-6d26-4846-a46d-af987db5cc88 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:13.885223 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1673d32e-6d26-4846-a46d-af987db5cc88 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158774 Feb 21 01:16:13.885762 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 508/993] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:13 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:14.054001 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2bf7a0c3-697e-47c4-9e98-bbe3d93771ec tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:14.054546 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2bf7a0c3-697e-47c4-9e98-bbe3d93771ec tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:14.060388 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2bf7a0c3-697e-47c4-9e98-bbe3d93771ec tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:14.060836 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2bf7a0c3-697e-47c4-9e98-bbe3d93771ec tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:14.061611 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2bf7a0c3-697e-47c4-9e98-bbe3d93771ec tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:14.062042 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2bf7a0c3-697e-47c4-9e98-bbe3d93771ec tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:14.120497 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2bf7a0c3-697e-47c4-9e98-bbe3d93771ec tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:14.128492 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2bf7a0c3-697e-47c4-9e98-bbe3d93771ec tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.078259 Feb 21 01:16:14.129075 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 486/994] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:14 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:14.322086 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-20bf0e61-7150-4d54-968a-7bb1cd0e5ff2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:14.322915 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-20bf0e61-7150-4d54-968a-7bb1cd0e5ff2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:14.329829 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-20bf0e61-7150-4d54-968a-7bb1cd0e5ff2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:14.330273 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-20bf0e61-7150-4d54-968a-7bb1cd0e5ff2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:14.331081 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-20bf0e61-7150-4d54-968a-7bb1cd0e5ff2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:14.331519 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-20bf0e61-7150-4d54-968a-7bb1cd0e5ff2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:14.361372 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-20bf0e61-7150-4d54-968a-7bb1cd0e5ff2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043092 Feb 21 01:16:14.362150 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 509/995] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:14 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:14.905367 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7295267c-ccf4-4292-b010-c7ade67d5549 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:14.905995 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7295267c-ccf4-4292-b010-c7ade67d5549 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:14.914638 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7295267c-ccf4-4292-b010-c7ade67d5549 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:14.915081 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7295267c-ccf4-4292-b010-c7ade67d5549 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:14.915907 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7295267c-ccf4-4292-b010-c7ade67d5549 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:14.916341 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7295267c-ccf4-4292-b010-c7ade67d5549 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:15.049697 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7295267c-ccf4-4292-b010-c7ade67d5549 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:15.058000 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7295267c-ccf4-4292-b010-c7ade67d5549 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:15.059488 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7295267c-ccf4-4292-b010-c7ade67d5549 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:15.060689 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7295267c-ccf4-4292-b010-c7ade67d5549 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159385 Feb 21 01:16:15.061243 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 487/996] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:14 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:16:15.144487 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a0f3bb7e-50ef-4278-bdcd-bccbc1cf3cde tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:15.145087 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a0f3bb7e-50ef-4278-bdcd-bccbc1cf3cde tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:15.151044 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a0f3bb7e-50ef-4278-bdcd-bccbc1cf3cde tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:15.151487 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a0f3bb7e-50ef-4278-bdcd-bccbc1cf3cde tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:15.152303 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a0f3bb7e-50ef-4278-bdcd-bccbc1cf3cde tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:15.152735 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a0f3bb7e-50ef-4278-bdcd-bccbc1cf3cde tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:15.213411 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a0f3bb7e-50ef-4278-bdcd-bccbc1cf3cde tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:15.220855 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a0f3bb7e-50ef-4278-bdcd-bccbc1cf3cde tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080259 Feb 21 01:16:15.221411 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 510/997] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:15 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:15.372383 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cd2b51d9-d883-4122-8d79-b2c49fad4a55 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:15.373358 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cd2b51d9-d883-4122-8d79-b2c49fad4a55 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:15.379947 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cd2b51d9-d883-4122-8d79-b2c49fad4a55 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:15.380393 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cd2b51d9-d883-4122-8d79-b2c49fad4a55 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:15.381200 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cd2b51d9-d883-4122-8d79-b2c49fad4a55 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:15.381628 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cd2b51d9-d883-4122-8d79-b2c49fad4a55 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:15.410938 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cd2b51d9-d883-4122-8d79-b2c49fad4a55 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042577 Feb 21 01:16:15.411499 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 488/998] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:15 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:16.079240 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-13570682-a0ca-45c1-9a50-ed012c3b0183 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:16.079859 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-13570682-a0ca-45c1-9a50-ed012c3b0183 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:16.086653 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-13570682-a0ca-45c1-9a50-ed012c3b0183 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:16.087105 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-13570682-a0ca-45c1-9a50-ed012c3b0183 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:16.087916 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-13570682-a0ca-45c1-9a50-ed012c3b0183 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:16.088355 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-13570682-a0ca-45c1-9a50-ed012c3b0183 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:16.224569 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-13570682-a0ca-45c1-9a50-ed012c3b0183 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:16.232790 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-13570682-a0ca-45c1-9a50-ed012c3b0183 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:16.234298 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-13570682-a0ca-45c1-9a50-ed012c3b0183 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:16.235536 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-13570682-a0ca-45c1-9a50-ed012c3b0183 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159973 Feb 21 01:16:16.236333 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 511/999] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:16 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:16.237290 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-901c04da-ee8e-4d76-a175-3a76bf63e8fb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:16.237901 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-901c04da-ee8e-4d76-a175-3a76bf63e8fb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:16.244242 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-901c04da-ee8e-4d76-a175-3a76bf63e8fb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:16.244697 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-901c04da-ee8e-4d76-a175-3a76bf63e8fb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:16.245476 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-901c04da-ee8e-4d76-a175-3a76bf63e8fb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:16.245906 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-901c04da-ee8e-4d76-a175-3a76bf63e8fb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:16.305724 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-901c04da-ee8e-4d76-a175-3a76bf63e8fb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:16.313059 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-901c04da-ee8e-4d76-a175-3a76bf63e8fb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079534 Feb 21 01:16:16.313613 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 489/1000] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:16 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:16:16.422019 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3b9d9f6a-9d32-4232-a2b8-b4e91060ce12 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:16.422934 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3b9d9f6a-9d32-4232-a2b8-b4e91060ce12 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:16.429626 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b9d9f6a-9d32-4232-a2b8-b4e91060ce12 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:16.430073 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b9d9f6a-9d32-4232-a2b8-b4e91060ce12 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:16.430858 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b9d9f6a-9d32-4232-a2b8-b4e91060ce12 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:16.431291 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b9d9f6a-9d32-4232-a2b8-b4e91060ce12 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:16.459826 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3b9d9f6a-9d32-4232-a2b8-b4e91060ce12 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041566 Feb 21 01:16:16.460412 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 512/1001] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:16 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:17.255124 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-20397521-ab3d-4ce6-b5aa-b5fe1c22b0be tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:17.255742 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-20397521-ab3d-4ce6-b5aa-b5fe1c22b0be tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:17.261856 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-20397521-ab3d-4ce6-b5aa-b5fe1c22b0be tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:17.262303 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-20397521-ab3d-4ce6-b5aa-b5fe1c22b0be tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:17.263090 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-20397521-ab3d-4ce6-b5aa-b5fe1c22b0be tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:17.263526 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-20397521-ab3d-4ce6-b5aa-b5fe1c22b0be tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:17.330082 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d5a3d2c3-92f8-4314-a061-d6810cd2b4de tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:17.330681 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d5a3d2c3-92f8-4314-a061-d6810cd2b4de tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:17.337135 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d5a3d2c3-92f8-4314-a061-d6810cd2b4de tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:17.337587 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d5a3d2c3-92f8-4314-a061-d6810cd2b4de tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:17.338374 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d5a3d2c3-92f8-4314-a061-d6810cd2b4de tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:17.338805 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d5a3d2c3-92f8-4314-a061-d6810cd2b4de tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:17.402047 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d5a3d2c3-92f8-4314-a061-d6810cd2b4de tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:17.405016 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-20397521-ab3d-4ce6-b5aa-b5fe1c22b0be tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:17.411747 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d5a3d2c3-92f8-4314-a061-d6810cd2b4de tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.085369 Feb 21 01:16:17.412462 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 513/1002] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:17 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:16:17.413921 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-20397521-ab3d-4ce6-b5aa-b5fe1c22b0be tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:17.415495 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-20397521-ab3d-4ce6-b5aa-b5fe1c22b0be tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:17.416676 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-20397521-ab3d-4ce6-b5aa-b5fe1c22b0be tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.166524 Feb 21 01:16:17.417217 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 490/1003] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:17 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:17.471154 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2ce2e993-be7d-4373-ab2a-f3f6e2162c59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:17.472209 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2ce2e993-be7d-4373-ab2a-f3f6e2162c59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:17.478041 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2ce2e993-be7d-4373-ab2a-f3f6e2162c59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:17.478481 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2ce2e993-be7d-4373-ab2a-f3f6e2162c59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:17.479250 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2ce2e993-be7d-4373-ab2a-f3f6e2162c59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:17.479675 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2ce2e993-be7d-4373-ab2a-f3f6e2162c59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:17.508557 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2ce2e993-be7d-4373-ab2a-f3f6e2162c59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041209 Feb 21 01:16:17.509035 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 514/1004] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:17 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:18.428220 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-aa89c6a1-c519-49fb-9603-1357b57310d8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:18.428829 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-aa89c6a1-c519-49fb-9603-1357b57310d8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:18.434175 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5e045449-f6af-4546-9a0d-7d26228d6108 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:18.434787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5e045449-f6af-4546-9a0d-7d26228d6108 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:18.435434 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-aa89c6a1-c519-49fb-9603-1357b57310d8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:18.435916 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-aa89c6a1-c519-49fb-9603-1357b57310d8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:18.436702 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-aa89c6a1-c519-49fb-9603-1357b57310d8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:18.437131 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-aa89c6a1-c519-49fb-9603-1357b57310d8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:18.441858 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5e045449-f6af-4546-9a0d-7d26228d6108 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:18.442304 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5e045449-f6af-4546-9a0d-7d26228d6108 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:18.443151 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5e045449-f6af-4546-9a0d-7d26228d6108 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:18.443581 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5e045449-f6af-4546-9a0d-7d26228d6108 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:18.498435 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-aa89c6a1-c519-49fb-9603-1357b57310d8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:18.506487 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-aa89c6a1-c519-49fb-9603-1357b57310d8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081940 Feb 21 01:16:18.507066 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 491/1005] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:18 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:16:18.520451 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-baa53700-4ba2-4076-9d79-4028872bec00 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:18.521413 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-baa53700-4ba2-4076-9d79-4028872bec00 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:18.527365 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-baa53700-4ba2-4076-9d79-4028872bec00 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:18.528225 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-baa53700-4ba2-4076-9d79-4028872bec00 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:18.528625 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-baa53700-4ba2-4076-9d79-4028872bec00 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:18.529070 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-baa53700-4ba2-4076-9d79-4028872bec00 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:18.560552 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-baa53700-4ba2-4076-9d79-4028872bec00 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044541 Feb 21 01:16:18.561122 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 492/1006] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:18 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:16:18.585215 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5e045449-f6af-4546-9a0d-7d26228d6108 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:18.593483 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5e045449-f6af-4546-9a0d-7d26228d6108 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:18.594983 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5e045449-f6af-4546-9a0d-7d26228d6108 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:18.596145 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5e045449-f6af-4546-9a0d-7d26228d6108 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.165673 Feb 21 01:16:18.596692 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 515/1007] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:18 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:16:19.523306 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9ba48cad-8e27-4d9a-b1bd-3fba6ddb0848 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:19.523957 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9ba48cad-8e27-4d9a-b1bd-3fba6ddb0848 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:19.530519 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9ba48cad-8e27-4d9a-b1bd-3fba6ddb0848 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:19.530964 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9ba48cad-8e27-4d9a-b1bd-3fba6ddb0848 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:19.531743 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9ba48cad-8e27-4d9a-b1bd-3fba6ddb0848 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:19.532198 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9ba48cad-8e27-4d9a-b1bd-3fba6ddb0848 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:19.572348 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7e577870-e4ac-4b94-9288-78867cbe2e17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:19.573245 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7e577870-e4ac-4b94-9288-78867cbe2e17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:19.579188 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7e577870-e4ac-4b94-9288-78867cbe2e17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:19.579958 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7e577870-e4ac-4b94-9288-78867cbe2e17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:19.580768 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7e577870-e4ac-4b94-9288-78867cbe2e17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:19.581208 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7e577870-e4ac-4b94-9288-78867cbe2e17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:19.593880 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9ba48cad-8e27-4d9a-b1bd-3fba6ddb0848 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:19.601446 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9ba48cad-8e27-4d9a-b1bd-3fba6ddb0848 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081810 Feb 21 01:16:19.602011 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 493/1008] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:19 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:19.612988 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7e577870-e4ac-4b94-9288-78867cbe2e17 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044365 Feb 21 01:16:19.613557 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 516/1009] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:19 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:16:19.613860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-33b920dc-cd00-4e8a-8ac5-c64f9f1e6b41 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:19.614547 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-33b920dc-cd00-4e8a-8ac5-c64f9f1e6b41 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:19.620503 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-33b920dc-cd00-4e8a-8ac5-c64f9f1e6b41 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:19.620948 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-33b920dc-cd00-4e8a-8ac5-c64f9f1e6b41 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:19.621732 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-33b920dc-cd00-4e8a-8ac5-c64f9f1e6b41 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:19.622163 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-33b920dc-cd00-4e8a-8ac5-c64f9f1e6b41 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:19.762281 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-33b920dc-cd00-4e8a-8ac5-c64f9f1e6b41 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:19.770671 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-33b920dc-cd00-4e8a-8ac5-c64f9f1e6b41 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:19.772220 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-33b920dc-cd00-4e8a-8ac5-c64f9f1e6b41 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:19.773362 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-33b920dc-cd00-4e8a-8ac5-c64f9f1e6b41 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.163733 Feb 21 01:16:19.773912 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 494/1010] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:19 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:16:20.618476 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2d9d6469-dfbd-4ab3-bc38-84cd5c3bed9f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:20.619147 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2d9d6469-dfbd-4ab3-bc38-84cd5c3bed9f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:20.624198 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0508a3e8-0522-49d9-8fa1-23bc49efd53e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:20.625156 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0508a3e8-0522-49d9-8fa1-23bc49efd53e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:20.625538 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2d9d6469-dfbd-4ab3-bc38-84cd5c3bed9f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:20.625982 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2d9d6469-dfbd-4ab3-bc38-84cd5c3bed9f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:20.627352 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2d9d6469-dfbd-4ab3-bc38-84cd5c3bed9f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:20.627802 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2d9d6469-dfbd-4ab3-bc38-84cd5c3bed9f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:20.632215 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0508a3e8-0522-49d9-8fa1-23bc49efd53e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:20.632672 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0508a3e8-0522-49d9-8fa1-23bc49efd53e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:20.633471 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0508a3e8-0522-49d9-8fa1-23bc49efd53e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:20.633906 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0508a3e8-0522-49d9-8fa1-23bc49efd53e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:20.664173 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0508a3e8-0522-49d9-8fa1-23bc49efd53e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043691 Feb 21 01:16:20.664750 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 495/1011] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:20 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:16:20.691213 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2d9d6469-dfbd-4ab3-bc38-84cd5c3bed9f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:20.698652 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2d9d6469-dfbd-4ab3-bc38-84cd5c3bed9f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083822 Feb 21 01:16:20.699211 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 517/1012] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:20 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:20.791713 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c03fc368-30da-46a3-a8b9-09e8b3040e64 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:20.792336 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c03fc368-30da-46a3-a8b9-09e8b3040e64 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:20.798793 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c03fc368-30da-46a3-a8b9-09e8b3040e64 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:20.799317 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c03fc368-30da-46a3-a8b9-09e8b3040e64 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:20.800105 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c03fc368-30da-46a3-a8b9-09e8b3040e64 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:20.800535 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c03fc368-30da-46a3-a8b9-09e8b3040e64 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:20.932244 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c03fc368-30da-46a3-a8b9-09e8b3040e64 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:20.941607 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c03fc368-30da-46a3-a8b9-09e8b3040e64 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:20.943097 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c03fc368-30da-46a3-a8b9-09e8b3040e64 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:20.944377 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c03fc368-30da-46a3-a8b9-09e8b3040e64 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156343 Feb 21 01:16:20.944935 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 496/1013] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:20 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:16:21.676256 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-acdf8c54-fca2-49f0-9164-ca938f555c5e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:21.677128 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-acdf8c54-fca2-49f0-9164-ca938f555c5e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:21.683496 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-acdf8c54-fca2-49f0-9164-ca938f555c5e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:21.683985 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-acdf8c54-fca2-49f0-9164-ca938f555c5e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:21.684779 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-acdf8c54-fca2-49f0-9164-ca938f555c5e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:21.685212 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-acdf8c54-fca2-49f0-9164-ca938f555c5e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:21.716389 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c8914345-1fef-42ac-aaf3-1fa999ac3b83 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:21.717015 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c8914345-1fef-42ac-aaf3-1fa999ac3b83 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:21.717164 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-acdf8c54-fca2-49f0-9164-ca938f555c5e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045137 Feb 21 01:16:21.720775 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 518/1014] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:21 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:21.723988 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c8914345-1fef-42ac-aaf3-1fa999ac3b83 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:21.724439 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c8914345-1fef-42ac-aaf3-1fa999ac3b83 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:21.725252 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c8914345-1fef-42ac-aaf3-1fa999ac3b83 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:21.725689 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c8914345-1fef-42ac-aaf3-1fa999ac3b83 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:21.794447 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c8914345-1fef-42ac-aaf3-1fa999ac3b83 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:21.802691 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c8914345-1fef-42ac-aaf3-1fa999ac3b83 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.090857 Feb 21 01:16:21.803249 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 497/1015] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:21 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:16:21.962970 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-91b8badd-c37f-4f01-879a-ebbdc27d4095 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:21.963476 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-91b8badd-c37f-4f01-879a-ebbdc27d4095 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:21.969310 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-91b8badd-c37f-4f01-879a-ebbdc27d4095 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:21.969797 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-91b8badd-c37f-4f01-879a-ebbdc27d4095 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:21.970684 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-91b8badd-c37f-4f01-879a-ebbdc27d4095 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:21.971115 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-91b8badd-c37f-4f01-879a-ebbdc27d4095 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:22.115487 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-91b8badd-c37f-4f01-879a-ebbdc27d4095 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:22.124184 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-91b8badd-c37f-4f01-879a-ebbdc27d4095 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:22.125668 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-91b8badd-c37f-4f01-879a-ebbdc27d4095 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:22.127636 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-91b8badd-c37f-4f01-879a-ebbdc27d4095 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.168260 Feb 21 01:16:22.128582 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 519/1016] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:21 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:22.728877 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4ea6e27a-75e0-4f1d-8acb-635da831b820 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:22.729791 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4ea6e27a-75e0-4f1d-8acb-635da831b820 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:22.736182 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ea6e27a-75e0-4f1d-8acb-635da831b820 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:22.737874 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ea6e27a-75e0-4f1d-8acb-635da831b820 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:22.737874 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ea6e27a-75e0-4f1d-8acb-635da831b820 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:22.737874 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ea6e27a-75e0-4f1d-8acb-635da831b820 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:22.767436 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4ea6e27a-75e0-4f1d-8acb-635da831b820 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041844 Feb 21 01:16:22.768309 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 498/1017] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:22 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:22.818760 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8cbb358d-d44b-464f-942d-09073415dc23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:22.819371 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8cbb358d-d44b-464f-942d-09073415dc23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:22.825693 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8cbb358d-d44b-464f-942d-09073415dc23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:22.826134 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8cbb358d-d44b-464f-942d-09073415dc23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:22.826916 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8cbb358d-d44b-464f-942d-09073415dc23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:22.827352 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8cbb358d-d44b-464f-942d-09073415dc23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:22.887851 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8cbb358d-d44b-464f-942d-09073415dc23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:22.896357 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8cbb358d-d44b-464f-942d-09073415dc23 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081184 Feb 21 01:16:22.896910 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 520/1018] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:22 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:23.147742 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6990cb1a-17e2-4fc2-92b9-f1cc966a9e96 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:23.148200 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6990cb1a-17e2-4fc2-92b9-f1cc966a9e96 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:23.154055 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6990cb1a-17e2-4fc2-92b9-f1cc966a9e96 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:23.154761 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6990cb1a-17e2-4fc2-92b9-f1cc966a9e96 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:23.155564 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6990cb1a-17e2-4fc2-92b9-f1cc966a9e96 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:23.156016 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6990cb1a-17e2-4fc2-92b9-f1cc966a9e96 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:23.293447 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6990cb1a-17e2-4fc2-92b9-f1cc966a9e96 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:23.302447 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6990cb1a-17e2-4fc2-92b9-f1cc966a9e96 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:23.303929 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6990cb1a-17e2-4fc2-92b9-f1cc966a9e96 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:23.305070 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6990cb1a-17e2-4fc2-92b9-f1cc966a9e96 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.161949 Feb 21 01:16:23.305619 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 499/1019] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:23 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:23.779055 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e7863a7f-7508-4cbd-9145-901c7ec6cae3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:23.780230 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e7863a7f-7508-4cbd-9145-901c7ec6cae3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:23.786589 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7863a7f-7508-4cbd-9145-901c7ec6cae3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:23.787020 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7863a7f-7508-4cbd-9145-901c7ec6cae3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:23.787788 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7863a7f-7508-4cbd-9145-901c7ec6cae3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:23.788236 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7863a7f-7508-4cbd-9145-901c7ec6cae3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:23.817689 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e7863a7f-7508-4cbd-9145-901c7ec6cae3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042316 Feb 21 01:16:23.818244 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 521/1020] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:23 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:23.913614 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-deb96d75-b6b2-4b9d-9475-b6ce95c55d9e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:23.914227 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-deb96d75-b6b2-4b9d-9475-b6ce95c55d9e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:23.920477 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-deb96d75-b6b2-4b9d-9475-b6ce95c55d9e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:23.920954 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-deb96d75-b6b2-4b9d-9475-b6ce95c55d9e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:23.921710 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-deb96d75-b6b2-4b9d-9475-b6ce95c55d9e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:23.922146 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-deb96d75-b6b2-4b9d-9475-b6ce95c55d9e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:23.983148 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-deb96d75-b6b2-4b9d-9475-b6ce95c55d9e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:23.991342 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-deb96d75-b6b2-4b9d-9475-b6ce95c55d9e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081377 Feb 21 01:16:23.991924 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 500/1021] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:23 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:24.323545 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a81f47e0-0c90-482b-b547-226aab027ffc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:24.324176 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a81f47e0-0c90-482b-b547-226aab027ffc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:24.331234 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a81f47e0-0c90-482b-b547-226aab027ffc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:24.331679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a81f47e0-0c90-482b-b547-226aab027ffc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:24.332485 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a81f47e0-0c90-482b-b547-226aab027ffc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:24.332919 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a81f47e0-0c90-482b-b547-226aab027ffc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:24.468663 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a81f47e0-0c90-482b-b547-226aab027ffc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:24.477861 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a81f47e0-0c90-482b-b547-226aab027ffc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:24.479325 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a81f47e0-0c90-482b-b547-226aab027ffc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:24.480524 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a81f47e0-0c90-482b-b547-226aab027ffc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160721 Feb 21 01:16:24.481074 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 522/1022] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:24 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:24.830203 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9bd9b4d1-9657-4a94-8256-aa1711888ecc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:24.831144 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9bd9b4d1-9657-4a94-8256-aa1711888ecc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:24.837374 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9bd9b4d1-9657-4a94-8256-aa1711888ecc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:24.837827 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9bd9b4d1-9657-4a94-8256-aa1711888ecc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:24.838611 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9bd9b4d1-9657-4a94-8256-aa1711888ecc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:24.839045 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9bd9b4d1-9657-4a94-8256-aa1711888ecc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:24.870380 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9bd9b4d1-9657-4a94-8256-aa1711888ecc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045032 Feb 21 01:16:24.870973 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 501/1023] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:24 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:25.007709 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9e617699-3e8b-4b35-8762-a328a553673f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:25.008352 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9e617699-3e8b-4b35-8762-a328a553673f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:25.014438 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9e617699-3e8b-4b35-8762-a328a553673f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:25.014906 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9e617699-3e8b-4b35-8762-a328a553673f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:25.015695 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9e617699-3e8b-4b35-8762-a328a553673f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:25.016163 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9e617699-3e8b-4b35-8762-a328a553673f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:25.078447 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9e617699-3e8b-4b35-8762-a328a553673f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:25.086436 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9e617699-3e8b-4b35-8762-a328a553673f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082333 Feb 21 01:16:25.086932 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 523/1024] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:25 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:25.498939 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f64b718f-1dbf-4369-a05a-7af9e2ad0c05 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:25.499536 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f64b718f-1dbf-4369-a05a-7af9e2ad0c05 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:25.506195 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f64b718f-1dbf-4369-a05a-7af9e2ad0c05 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:25.506630 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f64b718f-1dbf-4369-a05a-7af9e2ad0c05 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:25.507398 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f64b718f-1dbf-4369-a05a-7af9e2ad0c05 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:25.507824 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f64b718f-1dbf-4369-a05a-7af9e2ad0c05 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:25.646483 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f64b718f-1dbf-4369-a05a-7af9e2ad0c05 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:25.654976 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f64b718f-1dbf-4369-a05a-7af9e2ad0c05 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:25.656509 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f64b718f-1dbf-4369-a05a-7af9e2ad0c05 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:25.658485 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f64b718f-1dbf-4369-a05a-7af9e2ad0c05 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.163007 Feb 21 01:16:25.658856 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 502/1025] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:25 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:25.883297 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-48a14977-a018-4072-b690-f0a3b93ee25a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:25.884147 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-48a14977-a018-4072-b690-f0a3b93ee25a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:25.890391 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-48a14977-a018-4072-b690-f0a3b93ee25a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:25.890816 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-48a14977-a018-4072-b690-f0a3b93ee25a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:25.891607 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-48a14977-a018-4072-b690-f0a3b93ee25a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:25.892067 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-48a14977-a018-4072-b690-f0a3b93ee25a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:25.920787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-48a14977-a018-4072-b690-f0a3b93ee25a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041312 Feb 21 01:16:25.922253 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 524/1026] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:25 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:26.103329 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-992de9b0-5f2f-4456-8df1-a2d473f41674 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:26.103961 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-992de9b0-5f2f-4456-8df1-a2d473f41674 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:26.109782 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-992de9b0-5f2f-4456-8df1-a2d473f41674 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:26.110229 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-992de9b0-5f2f-4456-8df1-a2d473f41674 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:26.111600 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-992de9b0-5f2f-4456-8df1-a2d473f41674 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:26.112084 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-992de9b0-5f2f-4456-8df1-a2d473f41674 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:26.171336 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-992de9b0-5f2f-4456-8df1-a2d473f41674 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:26.179580 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-992de9b0-5f2f-4456-8df1-a2d473f41674 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080000 Feb 21 01:16:26.180171 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 503/1027] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:26 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:26.676644 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-567fe2dd-7e20-46f0-8398-60f7f365a494 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:26.677246 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-567fe2dd-7e20-46f0-8398-60f7f365a494 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:26.683177 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-567fe2dd-7e20-46f0-8398-60f7f365a494 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:26.683626 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-567fe2dd-7e20-46f0-8398-60f7f365a494 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:26.684442 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-567fe2dd-7e20-46f0-8398-60f7f365a494 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:26.684912 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-567fe2dd-7e20-46f0-8398-60f7f365a494 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:26.813325 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-567fe2dd-7e20-46f0-8398-60f7f365a494 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:26.821914 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-567fe2dd-7e20-46f0-8398-60f7f365a494 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:26.823394 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-567fe2dd-7e20-46f0-8398-60f7f365a494 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:26.824562 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-567fe2dd-7e20-46f0-8398-60f7f365a494 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.151699 Feb 21 01:16:26.825111 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 525/1028] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:26 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:26.933071 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-75319507-7aec-4204-b76e-6e41ba52756a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:26.933917 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-75319507-7aec-4204-b76e-6e41ba52756a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:26.941367 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-75319507-7aec-4204-b76e-6e41ba52756a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:26.941817 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-75319507-7aec-4204-b76e-6e41ba52756a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:26.942613 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-75319507-7aec-4204-b76e-6e41ba52756a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:26.943051 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-75319507-7aec-4204-b76e-6e41ba52756a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:26.973194 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-75319507-7aec-4204-b76e-6e41ba52756a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043989 Feb 21 01:16:26.973748 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 504/1029] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:26 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:27.196128 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-125e33a2-5ce9-4542-9727-f85b912a456c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:27.196669 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-125e33a2-5ce9-4542-9727-f85b912a456c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:27.202711 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-125e33a2-5ce9-4542-9727-f85b912a456c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:27.203151 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-125e33a2-5ce9-4542-9727-f85b912a456c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:27.203953 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-125e33a2-5ce9-4542-9727-f85b912a456c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:27.204385 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-125e33a2-5ce9-4542-9727-f85b912a456c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:27.265196 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-125e33a2-5ce9-4542-9727-f85b912a456c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:27.271312 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-125e33a2-5ce9-4542-9727-f85b912a456c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.078934 Feb 21 01:16:27.271903 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 526/1030] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:27 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:27.843412 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8532d5e3-d302-422f-9547-0c0a33f0f8f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:27.844054 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8532d5e3-d302-422f-9547-0c0a33f0f8f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:27.850156 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8532d5e3-d302-422f-9547-0c0a33f0f8f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:27.850600 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8532d5e3-d302-422f-9547-0c0a33f0f8f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:27.851369 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8532d5e3-d302-422f-9547-0c0a33f0f8f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:27.851800 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8532d5e3-d302-422f-9547-0c0a33f0f8f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:27.984710 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8f1de0fd-ee42-4f5f-af2b-f15952e6b712 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:27.984872 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8532d5e3-d302-422f-9547-0c0a33f0f8f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:27.985963 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8f1de0fd-ee42-4f5f-af2b-f15952e6b712 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:27.991880 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8f1de0fd-ee42-4f5f-af2b-f15952e6b712 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:27.992353 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8f1de0fd-ee42-4f5f-af2b-f15952e6b712 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:27.993138 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8f1de0fd-ee42-4f5f-af2b-f15952e6b712 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:27.993566 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8f1de0fd-ee42-4f5f-af2b-f15952e6b712 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:27.994924 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8532d5e3-d302-422f-9547-0c0a33f0f8f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:27.996511 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8532d5e3-d302-422f-9547-0c0a33f0f8f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:27.997706 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8532d5e3-d302-422f-9547-0c0a33f0f8f1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158160 Feb 21 01:16:27.999086 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 505/1031] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:27 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:28.022787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8f1de0fd-ee42-4f5f-af2b-f15952e6b712 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041774 Feb 21 01:16:28.023333 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 527/1032] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:27 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:16:28.288230 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6e51fd46-24e9-415f-93de-1e58ccd3224b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:28.288937 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6e51fd46-24e9-415f-93de-1e58ccd3224b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:28.294961 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6e51fd46-24e9-415f-93de-1e58ccd3224b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:28.295410 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6e51fd46-24e9-415f-93de-1e58ccd3224b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:28.296289 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6e51fd46-24e9-415f-93de-1e58ccd3224b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:28.296849 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6e51fd46-24e9-415f-93de-1e58ccd3224b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:28.357515 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6e51fd46-24e9-415f-93de-1e58ccd3224b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:28.364924 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6e51fd46-24e9-415f-93de-1e58ccd3224b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080460 Feb 21 01:16:28.365515 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 506/1033] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:28 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:29.016319 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e7ab7724-59f6-42a6-866e-8160edd1e5a1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:29.016926 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e7ab7724-59f6-42a6-866e-8160edd1e5a1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:29.023857 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7ab7724-59f6-42a6-866e-8160edd1e5a1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:29.024329 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7ab7724-59f6-42a6-866e-8160edd1e5a1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:29.025141 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7ab7724-59f6-42a6-866e-8160edd1e5a1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:29.025549 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7ab7724-59f6-42a6-866e-8160edd1e5a1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:29.034209 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a29590e0-0eb1-4b80-abeb-7c962de46050 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:29.035119 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a29590e0-0eb1-4b80-abeb-7c962de46050 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:29.041405 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a29590e0-0eb1-4b80-abeb-7c962de46050 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:29.041854 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a29590e0-0eb1-4b80-abeb-7c962de46050 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:29.042635 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a29590e0-0eb1-4b80-abeb-7c962de46050 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:29.043064 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a29590e0-0eb1-4b80-abeb-7c962de46050 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:29.072720 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a29590e0-0eb1-4b80-abeb-7c962de46050 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042127 Feb 21 01:16:29.073303 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 507/1034] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:29 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:16:29.160258 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e7ab7724-59f6-42a6-866e-8160edd1e5a1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:29.169089 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e7ab7724-59f6-42a6-866e-8160edd1e5a1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:29.170579 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e7ab7724-59f6-42a6-866e-8160edd1e5a1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:29.171732 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e7ab7724-59f6-42a6-866e-8160edd1e5a1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159113 Feb 21 01:16:29.172632 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 528/1035] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:29 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:29.382629 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d26f59be-5e8a-42ce-83ae-ce1e3d3a95f1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:29.383237 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d26f59be-5e8a-42ce-83ae-ce1e3d3a95f1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:29.389039 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d26f59be-5e8a-42ce-83ae-ce1e3d3a95f1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:29.389481 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d26f59be-5e8a-42ce-83ae-ce1e3d3a95f1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:29.390255 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d26f59be-5e8a-42ce-83ae-ce1e3d3a95f1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:29.390679 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d26f59be-5e8a-42ce-83ae-ce1e3d3a95f1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:29.454921 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d26f59be-5e8a-42ce-83ae-ce1e3d3a95f1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:29.460960 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d26f59be-5e8a-42ce-83ae-ce1e3d3a95f1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082796 Feb 21 01:16:29.461512 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 508/1036] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:29 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:30.084710 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8ff13399-b84e-42c6-b835-3ec89192ee23 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:30.085624 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8ff13399-b84e-42c6-b835-3ec89192ee23 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:30.091857 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8ff13399-b84e-42c6-b835-3ec89192ee23 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:30.092323 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8ff13399-b84e-42c6-b835-3ec89192ee23 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:30.093150 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8ff13399-b84e-42c6-b835-3ec89192ee23 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:30.093590 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8ff13399-b84e-42c6-b835-3ec89192ee23 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:30.123322 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8ff13399-b84e-42c6-b835-3ec89192ee23 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043109 Feb 21 01:16:30.123908 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 529/1037] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:30 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:30.189844 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-54d499f3-c7bf-4daa-83b4-472cbe4a2369 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:30.190432 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-54d499f3-c7bf-4daa-83b4-472cbe4a2369 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:30.197307 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-54d499f3-c7bf-4daa-83b4-472cbe4a2369 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:30.197748 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-54d499f3-c7bf-4daa-83b4-472cbe4a2369 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:30.198528 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-54d499f3-c7bf-4daa-83b4-472cbe4a2369 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:30.198982 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-54d499f3-c7bf-4daa-83b4-472cbe4a2369 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:30.331375 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-54d499f3-c7bf-4daa-83b4-472cbe4a2369 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:30.339923 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-54d499f3-c7bf-4daa-83b4-472cbe4a2369 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:30.341230 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-54d499f3-c7bf-4daa-83b4-472cbe4a2369 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:30.342381 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-54d499f3-c7bf-4daa-83b4-472cbe4a2369 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156231 Feb 21 01:16:30.342976 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 509/1038] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:30 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:30.477633 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5d07d212-bf6b-4b5e-8447-87d3b5680831 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:30.478263 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5d07d212-bf6b-4b5e-8447-87d3b5680831 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:30.484436 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5d07d212-bf6b-4b5e-8447-87d3b5680831 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:30.484885 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5d07d212-bf6b-4b5e-8447-87d3b5680831 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:30.485660 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5d07d212-bf6b-4b5e-8447-87d3b5680831 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:30.486092 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5d07d212-bf6b-4b5e-8447-87d3b5680831 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:30.547160 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5d07d212-bf6b-4b5e-8447-87d3b5680831 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:30.555522 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5d07d212-bf6b-4b5e-8447-87d3b5680831 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081516 Feb 21 01:16:30.556119 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 530/1039] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:30 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:31.135242 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4279f714-2363-407c-a9ba-3b84f287c030 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:31.136259 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4279f714-2363-407c-a9ba-3b84f287c030 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:31.142010 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4279f714-2363-407c-a9ba-3b84f287c030 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:31.142444 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4279f714-2363-407c-a9ba-3b84f287c030 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:31.143211 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4279f714-2363-407c-a9ba-3b84f287c030 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:31.143649 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4279f714-2363-407c-a9ba-3b84f287c030 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:31.175132 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4279f714-2363-407c-a9ba-3b84f287c030 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043628 Feb 21 01:16:31.175677 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 510/1040] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:31 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:31.361235 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-cc36d576-8ca9-4394-8ee6-e7c11e40256e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:31.361850 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-cc36d576-8ca9-4394-8ee6-e7c11e40256e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:31.370107 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cc36d576-8ca9-4394-8ee6-e7c11e40256e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:31.370562 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cc36d576-8ca9-4394-8ee6-e7c11e40256e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:31.371653 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cc36d576-8ca9-4394-8ee6-e7c11e40256e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:31.372109 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cc36d576-8ca9-4394-8ee6-e7c11e40256e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:31.520897 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-cc36d576-8ca9-4394-8ee6-e7c11e40256e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:31.530973 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-cc36d576-8ca9-4394-8ee6-e7c11e40256e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:31.532546 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-cc36d576-8ca9-4394-8ee6-e7c11e40256e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:31.533768 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-cc36d576-8ca9-4394-8ee6-e7c11e40256e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.176564 Feb 21 01:16:31.534323 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 531/1041] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:31 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:31.572650 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-68c18897-2bcd-4810-b0ea-dfa6a0db2298 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:31.573306 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-68c18897-2bcd-4810-b0ea-dfa6a0db2298 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:31.580159 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68c18897-2bcd-4810-b0ea-dfa6a0db2298 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:31.580612 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68c18897-2bcd-4810-b0ea-dfa6a0db2298 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:31.581407 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68c18897-2bcd-4810-b0ea-dfa6a0db2298 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:31.581843 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68c18897-2bcd-4810-b0ea-dfa6a0db2298 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:31.651192 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-68c18897-2bcd-4810-b0ea-dfa6a0db2298 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:31.659025 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-68c18897-2bcd-4810-b0ea-dfa6a0db2298 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.090036 Feb 21 01:16:31.659585 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 511/1042] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:31 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:32.186539 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8053488a-647d-487b-a8f6-9ef4429d75ac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:32.187466 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8053488a-647d-487b-a8f6-9ef4429d75ac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:32.193719 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8053488a-647d-487b-a8f6-9ef4429d75ac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:32.194174 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8053488a-647d-487b-a8f6-9ef4429d75ac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:32.194987 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8053488a-647d-487b-a8f6-9ef4429d75ac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:32.195425 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8053488a-647d-487b-a8f6-9ef4429d75ac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:32.240091 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8053488a-647d-487b-a8f6-9ef4429d75ac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057309 Feb 21 01:16:32.240726 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 532/1043] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:32 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:32.557499 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f1e61c48-cc34-44b9-bab1-338b57806de1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:32.558109 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f1e61c48-cc34-44b9-bab1-338b57806de1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:32.563954 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f1e61c48-cc34-44b9-bab1-338b57806de1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:32.564400 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f1e61c48-cc34-44b9-bab1-338b57806de1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:32.565176 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f1e61c48-cc34-44b9-bab1-338b57806de1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:32.565606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f1e61c48-cc34-44b9-bab1-338b57806de1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:32.675488 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8379f08e-542d-48dd-bd2d-ce672377ca70 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:32.676230 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8379f08e-542d-48dd-bd2d-ce672377ca70 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:32.682677 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8379f08e-542d-48dd-bd2d-ce672377ca70 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:32.683208 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8379f08e-542d-48dd-bd2d-ce672377ca70 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:32.684106 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8379f08e-542d-48dd-bd2d-ce672377ca70 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:32.684614 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8379f08e-542d-48dd-bd2d-ce672377ca70 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:32.701835 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f1e61c48-cc34-44b9-bab1-338b57806de1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:32.710515 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f1e61c48-cc34-44b9-bab1-338b57806de1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:32.712017 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f1e61c48-cc34-44b9-bab1-338b57806de1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:32.713164 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f1e61c48-cc34-44b9-bab1-338b57806de1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159478 Feb 21 01:16:32.713741 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 512/1044] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:32 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:32.746760 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8379f08e-542d-48dd-bd2d-ce672377ca70 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:32.759435 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8379f08e-542d-48dd-bd2d-ce672377ca70 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.087491 Feb 21 01:16:32.760040 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 533/1045] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:32 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:16:33.251572 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-16666db9-1e4d-4595-b72e-d9a5eda6a6cf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:33.252528 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-16666db9-1e4d-4595-b72e-d9a5eda6a6cf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:33.259424 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-16666db9-1e4d-4595-b72e-d9a5eda6a6cf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:33.259906 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-16666db9-1e4d-4595-b72e-d9a5eda6a6cf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:33.260694 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-16666db9-1e4d-4595-b72e-d9a5eda6a6cf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:33.261134 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-16666db9-1e4d-4595-b72e-d9a5eda6a6cf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:33.291437 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-16666db9-1e4d-4595-b72e-d9a5eda6a6cf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043681 Feb 21 01:16:33.292031 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 513/1046] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:33 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:33.731083 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-58b512a5-9a79-4db0-8c41-abcd1ed91d4e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:33.731744 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-58b512a5-9a79-4db0-8c41-abcd1ed91d4e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:33.738015 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-58b512a5-9a79-4db0-8c41-abcd1ed91d4e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:33.739078 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-58b512a5-9a79-4db0-8c41-abcd1ed91d4e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:33.740057 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-58b512a5-9a79-4db0-8c41-abcd1ed91d4e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:33.740510 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-58b512a5-9a79-4db0-8c41-abcd1ed91d4e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:33.775611 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4eb32f1d-50e0-4b5a-8408-4bb6cbf3f799 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:33.776246 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4eb32f1d-50e0-4b5a-8408-4bb6cbf3f799 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:33.782759 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4eb32f1d-50e0-4b5a-8408-4bb6cbf3f799 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:33.783196 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4eb32f1d-50e0-4b5a-8408-4bb6cbf3f799 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:33.784008 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4eb32f1d-50e0-4b5a-8408-4bb6cbf3f799 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:33.784437 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4eb32f1d-50e0-4b5a-8408-4bb6cbf3f799 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:33.844638 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4eb32f1d-50e0-4b5a-8408-4bb6cbf3f799 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:33.852859 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4eb32f1d-50e0-4b5a-8408-4bb6cbf3f799 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080748 Feb 21 01:16:33.853480 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 514/1047] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:33 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:16:33.873034 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-58b512a5-9a79-4db0-8c41-abcd1ed91d4e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:33.881728 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-58b512a5-9a79-4db0-8c41-abcd1ed91d4e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:33.883197 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-58b512a5-9a79-4db0-8c41-abcd1ed91d4e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:33.884361 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-58b512a5-9a79-4db0-8c41-abcd1ed91d4e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156959 Feb 21 01:16:33.884905 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 534/1048] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:33 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:34.303666 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f4a60811-8e39-4f76-bfc2-8110ae66013a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:34.305751 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f4a60811-8e39-4f76-bfc2-8110ae66013a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:34.310979 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f4a60811-8e39-4f76-bfc2-8110ae66013a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:34.311430 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f4a60811-8e39-4f76-bfc2-8110ae66013a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:34.312248 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f4a60811-8e39-4f76-bfc2-8110ae66013a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:34.312687 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f4a60811-8e39-4f76-bfc2-8110ae66013a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:34.340882 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f4a60811-8e39-4f76-bfc2-8110ae66013a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041886 Feb 21 01:16:34.341424 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 515/1049] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:34 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:34.869509 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-680fb66f-9e95-4f9e-b0b7-074eab277637 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:34.870125 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-680fb66f-9e95-4f9e-b0b7-074eab277637 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:34.876881 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-680fb66f-9e95-4f9e-b0b7-074eab277637 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:34.879929 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-680fb66f-9e95-4f9e-b0b7-074eab277637 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:34.879929 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-680fb66f-9e95-4f9e-b0b7-074eab277637 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:34.879929 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-680fb66f-9e95-4f9e-b0b7-074eab277637 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:34.902729 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4e470bfd-3ef9-40e2-bcc9-179fdd78a605 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:34.903435 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4e470bfd-3ef9-40e2-bcc9-179fdd78a605 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:34.910067 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4e470bfd-3ef9-40e2-bcc9-179fdd78a605 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:34.911049 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4e470bfd-3ef9-40e2-bcc9-179fdd78a605 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:34.912090 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4e470bfd-3ef9-40e2-bcc9-179fdd78a605 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:34.912560 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4e470bfd-3ef9-40e2-bcc9-179fdd78a605 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:34.941139 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-680fb66f-9e95-4f9e-b0b7-074eab277637 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:34.950109 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-680fb66f-9e95-4f9e-b0b7-074eab277637 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084253 Feb 21 01:16:34.950894 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 535/1050] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:34 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:35.051367 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4e470bfd-3ef9-40e2-bcc9-179fdd78a605 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:35.061754 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4e470bfd-3ef9-40e2-bcc9-179fdd78a605 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:35.063263 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4e470bfd-3ef9-40e2-bcc9-179fdd78a605 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:35.064537 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4e470bfd-3ef9-40e2-bcc9-179fdd78a605 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.165607 Feb 21 01:16:35.065108 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 516/1051] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:34 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:16:35.352373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-093bd40d-365f-4416-8bd0-5583046f44bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:35.353534 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-093bd40d-365f-4416-8bd0-5583046f44bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:35.359933 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-093bd40d-365f-4416-8bd0-5583046f44bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:35.360386 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-093bd40d-365f-4416-8bd0-5583046f44bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:35.361162 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-093bd40d-365f-4416-8bd0-5583046f44bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:35.361588 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-093bd40d-365f-4416-8bd0-5583046f44bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:35.393075 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-093bd40d-365f-4416-8bd0-5583046f44bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044657 Feb 21 01:16:35.393618 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 536/1052] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:35 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:35.967942 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-be4e6220-bad1-44f4-b7c0-c70bbda5da81 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:35.968587 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-be4e6220-bad1-44f4-b7c0-c70bbda5da81 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:35.975979 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-be4e6220-bad1-44f4-b7c0-c70bbda5da81 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:35.976435 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-be4e6220-bad1-44f4-b7c0-c70bbda5da81 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:35.977223 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-be4e6220-bad1-44f4-b7c0-c70bbda5da81 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:35.977660 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-be4e6220-bad1-44f4-b7c0-c70bbda5da81 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:36.039624 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-be4e6220-bad1-44f4-b7c0-c70bbda5da81 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:36.047559 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-be4e6220-bad1-44f4-b7c0-c70bbda5da81 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083496 Feb 21 01:16:36.048162 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 517/1053] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:35 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:36.090941 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-751506ed-9bda-4bde-bab1-a6e5e692f6a2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:36.091544 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-751506ed-9bda-4bde-bab1-a6e5e692f6a2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:36.097880 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-751506ed-9bda-4bde-bab1-a6e5e692f6a2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:36.098426 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-751506ed-9bda-4bde-bab1-a6e5e692f6a2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:36.099210 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-751506ed-9bda-4bde-bab1-a6e5e692f6a2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:36.099635 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-751506ed-9bda-4bde-bab1-a6e5e692f6a2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:36.236485 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-751506ed-9bda-4bde-bab1-a6e5e692f6a2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:36.245398 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-751506ed-9bda-4bde-bab1-a6e5e692f6a2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:36.246933 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-751506ed-9bda-4bde-bab1-a6e5e692f6a2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:36.248113 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-751506ed-9bda-4bde-bab1-a6e5e692f6a2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160828 Feb 21 01:16:36.248675 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 537/1054] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:36 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:36.405312 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1724396f-0caa-4e56-9f1d-5a6e3bddf297 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:36.406218 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1724396f-0caa-4e56-9f1d-5a6e3bddf297 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:36.413055 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1724396f-0caa-4e56-9f1d-5a6e3bddf297 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:36.413513 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1724396f-0caa-4e56-9f1d-5a6e3bddf297 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:36.414275 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1724396f-0caa-4e56-9f1d-5a6e3bddf297 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:36.414698 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1724396f-0caa-4e56-9f1d-5a6e3bddf297 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:36.443585 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1724396f-0caa-4e56-9f1d-5a6e3bddf297 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042172 Feb 21 01:16:36.444075 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 518/1055] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:36 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:37.070734 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-17f9424b-61c8-404e-a0a4-1b9932721d90 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:37.071355 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-17f9424b-61c8-404e-a0a4-1b9932721d90 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:37.077486 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-17f9424b-61c8-404e-a0a4-1b9932721d90 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:37.077930 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-17f9424b-61c8-404e-a0a4-1b9932721d90 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:37.078716 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-17f9424b-61c8-404e-a0a4-1b9932721d90 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:37.079140 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-17f9424b-61c8-404e-a0a4-1b9932721d90 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:37.138926 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-17f9424b-61c8-404e-a0a4-1b9932721d90 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:37.146882 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-17f9424b-61c8-404e-a0a4-1b9932721d90 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.085119 Feb 21 01:16:37.147440 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 538/1056] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:37 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:37.266320 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8c9ef331-5c88-4976-92eb-b3107b07e0a7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:37.266907 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8c9ef331-5c88-4976-92eb-b3107b07e0a7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:37.274272 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8c9ef331-5c88-4976-92eb-b3107b07e0a7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:37.274721 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8c9ef331-5c88-4976-92eb-b3107b07e0a7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:37.275498 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8c9ef331-5c88-4976-92eb-b3107b07e0a7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:37.275962 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8c9ef331-5c88-4976-92eb-b3107b07e0a7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:37.412200 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8c9ef331-5c88-4976-92eb-b3107b07e0a7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:37.420382 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8c9ef331-5c88-4976-92eb-b3107b07e0a7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:37.421861 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8c9ef331-5c88-4976-92eb-b3107b07e0a7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:37.422999 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8c9ef331-5c88-4976-92eb-b3107b07e0a7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160446 Feb 21 01:16:37.423536 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 519/1057] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:37 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:37.454557 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6de09def-c94e-4f58-b63a-55e616ef9bea tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:37.455510 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6de09def-c94e-4f58-b63a-55e616ef9bea tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:37.462531 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6de09def-c94e-4f58-b63a-55e616ef9bea tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:37.462951 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6de09def-c94e-4f58-b63a-55e616ef9bea tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:37.463769 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6de09def-c94e-4f58-b63a-55e616ef9bea tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:37.464229 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6de09def-c94e-4f58-b63a-55e616ef9bea tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:37.492928 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6de09def-c94e-4f58-b63a-55e616ef9bea tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042225 Feb 21 01:16:37.493481 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 539/1058] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:37 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:38.163471 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-673cbb6f-6d2a-4755-9e90-db60cc5147e1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:38.164105 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-673cbb6f-6d2a-4755-9e90-db60cc5147e1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:38.169951 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-673cbb6f-6d2a-4755-9e90-db60cc5147e1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:38.170394 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-673cbb6f-6d2a-4755-9e90-db60cc5147e1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:38.171173 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-673cbb6f-6d2a-4755-9e90-db60cc5147e1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:38.171601 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-673cbb6f-6d2a-4755-9e90-db60cc5147e1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:38.230403 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-673cbb6f-6d2a-4755-9e90-db60cc5147e1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:38.237643 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-673cbb6f-6d2a-4755-9e90-db60cc5147e1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.077907 Feb 21 01:16:38.238777 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 520/1059] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:38 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:38.443519 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e09dd036-f11d-42eb-a2d6-187449561fce tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:38.444078 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e09dd036-f11d-42eb-a2d6-187449561fce tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:38.451245 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e09dd036-f11d-42eb-a2d6-187449561fce tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:38.451688 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e09dd036-f11d-42eb-a2d6-187449561fce tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:38.452510 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e09dd036-f11d-42eb-a2d6-187449561fce tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:38.452942 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e09dd036-f11d-42eb-a2d6-187449561fce tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:38.505494 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-22cb2fdb-6383-4866-a527-6e9b6bc68cc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:38.506450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-22cb2fdb-6383-4866-a527-6e9b6bc68cc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:38.512884 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-22cb2fdb-6383-4866-a527-6e9b6bc68cc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:38.513337 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-22cb2fdb-6383-4866-a527-6e9b6bc68cc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:38.514137 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-22cb2fdb-6383-4866-a527-6e9b6bc68cc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:38.514646 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-22cb2fdb-6383-4866-a527-6e9b6bc68cc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:38.548281 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-22cb2fdb-6383-4866-a527-6e9b6bc68cc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047482 Feb 21 01:16:38.548877 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 521/1060] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:38 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:16:38.594677 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e09dd036-f11d-42eb-a2d6-187449561fce tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:38.606009 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e09dd036-f11d-42eb-a2d6-187449561fce tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:38.607490 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e09dd036-f11d-42eb-a2d6-187449561fce tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:38.608680 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e09dd036-f11d-42eb-a2d6-187449561fce tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.171189 Feb 21 01:16:38.609235 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 540/1061] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:38 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:39.254317 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e342f48c-b020-4e91-bed5-0ba0c5a44894 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:39.254965 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e342f48c-b020-4e91-bed5-0ba0c5a44894 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:39.261539 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e342f48c-b020-4e91-bed5-0ba0c5a44894 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:39.261988 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e342f48c-b020-4e91-bed5-0ba0c5a44894 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:39.262772 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e342f48c-b020-4e91-bed5-0ba0c5a44894 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:39.263208 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e342f48c-b020-4e91-bed5-0ba0c5a44894 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:39.324559 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e342f48c-b020-4e91-bed5-0ba0c5a44894 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:39.331797 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e342f48c-b020-4e91-bed5-0ba0c5a44894 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081189 Feb 21 01:16:39.332521 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 522/1062] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:39 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:39.559557 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-24bc675f-548d-49fa-be55-2090c0e175c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:39.560497 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-24bc675f-548d-49fa-be55-2090c0e175c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:39.566709 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-24bc675f-548d-49fa-be55-2090c0e175c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:39.567187 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-24bc675f-548d-49fa-be55-2090c0e175c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:39.568000 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-24bc675f-548d-49fa-be55-2090c0e175c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:39.568436 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-24bc675f-548d-49fa-be55-2090c0e175c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:39.596636 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-24bc675f-548d-49fa-be55-2090c0e175c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040706 Feb 21 01:16:39.597108 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 541/1063] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:39 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:39.626729 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3ad8249d-95e3-4fe5-8fec-330f5e9570b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:39.627336 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3ad8249d-95e3-4fe5-8fec-330f5e9570b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:39.633622 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3ad8249d-95e3-4fe5-8fec-330f5e9570b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:39.634066 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3ad8249d-95e3-4fe5-8fec-330f5e9570b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:39.634840 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3ad8249d-95e3-4fe5-8fec-330f5e9570b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:39.635304 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3ad8249d-95e3-4fe5-8fec-330f5e9570b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:39.770618 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3ad8249d-95e3-4fe5-8fec-330f5e9570b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:39.778834 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3ad8249d-95e3-4fe5-8fec-330f5e9570b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:39.780655 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3ad8249d-95e3-4fe5-8fec-330f5e9570b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:39.781816 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3ad8249d-95e3-4fe5-8fec-330f5e9570b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158820 Feb 21 01:16:39.782368 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 523/1064] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:39 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:40.348404 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a3d59477-90c7-45ca-9e18-8eabffdaa396 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:40.349011 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a3d59477-90c7-45ca-9e18-8eabffdaa396 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:40.356239 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a3d59477-90c7-45ca-9e18-8eabffdaa396 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:40.357280 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a3d59477-90c7-45ca-9e18-8eabffdaa396 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:40.357478 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a3d59477-90c7-45ca-9e18-8eabffdaa396 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:40.358224 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a3d59477-90c7-45ca-9e18-8eabffdaa396 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:40.421611 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a3d59477-90c7-45ca-9e18-8eabffdaa396 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:40.429007 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a3d59477-90c7-45ca-9e18-8eabffdaa396 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084339 Feb 21 01:16:40.429556 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 542/1065] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:40 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:40.609835 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8b8e661e-ea49-472b-9b5b-f4736901a184 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:40.610673 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8b8e661e-ea49-472b-9b5b-f4736901a184 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:40.617319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8b8e661e-ea49-472b-9b5b-f4736901a184 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:40.617776 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8b8e661e-ea49-472b-9b5b-f4736901a184 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:40.618626 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8b8e661e-ea49-472b-9b5b-f4736901a184 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:40.619068 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8b8e661e-ea49-472b-9b5b-f4736901a184 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:40.649395 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8b8e661e-ea49-472b-9b5b-f4736901a184 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043403 Feb 21 01:16:40.650077 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 524/1066] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:40 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:16:40.801653 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4d35139c-3d95-46a7-90ee-53ab3ca85e07 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:40.802297 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4d35139c-3d95-46a7-90ee-53ab3ca85e07 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:40.808553 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4d35139c-3d95-46a7-90ee-53ab3ca85e07 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:40.808997 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4d35139c-3d95-46a7-90ee-53ab3ca85e07 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:40.809772 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4d35139c-3d95-46a7-90ee-53ab3ca85e07 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:40.810200 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4d35139c-3d95-46a7-90ee-53ab3ca85e07 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:40.942781 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4d35139c-3d95-46a7-90ee-53ab3ca85e07 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:40.950857 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4d35139c-3d95-46a7-90ee-53ab3ca85e07 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:40.952371 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4d35139c-3d95-46a7-90ee-53ab3ca85e07 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:40.953542 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4d35139c-3d95-46a7-90ee-53ab3ca85e07 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156137 Feb 21 01:16:40.954101 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 543/1067] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:40 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:41.445790 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0199d68d-c424-496a-ad8a-6e12216e2b5f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:41.446402 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0199d68d-c424-496a-ad8a-6e12216e2b5f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:41.452227 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0199d68d-c424-496a-ad8a-6e12216e2b5f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:41.452676 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0199d68d-c424-496a-ad8a-6e12216e2b5f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:41.453487 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0199d68d-c424-496a-ad8a-6e12216e2b5f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:41.453922 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0199d68d-c424-496a-ad8a-6e12216e2b5f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:41.513725 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0199d68d-c424-496a-ad8a-6e12216e2b5f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:41.521533 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0199d68d-c424-496a-ad8a-6e12216e2b5f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079796 Feb 21 01:16:41.522090 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 525/1068] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:41 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:41.661084 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a17bd9a0-0775-4e02-93f1-273cebfd6a2f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:41.661911 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a17bd9a0-0775-4e02-93f1-273cebfd6a2f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:41.667883 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a17bd9a0-0775-4e02-93f1-273cebfd6a2f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:41.668334 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a17bd9a0-0775-4e02-93f1-273cebfd6a2f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:41.669119 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a17bd9a0-0775-4e02-93f1-273cebfd6a2f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:41.669551 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a17bd9a0-0775-4e02-93f1-273cebfd6a2f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:41.698775 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a17bd9a0-0775-4e02-93f1-273cebfd6a2f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041582 Feb 21 01:16:41.699330 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 544/1069] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:41 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:41.971402 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-339ddcc4-771c-47ee-b398-06950de8c5b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:41.972030 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-339ddcc4-771c-47ee-b398-06950de8c5b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:41.978194 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-339ddcc4-771c-47ee-b398-06950de8c5b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:41.978633 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-339ddcc4-771c-47ee-b398-06950de8c5b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:41.979412 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-339ddcc4-771c-47ee-b398-06950de8c5b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:41.979850 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-339ddcc4-771c-47ee-b398-06950de8c5b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:42.110788 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-339ddcc4-771c-47ee-b398-06950de8c5b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:42.119602 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-339ddcc4-771c-47ee-b398-06950de8c5b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:42.121136 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-339ddcc4-771c-47ee-b398-06950de8c5b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:42.122302 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-339ddcc4-771c-47ee-b398-06950de8c5b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.154591 Feb 21 01:16:42.122855 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 526/1070] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:41 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:42.538579 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3da77ce6-7d17-40ac-a20c-353d1f2585ea tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:42.539228 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3da77ce6-7d17-40ac-a20c-353d1f2585ea tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:42.545419 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3da77ce6-7d17-40ac-a20c-353d1f2585ea tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:42.545882 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3da77ce6-7d17-40ac-a20c-353d1f2585ea tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:42.546622 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3da77ce6-7d17-40ac-a20c-353d1f2585ea tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:42.547044 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3da77ce6-7d17-40ac-a20c-353d1f2585ea tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:42.606195 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3da77ce6-7d17-40ac-a20c-353d1f2585ea tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:42.614035 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3da77ce6-7d17-40ac-a20c-353d1f2585ea tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.078856 Feb 21 01:16:42.614527 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 545/1071] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:42 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:42.710964 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-52501879-fbfc-4658-9a13-ea8efeb8a4f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:42.711924 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-52501879-fbfc-4658-9a13-ea8efeb8a4f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:42.717667 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-52501879-fbfc-4658-9a13-ea8efeb8a4f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:42.718105 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-52501879-fbfc-4658-9a13-ea8efeb8a4f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:42.718869 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-52501879-fbfc-4658-9a13-ea8efeb8a4f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:42.719295 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-52501879-fbfc-4658-9a13-ea8efeb8a4f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:42.747660 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-52501879-fbfc-4658-9a13-ea8efeb8a4f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041130 Feb 21 01:16:42.748229 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 527/1072] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:42 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:43.141016 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a12c861e-feec-401a-85e3-38be8b2361e7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:43.141621 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a12c861e-feec-401a-85e3-38be8b2361e7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:43.148526 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a12c861e-feec-401a-85e3-38be8b2361e7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:43.148975 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a12c861e-feec-401a-85e3-38be8b2361e7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:43.149755 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a12c861e-feec-401a-85e3-38be8b2361e7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:43.150187 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a12c861e-feec-401a-85e3-38be8b2361e7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:43.283347 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a12c861e-feec-401a-85e3-38be8b2361e7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:43.291746 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a12c861e-feec-401a-85e3-38be8b2361e7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:43.293276 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a12c861e-feec-401a-85e3-38be8b2361e7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:43.294420 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a12c861e-feec-401a-85e3-38be8b2361e7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157185 Feb 21 01:16:43.294973 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 546/1073] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:43 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:43.631003 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-31f5c2a5-858f-4876-aa0f-65cab7ec2b4d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:43.631588 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-31f5c2a5-858f-4876-aa0f-65cab7ec2b4d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:43.637849 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31f5c2a5-858f-4876-aa0f-65cab7ec2b4d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:43.638296 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31f5c2a5-858f-4876-aa0f-65cab7ec2b4d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:43.639109 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31f5c2a5-858f-4876-aa0f-65cab7ec2b4d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:43.639562 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31f5c2a5-858f-4876-aa0f-65cab7ec2b4d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:43.702288 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-31f5c2a5-858f-4876-aa0f-65cab7ec2b4d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:43.709686 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-31f5c2a5-858f-4876-aa0f-65cab7ec2b4d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083138 Feb 21 01:16:43.710236 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 528/1074] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:43 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:43.758821 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-82c57fce-18b4-474d-8534-794d83f06cbe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:43.759885 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-82c57fce-18b4-474d-8534-794d83f06cbe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:43.766189 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-82c57fce-18b4-474d-8534-794d83f06cbe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:43.766642 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-82c57fce-18b4-474d-8534-794d83f06cbe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:43.767423 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-82c57fce-18b4-474d-8534-794d83f06cbe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:43.767909 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-82c57fce-18b4-474d-8534-794d83f06cbe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:43.796886 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-82c57fce-18b4-474d-8534-794d83f06cbe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041766 Feb 21 01:16:43.797443 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 547/1075] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:43 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:44.312345 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8ce81ee5-4725-4e88-af8d-d0d8703ff472 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:44.312948 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8ce81ee5-4725-4e88-af8d-d0d8703ff472 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:44.319445 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8ce81ee5-4725-4e88-af8d-d0d8703ff472 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:44.319920 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8ce81ee5-4725-4e88-af8d-d0d8703ff472 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:44.320703 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8ce81ee5-4725-4e88-af8d-d0d8703ff472 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:44.321140 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8ce81ee5-4725-4e88-af8d-d0d8703ff472 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:44.454094 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8ce81ee5-4725-4e88-af8d-d0d8703ff472 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:44.462848 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8ce81ee5-4725-4e88-af8d-d0d8703ff472 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:44.464342 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8ce81ee5-4725-4e88-af8d-d0d8703ff472 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:44.465502 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8ce81ee5-4725-4e88-af8d-d0d8703ff472 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156911 Feb 21 01:16:44.466028 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 529/1076] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:44 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:44.726497 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-462a25a3-1b35-4b4f-9d96-ada0daf85994 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:44.727110 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-462a25a3-1b35-4b4f-9d96-ada0daf85994 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:44.733076 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-462a25a3-1b35-4b4f-9d96-ada0daf85994 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:44.733527 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-462a25a3-1b35-4b4f-9d96-ada0daf85994 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:44.734306 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-462a25a3-1b35-4b4f-9d96-ada0daf85994 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:44.734742 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-462a25a3-1b35-4b4f-9d96-ada0daf85994 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:44.795212 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-462a25a3-1b35-4b4f-9d96-ada0daf85994 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:44.802631 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-462a25a3-1b35-4b4f-9d96-ada0daf85994 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080102 Feb 21 01:16:44.803183 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 548/1077] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:44 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:44.808666 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c3eec0bd-e8e8-49d6-9069-0ba55cdb9fbd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:44.809594 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c3eec0bd-e8e8-49d6-9069-0ba55cdb9fbd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:44.815746 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c3eec0bd-e8e8-49d6-9069-0ba55cdb9fbd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:44.816926 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c3eec0bd-e8e8-49d6-9069-0ba55cdb9fbd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:44.817719 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c3eec0bd-e8e8-49d6-9069-0ba55cdb9fbd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:44.818153 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c3eec0bd-e8e8-49d6-9069-0ba55cdb9fbd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:44.847484 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c3eec0bd-e8e8-49d6-9069-0ba55cdb9fbd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042419 Feb 21 01:16:44.848093 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 530/1078] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:44 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:45.484410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a673486c-cf91-4d15-a4b9-90a57241803f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:45.485020 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a673486c-cf91-4d15-a4b9-90a57241803f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:45.491614 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a673486c-cf91-4d15-a4b9-90a57241803f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:45.492081 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a673486c-cf91-4d15-a4b9-90a57241803f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:45.492940 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a673486c-cf91-4d15-a4b9-90a57241803f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:45.493373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a673486c-cf91-4d15-a4b9-90a57241803f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:45.624820 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a673486c-cf91-4d15-a4b9-90a57241803f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:45.632695 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a673486c-cf91-4d15-a4b9-90a57241803f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:45.634178 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a673486c-cf91-4d15-a4b9-90a57241803f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:45.635333 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a673486c-cf91-4d15-a4b9-90a57241803f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.154656 Feb 21 01:16:45.635906 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 549/1079] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:45 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:45.818982 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3b4b166d-5b4a-4126-a3f9-2675b983a77c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:45.819659 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3b4b166d-5b4a-4126-a3f9-2675b983a77c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:45.825826 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3b4b166d-5b4a-4126-a3f9-2675b983a77c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:45.826268 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3b4b166d-5b4a-4126-a3f9-2675b983a77c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:45.827033 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3b4b166d-5b4a-4126-a3f9-2675b983a77c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:45.827463 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3b4b166d-5b4a-4126-a3f9-2675b983a77c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:45.858621 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-84b43465-0cbf-4eda-ac95-1b1178e2a134 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:45.859649 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-84b43465-0cbf-4eda-ac95-1b1178e2a134 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:45.866522 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84b43465-0cbf-4eda-ac95-1b1178e2a134 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:45.867044 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84b43465-0cbf-4eda-ac95-1b1178e2a134 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:45.867946 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84b43465-0cbf-4eda-ac95-1b1178e2a134 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:45.868382 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84b43465-0cbf-4eda-ac95-1b1178e2a134 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:45.895134 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3b4b166d-5b4a-4126-a3f9-2675b983a77c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:45.897914 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3b4b166d-5b4a-4126-a3f9-2675b983a77c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082722 Feb 21 01:16:45.898489 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 531/1080] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:45 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:45.900124 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-84b43465-0cbf-4eda-ac95-1b1178e2a134 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045082 Feb 21 01:16:45.900681 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 550/1081] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:45 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:16:46.653391 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-31ee639c-836b-424d-a354-6f13894165c9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:46.654160 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-31ee639c-836b-424d-a354-6f13894165c9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:46.660205 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31ee639c-836b-424d-a354-6f13894165c9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:46.660716 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31ee639c-836b-424d-a354-6f13894165c9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:46.661497 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31ee639c-836b-424d-a354-6f13894165c9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:46.661929 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31ee639c-836b-424d-a354-6f13894165c9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:46.794870 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-31ee639c-836b-424d-a354-6f13894165c9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:46.803766 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-31ee639c-836b-424d-a354-6f13894165c9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:46.805296 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-31ee639c-836b-424d-a354-6f13894165c9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:46.806441 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-31ee639c-836b-424d-a354-6f13894165c9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156846 Feb 21 01:16:46.806986 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 532/1082] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:46 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:46.912017 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-56267f35-ecf8-4d4c-b0e1-fa6b27398f66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:46.912771 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-56267f35-ecf8-4d4c-b0e1-fa6b27398f66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:46.914932 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f6d4cb63-7468-4987-9058-60e1cc360b32 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:46.915553 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f6d4cb63-7468-4987-9058-60e1cc360b32 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:46.919496 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-56267f35-ecf8-4d4c-b0e1-fa6b27398f66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:46.919973 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-56267f35-ecf8-4d4c-b0e1-fa6b27398f66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:46.920754 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-56267f35-ecf8-4d4c-b0e1-fa6b27398f66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:46.921181 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-56267f35-ecf8-4d4c-b0e1-fa6b27398f66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:46.921885 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f6d4cb63-7468-4987-9058-60e1cc360b32 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:46.922335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f6d4cb63-7468-4987-9058-60e1cc360b32 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:46.923158 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f6d4cb63-7468-4987-9058-60e1cc360b32 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:46.923594 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f6d4cb63-7468-4987-9058-60e1cc360b32 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:46.952748 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-56267f35-ecf8-4d4c-b0e1-fa6b27398f66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045109 Feb 21 01:16:46.953319 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 551/1083] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:46 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:46.985294 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f6d4cb63-7468-4987-9058-60e1cc360b32 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:46.992740 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f6d4cb63-7468-4987-9058-60e1cc360b32 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081750 Feb 21 01:16:46.993312 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 533/1084] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:46 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:47.825012 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c7595894-fdea-417d-b0c6-07688791acd0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:47.825644 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c7595894-fdea-417d-b0c6-07688791acd0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:47.831641 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c7595894-fdea-417d-b0c6-07688791acd0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:47.832679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c7595894-fdea-417d-b0c6-07688791acd0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:47.833554 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c7595894-fdea-417d-b0c6-07688791acd0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:47.833991 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c7595894-fdea-417d-b0c6-07688791acd0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:47.965274 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-202aa5a3-e4e6-432a-baaa-a4dbff502b84 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:47.966250 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-202aa5a3-e4e6-432a-baaa-a4dbff502b84 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:47.972060 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-202aa5a3-e4e6-432a-baaa-a4dbff502b84 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:47.972542 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-202aa5a3-e4e6-432a-baaa-a4dbff502b84 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:47.973420 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-202aa5a3-e4e6-432a-baaa-a4dbff502b84 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:47.973632 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c7595894-fdea-417d-b0c6-07688791acd0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:47.974079 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-202aa5a3-e4e6-432a-baaa-a4dbff502b84 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:47.981851 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c7595894-fdea-417d-b0c6-07688791acd0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:47.983327 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c7595894-fdea-417d-b0c6-07688791acd0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:47.984496 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c7595894-fdea-417d-b0c6-07688791acd0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.163258 Feb 21 01:16:47.985058 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 552/1085] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:47 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:48.002772 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-202aa5a3-e4e6-432a-baaa-a4dbff502b84 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041385 Feb 21 01:16:48.003343 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 534/1086] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:47 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:16:48.010704 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6e51d6c2-b615-4b30-a523-39f1526197a5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:48.011395 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6e51d6c2-b615-4b30-a523-39f1526197a5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:48.017786 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6e51d6c2-b615-4b30-a523-39f1526197a5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:48.018234 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6e51d6c2-b615-4b30-a523-39f1526197a5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:48.019011 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6e51d6c2-b615-4b30-a523-39f1526197a5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:48.019494 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6e51d6c2-b615-4b30-a523-39f1526197a5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:48.079091 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-6e51d6c2-b615-4b30-a523-39f1526197a5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:48.086474 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6e51d6c2-b615-4b30-a523-39f1526197a5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079566 Feb 21 01:16:48.087033 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 553/1087] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:48 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:49.004427 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-04a23c46-585a-4ce9-be21-9ea99d6dac91 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:49.005058 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-04a23c46-585a-4ce9-be21-9ea99d6dac91 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:49.011727 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-04a23c46-585a-4ce9-be21-9ea99d6dac91 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:49.012209 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-04a23c46-585a-4ce9-be21-9ea99d6dac91 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:49.013000 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-04a23c46-585a-4ce9-be21-9ea99d6dac91 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:49.013433 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-04a23c46-585a-4ce9-be21-9ea99d6dac91 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:49.014411 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-87ce8e89-5d33-44ae-908c-1fb32be77f91 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:49.015320 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-87ce8e89-5d33-44ae-908c-1fb32be77f91 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:49.022196 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-87ce8e89-5d33-44ae-908c-1fb32be77f91 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:49.022634 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-87ce8e89-5d33-44ae-908c-1fb32be77f91 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:49.023413 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-87ce8e89-5d33-44ae-908c-1fb32be77f91 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:49.023853 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-87ce8e89-5d33-44ae-908c-1fb32be77f91 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:49.053554 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-87ce8e89-5d33-44ae-908c-1fb32be77f91 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042870 Feb 21 01:16:49.054159 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 554/1088] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:49 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:16:49.103222 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1646e7e5-4950-476c-bb4c-abf6b164962e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:49.103873 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1646e7e5-4950-476c-bb4c-abf6b164962e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:49.109938 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1646e7e5-4950-476c-bb4c-abf6b164962e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:49.110382 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1646e7e5-4950-476c-bb4c-abf6b164962e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:49.111165 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1646e7e5-4950-476c-bb4c-abf6b164962e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:49.111594 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1646e7e5-4950-476c-bb4c-abf6b164962e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:49.152629 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-04a23c46-585a-4ce9-be21-9ea99d6dac91 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:49.161361 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-04a23c46-585a-4ce9-be21-9ea99d6dac91 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:49.162860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-04a23c46-585a-4ce9-be21-9ea99d6dac91 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:49.164074 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-04a23c46-585a-4ce9-be21-9ea99d6dac91 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.163413 Feb 21 01:16:49.164632 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 535/1089] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:48 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:49.173202 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1646e7e5-4950-476c-bb4c-abf6b164962e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:49.181470 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1646e7e5-4950-476c-bb4c-abf6b164962e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081988 Feb 21 01:16:49.182156 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 555/1090] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:49 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:16:50.064870 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e4cde324-162d-47a3-95c0-ad1833d142d7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:50.065774 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e4cde324-162d-47a3-95c0-ad1833d142d7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:50.072539 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e4cde324-162d-47a3-95c0-ad1833d142d7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:50.072993 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e4cde324-162d-47a3-95c0-ad1833d142d7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:50.073756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e4cde324-162d-47a3-95c0-ad1833d142d7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:50.074185 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e4cde324-162d-47a3-95c0-ad1833d142d7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:50.104046 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e4cde324-162d-47a3-95c0-ad1833d142d7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042879 Feb 21 01:16:50.104651 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 536/1091] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:50 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:50.182863 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ec2eb354-8a5e-4611-a00e-19a12f5aa5b3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:50.183472 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ec2eb354-8a5e-4611-a00e-19a12f5aa5b3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:50.190098 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec2eb354-8a5e-4611-a00e-19a12f5aa5b3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:50.190544 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec2eb354-8a5e-4611-a00e-19a12f5aa5b3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:50.192150 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec2eb354-8a5e-4611-a00e-19a12f5aa5b3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:50.192583 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec2eb354-8a5e-4611-a00e-19a12f5aa5b3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:50.198280 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-312d972c-f258-41d5-9365-9565d184e800 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:50.198893 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-312d972c-f258-41d5-9365-9565d184e800 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:50.204654 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-312d972c-f258-41d5-9365-9565d184e800 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:50.205107 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-312d972c-f258-41d5-9365-9565d184e800 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:50.205892 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-312d972c-f258-41d5-9365-9565d184e800 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:50.206327 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-312d972c-f258-41d5-9365-9565d184e800 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:50.270895 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-312d972c-f258-41d5-9365-9565d184e800 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:50.279118 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-312d972c-f258-41d5-9365-9565d184e800 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084218 Feb 21 01:16:50.280014 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 537/1092] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:50 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:16:50.328397 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ec2eb354-8a5e-4611-a00e-19a12f5aa5b3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:50.336707 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ec2eb354-8a5e-4611-a00e-19a12f5aa5b3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:50.338188 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ec2eb354-8a5e-4611-a00e-19a12f5aa5b3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:50.339327 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ec2eb354-8a5e-4611-a00e-19a12f5aa5b3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160370 Feb 21 01:16:50.339914 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 556/1093] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:50 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:51.115879 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7bfa4783-ff27-411a-ae74-f98cecbf21be tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:51.116788 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7bfa4783-ff27-411a-ae74-f98cecbf21be tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:51.123245 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7bfa4783-ff27-411a-ae74-f98cecbf21be tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:51.123683 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7bfa4783-ff27-411a-ae74-f98cecbf21be tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:51.124486 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7bfa4783-ff27-411a-ae74-f98cecbf21be tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:51.124921 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7bfa4783-ff27-411a-ae74-f98cecbf21be tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:51.154911 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7bfa4783-ff27-411a-ae74-f98cecbf21be tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043440 Feb 21 01:16:51.155457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 538/1094] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:51 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:51.295555 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5a5bf524-a668-4e77-87e5-3ddfde74ff62 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:51.296249 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5a5bf524-a668-4e77-87e5-3ddfde74ff62 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:51.303885 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5a5bf524-a668-4e77-87e5-3ddfde74ff62 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:51.304338 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5a5bf524-a668-4e77-87e5-3ddfde74ff62 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:51.305122 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5a5bf524-a668-4e77-87e5-3ddfde74ff62 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:51.305559 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5a5bf524-a668-4e77-87e5-3ddfde74ff62 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:51.357644 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-99344174-b44a-410a-b118-4ccd33bfe867 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:51.358369 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-99344174-b44a-410a-b118-4ccd33bfe867 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:51.364907 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-99344174-b44a-410a-b118-4ccd33bfe867 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:51.365349 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-99344174-b44a-410a-b118-4ccd33bfe867 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:51.366196 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-99344174-b44a-410a-b118-4ccd33bfe867 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:51.366575 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-99344174-b44a-410a-b118-4ccd33bfe867 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:51.371047 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5a5bf524-a668-4e77-87e5-3ddfde74ff62 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:51.381589 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5a5bf524-a668-4e77-87e5-3ddfde74ff62 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.086589 Feb 21 01:16:51.381589 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 557/1095] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:51 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:51.503254 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-99344174-b44a-410a-b118-4ccd33bfe867 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:51.511475 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-99344174-b44a-410a-b118-4ccd33bfe867 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:51.512982 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-99344174-b44a-410a-b118-4ccd33bfe867 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:51.514123 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-99344174-b44a-410a-b118-4ccd33bfe867 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160273 Feb 21 01:16:51.514665 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 539/1096] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:51 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:16:52.166493 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-117c8c59-f28f-4026-be19-f8bb0cfbd917 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:52.167407 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-117c8c59-f28f-4026-be19-f8bb0cfbd917 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:52.173490 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-117c8c59-f28f-4026-be19-f8bb0cfbd917 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:52.173964 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-117c8c59-f28f-4026-be19-f8bb0cfbd917 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:52.174747 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-117c8c59-f28f-4026-be19-f8bb0cfbd917 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:52.175180 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-117c8c59-f28f-4026-be19-f8bb0cfbd917 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:52.204069 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-117c8c59-f28f-4026-be19-f8bb0cfbd917 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041274 Feb 21 01:16:52.204619 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 558/1097] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:52 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:52.396310 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-574a7662-a471-4d1f-9188-4efad582f57a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:52.396919 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-574a7662-a471-4d1f-9188-4efad582f57a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:52.403121 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-574a7662-a471-4d1f-9188-4efad582f57a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:52.403567 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-574a7662-a471-4d1f-9188-4efad582f57a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:52.404643 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-574a7662-a471-4d1f-9188-4efad582f57a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:52.405074 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-574a7662-a471-4d1f-9188-4efad582f57a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:52.465650 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-574a7662-a471-4d1f-9188-4efad582f57a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:52.473279 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-574a7662-a471-4d1f-9188-4efad582f57a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081244 Feb 21 01:16:52.473912 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 540/1098] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:52 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:52.532331 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-05ec87d4-9c80-4f84-a155-4e3ccc93b465 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:52.532957 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-05ec87d4-9c80-4f84-a155-4e3ccc93b465 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:52.540233 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-05ec87d4-9c80-4f84-a155-4e3ccc93b465 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:52.540684 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-05ec87d4-9c80-4f84-a155-4e3ccc93b465 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:52.541461 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-05ec87d4-9c80-4f84-a155-4e3ccc93b465 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:52.541899 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-05ec87d4-9c80-4f84-a155-4e3ccc93b465 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:52.680910 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-05ec87d4-9c80-4f84-a155-4e3ccc93b465 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:52.689046 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-05ec87d4-9c80-4f84-a155-4e3ccc93b465 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:52.690551 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-05ec87d4-9c80-4f84-a155-4e3ccc93b465 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:52.692130 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-05ec87d4-9c80-4f84-a155-4e3ccc93b465 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.163363 Feb 21 01:16:52.692684 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 559/1099] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:52 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:53.215807 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6d7f48eb-3d48-4f45-bec3-c20a5200684e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:53.216870 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6d7f48eb-3d48-4f45-bec3-c20a5200684e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:53.223235 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6d7f48eb-3d48-4f45-bec3-c20a5200684e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:53.223690 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6d7f48eb-3d48-4f45-bec3-c20a5200684e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:53.224505 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6d7f48eb-3d48-4f45-bec3-c20a5200684e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:53.224943 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6d7f48eb-3d48-4f45-bec3-c20a5200684e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:53.255008 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6d7f48eb-3d48-4f45-bec3-c20a5200684e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041949 Feb 21 01:16:53.255576 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 541/1100] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:53 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:53.492269 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-edf7bde1-824b-42af-ad31-f3657c790495 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:53.492786 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-edf7bde1-824b-42af-ad31-f3657c790495 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:53.498930 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-edf7bde1-824b-42af-ad31-f3657c790495 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:53.499386 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-edf7bde1-824b-42af-ad31-f3657c790495 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:53.500213 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-edf7bde1-824b-42af-ad31-f3657c790495 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:53.500644 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-edf7bde1-824b-42af-ad31-f3657c790495 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:53.562438 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-edf7bde1-824b-42af-ad31-f3657c790495 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:53.570571 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-edf7bde1-824b-42af-ad31-f3657c790495 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082769 Feb 21 01:16:53.571136 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 560/1101] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:53 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:53.709962 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a39d2e76-301b-489e-bfe9-ae89cd8dd0a7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:53.710549 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a39d2e76-301b-489e-bfe9-ae89cd8dd0a7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:53.716894 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a39d2e76-301b-489e-bfe9-ae89cd8dd0a7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:53.717342 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a39d2e76-301b-489e-bfe9-ae89cd8dd0a7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:53.718118 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a39d2e76-301b-489e-bfe9-ae89cd8dd0a7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:53.718583 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a39d2e76-301b-489e-bfe9-ae89cd8dd0a7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:53.855392 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a39d2e76-301b-489e-bfe9-ae89cd8dd0a7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:53.865708 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a39d2e76-301b-489e-bfe9-ae89cd8dd0a7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:53.867233 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a39d2e76-301b-489e-bfe9-ae89cd8dd0a7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:53.868472 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a39d2e76-301b-489e-bfe9-ae89cd8dd0a7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.162234 Feb 21 01:16:53.869026 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 542/1102] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:53 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:54.266780 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1b07f008-8611-4e8d-8a93-1fbe312ea052 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:54.267745 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1b07f008-8611-4e8d-8a93-1fbe312ea052 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:54.274242 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1b07f008-8611-4e8d-8a93-1fbe312ea052 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:54.274691 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1b07f008-8611-4e8d-8a93-1fbe312ea052 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:54.275470 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1b07f008-8611-4e8d-8a93-1fbe312ea052 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:54.275952 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1b07f008-8611-4e8d-8a93-1fbe312ea052 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:54.306857 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1b07f008-8611-4e8d-8a93-1fbe312ea052 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043991 Feb 21 01:16:54.307428 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 561/1103] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:54 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:54.586308 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7d8e65ec-75ae-4fa6-8fa4-4f4dcd7413b1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:54.586835 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7d8e65ec-75ae-4fa6-8fa4-4f4dcd7413b1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:54.593596 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7d8e65ec-75ae-4fa6-8fa4-4f4dcd7413b1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:54.594037 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7d8e65ec-75ae-4fa6-8fa4-4f4dcd7413b1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:54.594806 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7d8e65ec-75ae-4fa6-8fa4-4f4dcd7413b1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:54.595234 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7d8e65ec-75ae-4fa6-8fa4-4f4dcd7413b1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:54.655920 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7d8e65ec-75ae-4fa6-8fa4-4f4dcd7413b1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:54.663468 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7d8e65ec-75ae-4fa6-8fa4-4f4dcd7413b1 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080901 Feb 21 01:16:54.664096 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 543/1104] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:54 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:54.887088 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9f49729a-a51a-476b-a012-4fe8c2cc8d26 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:54.887655 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9f49729a-a51a-476b-a012-4fe8c2cc8d26 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:54.893953 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9f49729a-a51a-476b-a012-4fe8c2cc8d26 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:54.894402 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9f49729a-a51a-476b-a012-4fe8c2cc8d26 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:54.895185 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9f49729a-a51a-476b-a012-4fe8c2cc8d26 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:54.896244 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9f49729a-a51a-476b-a012-4fe8c2cc8d26 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:55.027209 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9f49729a-a51a-476b-a012-4fe8c2cc8d26 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:55.037105 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9f49729a-a51a-476b-a012-4fe8c2cc8d26 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:55.038677 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9f49729a-a51a-476b-a012-4fe8c2cc8d26 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:55.039882 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9f49729a-a51a-476b-a012-4fe8c2cc8d26 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156621 Feb 21 01:16:55.040442 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 562/1105] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:54 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:55.318876 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-bad1da05-6a7c-4772-bd06-be38d479f62e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:55.319803 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-bad1da05-6a7c-4772-bd06-be38d479f62e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:55.326058 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bad1da05-6a7c-4772-bd06-be38d479f62e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:55.326508 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bad1da05-6a7c-4772-bd06-be38d479f62e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:55.327300 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bad1da05-6a7c-4772-bd06-be38d479f62e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:55.327734 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bad1da05-6a7c-4772-bd06-be38d479f62e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:55.358372 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-bad1da05-6a7c-4772-bd06-be38d479f62e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043227 Feb 21 01:16:55.358604 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 544/1106] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:55 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:55.680235 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-60940349-66c5-4dd9-8793-7eb0bd6a7eb7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:55.680768 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-60940349-66c5-4dd9-8793-7eb0bd6a7eb7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:55.686717 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-60940349-66c5-4dd9-8793-7eb0bd6a7eb7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:55.687172 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-60940349-66c5-4dd9-8793-7eb0bd6a7eb7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:55.687992 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-60940349-66c5-4dd9-8793-7eb0bd6a7eb7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:55.688430 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-60940349-66c5-4dd9-8793-7eb0bd6a7eb7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:55.748691 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-60940349-66c5-4dd9-8793-7eb0bd6a7eb7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:55.756786 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-60940349-66c5-4dd9-8793-7eb0bd6a7eb7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080414 Feb 21 01:16:55.757340 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 563/1107] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:55 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:56.058607 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-32ccc035-f248-451c-b12c-40578c1f7472 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:56.059225 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-32ccc035-f248-451c-b12c-40578c1f7472 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:56.065208 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-32ccc035-f248-451c-b12c-40578c1f7472 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:56.065686 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-32ccc035-f248-451c-b12c-40578c1f7472 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:56.066468 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-32ccc035-f248-451c-b12c-40578c1f7472 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:56.066907 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-32ccc035-f248-451c-b12c-40578c1f7472 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:56.199865 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-32ccc035-f248-451c-b12c-40578c1f7472 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:56.209228 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-32ccc035-f248-451c-b12c-40578c1f7472 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:56.210768 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-32ccc035-f248-451c-b12c-40578c1f7472 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:56.211977 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-32ccc035-f248-451c-b12c-40578c1f7472 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157078 Feb 21 01:16:56.212511 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 545/1108] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:56 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:56.370099 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-57eb9c54-9094-46c4-aced-8a6b68f9db69 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:56.371020 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-57eb9c54-9094-46c4-aced-8a6b68f9db69 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:56.377251 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57eb9c54-9094-46c4-aced-8a6b68f9db69 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:56.377699 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57eb9c54-9094-46c4-aced-8a6b68f9db69 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:56.378484 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57eb9c54-9094-46c4-aced-8a6b68f9db69 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:56.379035 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57eb9c54-9094-46c4-aced-8a6b68f9db69 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:56.411990 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-57eb9c54-9094-46c4-aced-8a6b68f9db69 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045558 Feb 21 01:16:56.412751 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 564/1109] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:56 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:56.774144 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2651905a-a5d4-4e3e-a7e3-704b43d2460c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:56.774756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2651905a-a5d4-4e3e-a7e3-704b43d2460c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:56.781395 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2651905a-a5d4-4e3e-a7e3-704b43d2460c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:56.781850 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2651905a-a5d4-4e3e-a7e3-704b43d2460c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:56.782636 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2651905a-a5d4-4e3e-a7e3-704b43d2460c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:56.783070 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2651905a-a5d4-4e3e-a7e3-704b43d2460c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:56.845027 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2651905a-a5d4-4e3e-a7e3-704b43d2460c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:56.852483 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2651905a-a5d4-4e3e-a7e3-704b43d2460c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082955 Feb 21 01:16:56.853049 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 546/1110] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:56 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:57.229961 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ad5fff8e-7a2d-47cd-a3f2-1df360b9bb57 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:57.230590 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ad5fff8e-7a2d-47cd-a3f2-1df360b9bb57 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:57.236430 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad5fff8e-7a2d-47cd-a3f2-1df360b9bb57 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:57.236789 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad5fff8e-7a2d-47cd-a3f2-1df360b9bb57 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:57.237550 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad5fff8e-7a2d-47cd-a3f2-1df360b9bb57 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:57.237976 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad5fff8e-7a2d-47cd-a3f2-1df360b9bb57 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:57.373934 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ad5fff8e-7a2d-47cd-a3f2-1df360b9bb57 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:57.382594 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ad5fff8e-7a2d-47cd-a3f2-1df360b9bb57 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:57.384177 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ad5fff8e-7a2d-47cd-a3f2-1df360b9bb57 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:57.385341 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ad5fff8e-7a2d-47cd-a3f2-1df360b9bb57 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159106 Feb 21 01:16:57.385882 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 565/1111] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:57 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:57.422419 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d266a33e-ff90-413f-81f6-4db6bc46c2a1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:57.423328 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d266a33e-ff90-413f-81f6-4db6bc46c2a1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:57.430140 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d266a33e-ff90-413f-81f6-4db6bc46c2a1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:57.430588 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d266a33e-ff90-413f-81f6-4db6bc46c2a1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:57.431362 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d266a33e-ff90-413f-81f6-4db6bc46c2a1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:57.431795 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d266a33e-ff90-413f-81f6-4db6bc46c2a1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:57.460896 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d266a33e-ff90-413f-81f6-4db6bc46c2a1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042217 Feb 21 01:16:57.461444 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 547/1112] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:57 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:57.870292 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-607b7121-b739-4e54-a160-eb8d12ac0cd5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:57.870896 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-607b7121-b739-4e54-a160-eb8d12ac0cd5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:57.877065 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-607b7121-b739-4e54-a160-eb8d12ac0cd5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:57.877526 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-607b7121-b739-4e54-a160-eb8d12ac0cd5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:57.878314 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-607b7121-b739-4e54-a160-eb8d12ac0cd5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:57.878718 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-607b7121-b739-4e54-a160-eb8d12ac0cd5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:57.939018 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-607b7121-b739-4e54-a160-eb8d12ac0cd5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:57.947241 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-607b7121-b739-4e54-a160-eb8d12ac0cd5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080724 Feb 21 01:16:57.947802 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 566/1113] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:57 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:58.404039 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4be9bd19-769f-499d-9944-3b9054a0ff30 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:58.404685 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4be9bd19-769f-499d-9944-3b9054a0ff30 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:58.411738 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4be9bd19-769f-499d-9944-3b9054a0ff30 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:58.412205 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4be9bd19-769f-499d-9944-3b9054a0ff30 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:58.412987 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4be9bd19-769f-499d-9944-3b9054a0ff30 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:58.413414 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4be9bd19-769f-499d-9944-3b9054a0ff30 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:58.472243 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6acc63d0-2a39-493d-a4ed-9ec816479495 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:58.473895 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6acc63d0-2a39-493d-a4ed-9ec816479495 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:58.480597 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6acc63d0-2a39-493d-a4ed-9ec816479495 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:58.481135 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6acc63d0-2a39-493d-a4ed-9ec816479495 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:58.482003 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6acc63d0-2a39-493d-a4ed-9ec816479495 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:58.482509 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6acc63d0-2a39-493d-a4ed-9ec816479495 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:58.515207 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6acc63d0-2a39-493d-a4ed-9ec816479495 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046705 Feb 21 01:16:58.515790 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 567/1114] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:58 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:16:58.554263 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4be9bd19-769f-499d-9944-3b9054a0ff30 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:58.562428 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4be9bd19-769f-499d-9944-3b9054a0ff30 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:58.563928 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4be9bd19-769f-499d-9944-3b9054a0ff30 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:58.565063 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4be9bd19-769f-499d-9944-3b9054a0ff30 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.165122 Feb 21 01:16:58.565608 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 548/1115] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:58 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:16:58.964346 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-eca11e8b-f1d2-43af-b130-9b963c39993b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:58.964942 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-eca11e8b-f1d2-43af-b130-9b963c39993b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:58.970781 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eca11e8b-f1d2-43af-b130-9b963c39993b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:58.971226 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eca11e8b-f1d2-43af-b130-9b963c39993b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:58.972025 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eca11e8b-f1d2-43af-b130-9b963c39993b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:58.972461 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eca11e8b-f1d2-43af-b130-9b963c39993b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:59.182247 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-eca11e8b-f1d2-43af-b130-9b963c39993b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:59.194496 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-eca11e8b-f1d2-43af-b130-9b963c39993b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.233372 Feb 21 01:16:59.195502 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 568/1116] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:16:58 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:16:59.526157 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e1a1f2d9-2d0e-4d40-be57-e1d46a1cda2e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:59.527095 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e1a1f2d9-2d0e-4d40-be57-e1d46a1cda2e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:59.533528 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e1a1f2d9-2d0e-4d40-be57-e1d46a1cda2e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:59.533962 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e1a1f2d9-2d0e-4d40-be57-e1d46a1cda2e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:59.534730 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e1a1f2d9-2d0e-4d40-be57-e1d46a1cda2e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:59.535156 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e1a1f2d9-2d0e-4d40-be57-e1d46a1cda2e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:59.565134 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e1a1f2d9-2d0e-4d40-be57-e1d46a1cda2e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042700 Feb 21 01:16:59.565697 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 549/1117] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:16:59 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:16:59.585781 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0c72cb66-a092-46f0-bba5-609d038bcf3e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:16:59.586380 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0c72cb66-a092-46f0-bba5-609d038bcf3e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:16:59.592633 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0c72cb66-a092-46f0-bba5-609d038bcf3e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:59.593074 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0c72cb66-a092-46f0-bba5-609d038bcf3e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:59.593842 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0c72cb66-a092-46f0-bba5-609d038bcf3e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:16:59.594355 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0c72cb66-a092-46f0-bba5-609d038bcf3e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:16:59.725935 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0c72cb66-a092-46f0-bba5-609d038bcf3e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:59.734227 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0c72cb66-a092-46f0-bba5-609d038bcf3e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:59.735750 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0c72cb66-a092-46f0-bba5-609d038bcf3e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:16:59.736926 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0c72cb66-a092-46f0-bba5-609d038bcf3e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156878 Feb 21 01:16:59.737471 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 569/1118] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:16:59 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:17:00.213108 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4ae41df2-6897-4327-8eaa-af839add9d1c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:00.213717 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4ae41df2-6897-4327-8eaa-af839add9d1c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:00.219565 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ae41df2-6897-4327-8eaa-af839add9d1c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:00.220049 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ae41df2-6897-4327-8eaa-af839add9d1c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:00.220831 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ae41df2-6897-4327-8eaa-af839add9d1c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:00.221266 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ae41df2-6897-4327-8eaa-af839add9d1c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:00.280986 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4ae41df2-6897-4327-8eaa-af839add9d1c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:00.288900 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4ae41df2-6897-4327-8eaa-af839add9d1c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079477 Feb 21 01:17:00.289457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 550/1119] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:00 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:00.577250 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fe7abb67-97a2-4857-aca9-7e52a618b545 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:00.578156 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fe7abb67-97a2-4857-aca9-7e52a618b545 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:00.585119 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fe7abb67-97a2-4857-aca9-7e52a618b545 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:00.585575 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fe7abb67-97a2-4857-aca9-7e52a618b545 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:00.586354 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fe7abb67-97a2-4857-aca9-7e52a618b545 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:00.586896 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fe7abb67-97a2-4857-aca9-7e52a618b545 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:00.617736 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-fe7abb67-97a2-4857-aca9-7e52a618b545 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044298 Feb 21 01:17:00.618272 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 570/1120] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:00 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:00.755525 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e9384f35-d14f-4104-acf8-48e3ca157c6b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:00.756284 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e9384f35-d14f-4104-acf8-48e3ca157c6b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:00.762522 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e9384f35-d14f-4104-acf8-48e3ca157c6b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:00.762981 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e9384f35-d14f-4104-acf8-48e3ca157c6b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:00.763765 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e9384f35-d14f-4104-acf8-48e3ca157c6b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:00.764234 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e9384f35-d14f-4104-acf8-48e3ca157c6b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:00.901878 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e9384f35-d14f-4104-acf8-48e3ca157c6b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:00.910300 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e9384f35-d14f-4104-acf8-48e3ca157c6b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:00.912208 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e9384f35-d14f-4104-acf8-48e3ca157c6b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:00.913367 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e9384f35-d14f-4104-acf8-48e3ca157c6b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.162261 Feb 21 01:17:00.913924 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 551/1121] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:00 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:01.305352 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e57ea09e-e9d3-4f31-814c-b82cee55370b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:01.305960 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e57ea09e-e9d3-4f31-814c-b82cee55370b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:01.311750 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e57ea09e-e9d3-4f31-814c-b82cee55370b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:01.312235 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e57ea09e-e9d3-4f31-814c-b82cee55370b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:01.313012 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e57ea09e-e9d3-4f31-814c-b82cee55370b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:01.313450 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e57ea09e-e9d3-4f31-814c-b82cee55370b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:01.381593 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e57ea09e-e9d3-4f31-814c-b82cee55370b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:01.389653 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e57ea09e-e9d3-4f31-814c-b82cee55370b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.088679 Feb 21 01:17:01.390218 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 571/1122] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:01 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:01.633680 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ae33ed46-9bc0-490c-a724-1d7a38bbbfe5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:01.634494 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ae33ed46-9bc0-490c-a724-1d7a38bbbfe5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:01.640436 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ae33ed46-9bc0-490c-a724-1d7a38bbbfe5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:01.640879 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ae33ed46-9bc0-490c-a724-1d7a38bbbfe5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:01.641658 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ae33ed46-9bc0-490c-a724-1d7a38bbbfe5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:01.642091 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ae33ed46-9bc0-490c-a724-1d7a38bbbfe5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:01.671085 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ae33ed46-9bc0-490c-a724-1d7a38bbbfe5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041437 Feb 21 01:17:01.671629 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 552/1123] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:01 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:01.931654 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-872982d5-d56f-41e6-aa3a-d0d66cf8c744 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:01.932260 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-872982d5-d56f-41e6-aa3a-d0d66cf8c744 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:01.938410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-872982d5-d56f-41e6-aa3a-d0d66cf8c744 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:01.938858 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-872982d5-d56f-41e6-aa3a-d0d66cf8c744 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:01.939633 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-872982d5-d56f-41e6-aa3a-d0d66cf8c744 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:01.940101 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-872982d5-d56f-41e6-aa3a-d0d66cf8c744 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:02.070860 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-872982d5-d56f-41e6-aa3a-d0d66cf8c744 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:02.078938 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-872982d5-d56f-41e6-aa3a-d0d66cf8c744 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:02.080512 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-872982d5-d56f-41e6-aa3a-d0d66cf8c744 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:02.081647 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-872982d5-d56f-41e6-aa3a-d0d66cf8c744 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.153854 Feb 21 01:17:02.082192 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 572/1124] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:01 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:02.406352 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c560c271-4440-407e-bdbe-b75ba558ad66 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:02.407112 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c560c271-4440-407e-bdbe-b75ba558ad66 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:02.413812 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c560c271-4440-407e-bdbe-b75ba558ad66 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:02.414336 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c560c271-4440-407e-bdbe-b75ba558ad66 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:02.415413 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c560c271-4440-407e-bdbe-b75ba558ad66 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:02.416620 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c560c271-4440-407e-bdbe-b75ba558ad66 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:02.476638 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c560c271-4440-407e-bdbe-b75ba558ad66 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:02.484082 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c560c271-4440-407e-bdbe-b75ba558ad66 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081643 Feb 21 01:17:02.484857 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 553/1125] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:02 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:02.683171 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e480c94a-8738-4a55-b613-f2f8591237d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:02.684113 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e480c94a-8738-4a55-b613-f2f8591237d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:02.690048 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e480c94a-8738-4a55-b613-f2f8591237d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:02.690487 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e480c94a-8738-4a55-b613-f2f8591237d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:02.691261 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e480c94a-8738-4a55-b613-f2f8591237d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:02.691691 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e480c94a-8738-4a55-b613-f2f8591237d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:02.721260 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e480c94a-8738-4a55-b613-f2f8591237d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041759 Feb 21 01:17:02.721805 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 573/1126] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:02 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:03.100747 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-41051d2d-d3e5-4263-bb85-dbf42ec59a0f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:03.101354 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-41051d2d-d3e5-4263-bb85-dbf42ec59a0f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:03.107369 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-41051d2d-d3e5-4263-bb85-dbf42ec59a0f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:03.111367 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-41051d2d-d3e5-4263-bb85-dbf42ec59a0f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:03.111367 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-41051d2d-d3e5-4263-bb85-dbf42ec59a0f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:03.111367 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-41051d2d-d3e5-4263-bb85-dbf42ec59a0f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:03.154473 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:17:03.155064 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:17:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:17:03.244737 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-41051d2d-d3e5-4263-bb85-dbf42ec59a0f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:03.252911 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-41051d2d-d3e5-4263-bb85-dbf42ec59a0f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:03.254643 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-41051d2d-d3e5-4263-bb85-dbf42ec59a0f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:03.256030 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-41051d2d-d3e5-4263-bb85-dbf42ec59a0f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159803 Feb 21 01:17:03.256592 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 554/1127] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:03 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:17:03.500663 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f54f4a1a-6dc8-4846-80ad-d2e2431c0168 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:03.501288 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f54f4a1a-6dc8-4846-80ad-d2e2431c0168 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:03.507651 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f54f4a1a-6dc8-4846-80ad-d2e2431c0168 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:03.508120 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f54f4a1a-6dc8-4846-80ad-d2e2431c0168 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:03.508887 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f54f4a1a-6dc8-4846-80ad-d2e2431c0168 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:03.509310 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f54f4a1a-6dc8-4846-80ad-d2e2431c0168 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:03.570585 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f54f4a1a-6dc8-4846-80ad-d2e2431c0168 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:03.577810 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f54f4a1a-6dc8-4846-80ad-d2e2431c0168 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080772 Feb 21 01:17:03.578351 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 574/1128] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:03 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:03.733115 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b43821ca-4372-41ad-be48-192209ab1814 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:03.734022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b43821ca-4372-41ad-be48-192209ab1814 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:03.741445 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b43821ca-4372-41ad-be48-192209ab1814 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:03.741885 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b43821ca-4372-41ad-be48-192209ab1814 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:03.742648 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b43821ca-4372-41ad-be48-192209ab1814 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:03.743072 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b43821ca-4372-41ad-be48-192209ab1814 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:03.771843 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b43821ca-4372-41ad-be48-192209ab1814 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042416 Feb 21 01:17:03.772427 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 555/1129] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:03 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:04.274384 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-55adcffe-9eec-46c6-98b7-ff18da17a515 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:04.274986 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-55adcffe-9eec-46c6-98b7-ff18da17a515 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:04.281126 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-55adcffe-9eec-46c6-98b7-ff18da17a515 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:04.281567 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-55adcffe-9eec-46c6-98b7-ff18da17a515 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:04.282344 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-55adcffe-9eec-46c6-98b7-ff18da17a515 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:04.282776 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-55adcffe-9eec-46c6-98b7-ff18da17a515 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:04.416460 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-55adcffe-9eec-46c6-98b7-ff18da17a515 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:04.424616 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-55adcffe-9eec-46c6-98b7-ff18da17a515 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:04.426231 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-55adcffe-9eec-46c6-98b7-ff18da17a515 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:04.427467 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-55adcffe-9eec-46c6-98b7-ff18da17a515 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156786 Feb 21 01:17:04.428045 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 575/1130] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:04 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:04.594696 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f9c28189-2d7f-4164-adbd-e8acf736ac0e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:04.595223 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f9c28189-2d7f-4164-adbd-e8acf736ac0e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:04.601709 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f9c28189-2d7f-4164-adbd-e8acf736ac0e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:04.602162 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f9c28189-2d7f-4164-adbd-e8acf736ac0e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:04.602946 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f9c28189-2d7f-4164-adbd-e8acf736ac0e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:04.603385 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f9c28189-2d7f-4164-adbd-e8acf736ac0e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:04.665881 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f9c28189-2d7f-4164-adbd-e8acf736ac0e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:04.673330 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f9c28189-2d7f-4164-adbd-e8acf736ac0e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082396 Feb 21 01:17:04.673884 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 556/1131] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:04 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:04.782825 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-77196133-57fe-4dec-8299-89be54dbc1ed tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:04.783740 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-77196133-57fe-4dec-8299-89be54dbc1ed tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:04.790115 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-77196133-57fe-4dec-8299-89be54dbc1ed tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:04.790563 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-77196133-57fe-4dec-8299-89be54dbc1ed tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:04.791345 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-77196133-57fe-4dec-8299-89be54dbc1ed tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:04.791786 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-77196133-57fe-4dec-8299-89be54dbc1ed tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:04.820795 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-77196133-57fe-4dec-8299-89be54dbc1ed tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041993 Feb 21 01:17:04.821341 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 576/1132] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:04 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:05.445506 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-299f030e-5b41-419a-8e74-decdcc931e2c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:05.446122 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-299f030e-5b41-419a-8e74-decdcc931e2c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:05.452485 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-299f030e-5b41-419a-8e74-decdcc931e2c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:05.452933 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-299f030e-5b41-419a-8e74-decdcc931e2c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:05.453708 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-299f030e-5b41-419a-8e74-decdcc931e2c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:05.454142 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-299f030e-5b41-419a-8e74-decdcc931e2c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:05.589665 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-299f030e-5b41-419a-8e74-decdcc931e2c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:05.597940 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-299f030e-5b41-419a-8e74-decdcc931e2c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:05.600198 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-299f030e-5b41-419a-8e74-decdcc931e2c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:05.601354 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-299f030e-5b41-419a-8e74-decdcc931e2c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159872 Feb 21 01:17:05.601911 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 557/1133] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:05 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:05.690496 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a9bc444f-a328-47b1-9ae8-70b4ce293347 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:05.691104 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a9bc444f-a328-47b1-9ae8-70b4ce293347 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:05.697308 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a9bc444f-a328-47b1-9ae8-70b4ce293347 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:05.697755 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a9bc444f-a328-47b1-9ae8-70b4ce293347 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:05.698531 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a9bc444f-a328-47b1-9ae8-70b4ce293347 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:05.698961 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a9bc444f-a328-47b1-9ae8-70b4ce293347 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:05.758988 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a9bc444f-a328-47b1-9ae8-70b4ce293347 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:05.766267 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a9bc444f-a328-47b1-9ae8-70b4ce293347 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079489 Feb 21 01:17:05.766816 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 577/1134] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:05 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:05.831677 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2fdbfe6f-cd41-4da8-b981-a2b5e274a975 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:05.832705 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2fdbfe6f-cd41-4da8-b981-a2b5e274a975 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:05.839117 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2fdbfe6f-cd41-4da8-b981-a2b5e274a975 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:05.839558 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2fdbfe6f-cd41-4da8-b981-a2b5e274a975 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:05.840443 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2fdbfe6f-cd41-4da8-b981-a2b5e274a975 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:05.840868 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2fdbfe6f-cd41-4da8-b981-a2b5e274a975 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:05.870358 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2fdbfe6f-cd41-4da8-b981-a2b5e274a975 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042367 Feb 21 01:17:05.870924 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 558/1135] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:05 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:17:06.619669 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1c82a2ba-2d05-4331-9a72-34ae343cd350 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:06.620230 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1c82a2ba-2d05-4331-9a72-34ae343cd350 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:06.626626 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c82a2ba-2d05-4331-9a72-34ae343cd350 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:06.627067 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c82a2ba-2d05-4331-9a72-34ae343cd350 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:06.627860 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c82a2ba-2d05-4331-9a72-34ae343cd350 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:06.628303 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c82a2ba-2d05-4331-9a72-34ae343cd350 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:06.761000 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1c82a2ba-2d05-4331-9a72-34ae343cd350 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:06.769124 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1c82a2ba-2d05-4331-9a72-34ae343cd350 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:06.770611 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1c82a2ba-2d05-4331-9a72-34ae343cd350 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:06.771757 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1c82a2ba-2d05-4331-9a72-34ae343cd350 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155921 Feb 21 01:17:06.772333 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 578/1136] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:06 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:17:06.783606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2f1cf25c-c02a-4a01-9ae7-5fed0115ba65 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:06.784240 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2f1cf25c-c02a-4a01-9ae7-5fed0115ba65 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:06.791100 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2f1cf25c-c02a-4a01-9ae7-5fed0115ba65 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:06.791543 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2f1cf25c-c02a-4a01-9ae7-5fed0115ba65 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:06.792359 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2f1cf25c-c02a-4a01-9ae7-5fed0115ba65 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:06.792787 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2f1cf25c-c02a-4a01-9ae7-5fed0115ba65 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:06.851396 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2f1cf25c-c02a-4a01-9ae7-5fed0115ba65 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:06.858762 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2f1cf25c-c02a-4a01-9ae7-5fed0115ba65 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.078803 Feb 21 01:17:06.859334 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 559/1137] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:06 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:06.881119 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2b00c7f3-1e6e-4ddf-985b-8cb2839dacb0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:06.881959 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2b00c7f3-1e6e-4ddf-985b-8cb2839dacb0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:06.887875 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2b00c7f3-1e6e-4ddf-985b-8cb2839dacb0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:06.888336 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2b00c7f3-1e6e-4ddf-985b-8cb2839dacb0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:06.889120 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2b00c7f3-1e6e-4ddf-985b-8cb2839dacb0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:06.889561 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2b00c7f3-1e6e-4ddf-985b-8cb2839dacb0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:06.918998 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2b00c7f3-1e6e-4ddf-985b-8cb2839dacb0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041857 Feb 21 01:17:06.919551 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 579/1138] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:06 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:07.790809 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3fbc37f5-8d28-4655-9f6f-db7471cb3623 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:07.791417 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3fbc37f5-8d28-4655-9f6f-db7471cb3623 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:07.797820 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3fbc37f5-8d28-4655-9f6f-db7471cb3623 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:07.798308 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3fbc37f5-8d28-4655-9f6f-db7471cb3623 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:07.799092 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3fbc37f5-8d28-4655-9f6f-db7471cb3623 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:07.799526 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3fbc37f5-8d28-4655-9f6f-db7471cb3623 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:07.876173 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-cfc3f23a-6379-4eed-9811-c5272cf9122c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:07.876784 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-cfc3f23a-6379-4eed-9811-c5272cf9122c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:07.884004 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cfc3f23a-6379-4eed-9811-c5272cf9122c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:07.884834 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cfc3f23a-6379-4eed-9811-c5272cf9122c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:07.885238 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cfc3f23a-6379-4eed-9811-c5272cf9122c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:07.885709 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cfc3f23a-6379-4eed-9811-c5272cf9122c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:07.935999 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3fbc37f5-8d28-4655-9f6f-db7471cb3623 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:07.945015 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3fbc37f5-8d28-4655-9f6f-db7471cb3623 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:07.946510 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3fbc37f5-8d28-4655-9f6f-db7471cb3623 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:07.947693 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3fbc37f5-8d28-4655-9f6f-db7471cb3623 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160781 Feb 21 01:17:07.947819 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-cfc3f23a-6379-4eed-9811-c5272cf9122c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:07.948291 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 560/1139] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:07 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:07.952733 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-36f1a2be-c7b5-4802-9167-4fa4853dccd5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:07.953647 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-36f1a2be-c7b5-4802-9167-4fa4853dccd5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:07.956360 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-cfc3f23a-6379-4eed-9811-c5272cf9122c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083763 Feb 21 01:17:07.957102 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 580/1140] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:07 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:17:07.959383 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-36f1a2be-c7b5-4802-9167-4fa4853dccd5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:07.959826 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-36f1a2be-c7b5-4802-9167-4fa4853dccd5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:07.960649 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-36f1a2be-c7b5-4802-9167-4fa4853dccd5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:07.961086 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-36f1a2be-c7b5-4802-9167-4fa4853dccd5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:07.989986 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-36f1a2be-c7b5-4802-9167-4fa4853dccd5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040183 Feb 21 01:17:07.990540 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 561/1141] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:07 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:08.968864 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f7e1362f-2d61-4a82-8241-769495d92cc4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:08.969461 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f7e1362f-2d61-4a82-8241-769495d92cc4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:08.972872 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a134c9b0-f823-463e-865b-d56f5b117b6d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:08.973489 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a134c9b0-f823-463e-865b-d56f5b117b6d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:08.976253 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f7e1362f-2d61-4a82-8241-769495d92cc4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:08.976708 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f7e1362f-2d61-4a82-8241-769495d92cc4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:08.977497 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f7e1362f-2d61-4a82-8241-769495d92cc4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:08.977931 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f7e1362f-2d61-4a82-8241-769495d92cc4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:08.979625 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a134c9b0-f823-463e-865b-d56f5b117b6d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:08.980114 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a134c9b0-f823-463e-865b-d56f5b117b6d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:08.981096 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a134c9b0-f823-463e-865b-d56f5b117b6d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:08.981528 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a134c9b0-f823-463e-865b-d56f5b117b6d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:09.045699 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a134c9b0-f823-463e-865b-d56f5b117b6d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:09.053051 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a134c9b0-f823-463e-865b-d56f5b117b6d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083844 Feb 21 01:17:09.053628 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 562/1142] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:08 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:17:09.058079 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a47bcb65-b416-4873-82fc-5fb3eb87d2cd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:09.058988 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a47bcb65-b416-4873-82fc-5fb3eb87d2cd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:09.064683 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a47bcb65-b416-4873-82fc-5fb3eb87d2cd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:09.065537 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a47bcb65-b416-4873-82fc-5fb3eb87d2cd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:09.065909 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a47bcb65-b416-4873-82fc-5fb3eb87d2cd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:09.066342 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a47bcb65-b416-4873-82fc-5fb3eb87d2cd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:09.098057 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a47bcb65-b416-4873-82fc-5fb3eb87d2cd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043385 Feb 21 01:17:09.099664 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 563/1143] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:09 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:09.120134 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f7e1362f-2d61-4a82-8241-769495d92cc4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:09.128307 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f7e1362f-2d61-4a82-8241-769495d92cc4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:09.130518 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f7e1362f-2d61-4a82-8241-769495d92cc4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:09.131674 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f7e1362f-2d61-4a82-8241-769495d92cc4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.166618 Feb 21 01:17:09.132260 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 581/1144] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:08 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:10.069630 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-87eece1a-3dee-4d61-8557-1e89a19fa040 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:10.070237 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-87eece1a-3dee-4d61-8557-1e89a19fa040 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:10.076492 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-87eece1a-3dee-4d61-8557-1e89a19fa040 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:10.076936 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-87eece1a-3dee-4d61-8557-1e89a19fa040 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:10.077708 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-87eece1a-3dee-4d61-8557-1e89a19fa040 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:10.078136 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-87eece1a-3dee-4d61-8557-1e89a19fa040 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:10.110348 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-da25494b-96fb-40ef-b760-bcd272b51e6d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:10.111358 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-da25494b-96fb-40ef-b760-bcd272b51e6d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:10.118569 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-da25494b-96fb-40ef-b760-bcd272b51e6d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:10.119131 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-da25494b-96fb-40ef-b760-bcd272b51e6d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:10.120031 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-da25494b-96fb-40ef-b760-bcd272b51e6d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:10.120540 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-da25494b-96fb-40ef-b760-bcd272b51e6d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:10.137141 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-87eece1a-3dee-4d61-8557-1e89a19fa040 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:10.144447 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-87eece1a-3dee-4d61-8557-1e89a19fa040 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079094 Feb 21 01:17:10.145145 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 564/1145] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:10 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:10.150348 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-10941477-bfd1-4b2e-95af-4967c80ef934 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:10.150964 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-10941477-bfd1-4b2e-95af-4967c80ef934 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:10.151573 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-da25494b-96fb-40ef-b760-bcd272b51e6d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044887 Feb 21 01:17:10.152322 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 582/1146] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:10 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:17:10.157044 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-10941477-bfd1-4b2e-95af-4967c80ef934 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:10.157493 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-10941477-bfd1-4b2e-95af-4967c80ef934 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:10.158284 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-10941477-bfd1-4b2e-95af-4967c80ef934 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:10.158719 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-10941477-bfd1-4b2e-95af-4967c80ef934 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:10.291222 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-10941477-bfd1-4b2e-95af-4967c80ef934 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:10.299203 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-10941477-bfd1-4b2e-95af-4967c80ef934 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:10.300708 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-10941477-bfd1-4b2e-95af-4967c80ef934 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:10.302335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-10941477-bfd1-4b2e-95af-4967c80ef934 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155039 Feb 21 01:17:10.302909 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 565/1147] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:10 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:11.160819 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-439fc461-bb1f-4b6f-8093-f063afb6b1d3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:11.161465 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-439fc461-bb1f-4b6f-8093-f063afb6b1d3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:11.162487 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-63e9bffe-00cd-430d-a84b-b881f3bbd2d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:11.163420 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-63e9bffe-00cd-430d-a84b-b881f3bbd2d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:11.167996 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-439fc461-bb1f-4b6f-8093-f063afb6b1d3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:11.168447 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-439fc461-bb1f-4b6f-8093-f063afb6b1d3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:11.169224 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-439fc461-bb1f-4b6f-8093-f063afb6b1d3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:11.169649 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-439fc461-bb1f-4b6f-8093-f063afb6b1d3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:11.169983 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-63e9bffe-00cd-430d-a84b-b881f3bbd2d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:11.170437 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-63e9bffe-00cd-430d-a84b-b881f3bbd2d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:11.171224 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-63e9bffe-00cd-430d-a84b-b881f3bbd2d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:11.171770 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-63e9bffe-00cd-430d-a84b-b881f3bbd2d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:11.202880 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-63e9bffe-00cd-430d-a84b-b881f3bbd2d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044327 Feb 21 01:17:11.203455 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 566/1148] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:11 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:17:11.232562 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-439fc461-bb1f-4b6f-8093-f063afb6b1d3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:11.240764 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-439fc461-bb1f-4b6f-8093-f063afb6b1d3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083509 Feb 21 01:17:11.241316 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 583/1149] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:11 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:11.320373 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-804a6a64-8d24-4053-a822-6ee037212a47 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:11.320980 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-804a6a64-8d24-4053-a822-6ee037212a47 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:11.326816 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-804a6a64-8d24-4053-a822-6ee037212a47 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:11.335186 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-804a6a64-8d24-4053-a822-6ee037212a47 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:11.335186 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-804a6a64-8d24-4053-a822-6ee037212a47 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:11.335186 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-804a6a64-8d24-4053-a822-6ee037212a47 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:11.463458 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-804a6a64-8d24-4053-a822-6ee037212a47 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:11.471582 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-804a6a64-8d24-4053-a822-6ee037212a47 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:11.473115 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-804a6a64-8d24-4053-a822-6ee037212a47 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:11.474786 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-804a6a64-8d24-4053-a822-6ee037212a47 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157763 Feb 21 01:17:11.475463 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 567/1150] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:11 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:12.214709 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3a70f3ae-542c-43d3-9223-0bdcbcc13811 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:12.215616 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3a70f3ae-542c-43d3-9223-0bdcbcc13811 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:12.221861 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3a70f3ae-542c-43d3-9223-0bdcbcc13811 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:12.222306 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3a70f3ae-542c-43d3-9223-0bdcbcc13811 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:12.223081 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3a70f3ae-542c-43d3-9223-0bdcbcc13811 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:12.223516 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3a70f3ae-542c-43d3-9223-0bdcbcc13811 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:12.252878 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3a70f3ae-542c-43d3-9223-0bdcbcc13811 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041932 Feb 21 01:17:12.253429 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 584/1151] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:12 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:12.257471 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-505dbc61-24b8-4d81-9bec-ba398a2a85e2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:12.258086 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-505dbc61-24b8-4d81-9bec-ba398a2a85e2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:12.264449 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-505dbc61-24b8-4d81-9bec-ba398a2a85e2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:12.264900 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-505dbc61-24b8-4d81-9bec-ba398a2a85e2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:12.265680 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-505dbc61-24b8-4d81-9bec-ba398a2a85e2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:12.266115 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-505dbc61-24b8-4d81-9bec-ba398a2a85e2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:12.326217 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-505dbc61-24b8-4d81-9bec-ba398a2a85e2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:12.334226 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-505dbc61-24b8-4d81-9bec-ba398a2a85e2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080089 Feb 21 01:17:12.334625 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 568/1152] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:12 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:17:12.493279 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e64a9ccc-ade7-4ef2-95db-5e5077e6c361 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:12.493878 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e64a9ccc-ade7-4ef2-95db-5e5077e6c361 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:12.499671 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e64a9ccc-ade7-4ef2-95db-5e5077e6c361 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:12.500158 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e64a9ccc-ade7-4ef2-95db-5e5077e6c361 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:12.500922 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e64a9ccc-ade7-4ef2-95db-5e5077e6c361 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:12.501347 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e64a9ccc-ade7-4ef2-95db-5e5077e6c361 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:12.634364 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e64a9ccc-ade7-4ef2-95db-5e5077e6c361 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:12.642775 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e64a9ccc-ade7-4ef2-95db-5e5077e6c361 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:12.644298 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e64a9ccc-ade7-4ef2-95db-5e5077e6c361 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:12.645446 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e64a9ccc-ade7-4ef2-95db-5e5077e6c361 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156348 Feb 21 01:17:12.645999 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 585/1153] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:12 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:13.264459 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a5e38d8b-6ad5-451c-bd1f-7cb05e968724 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:13.265377 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a5e38d8b-6ad5-451c-bd1f-7cb05e968724 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:13.272548 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a5e38d8b-6ad5-451c-bd1f-7cb05e968724 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:13.273003 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a5e38d8b-6ad5-451c-bd1f-7cb05e968724 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:13.273795 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a5e38d8b-6ad5-451c-bd1f-7cb05e968724 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:13.274234 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a5e38d8b-6ad5-451c-bd1f-7cb05e968724 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:13.304209 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a5e38d8b-6ad5-451c-bd1f-7cb05e968724 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043458 Feb 21 01:17:13.307701 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 569/1154] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:13 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:13.352265 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ec693e2f-5d05-425a-a857-2294758f9e57 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:13.353060 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ec693e2f-5d05-425a-a857-2294758f9e57 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:13.359280 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec693e2f-5d05-425a-a857-2294758f9e57 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:13.359724 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec693e2f-5d05-425a-a857-2294758f9e57 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:13.360536 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec693e2f-5d05-425a-a857-2294758f9e57 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:13.360964 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec693e2f-5d05-425a-a857-2294758f9e57 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:13.421243 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ec693e2f-5d05-425a-a857-2294758f9e57 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:13.428822 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ec693e2f-5d05-425a-a857-2294758f9e57 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081080 Feb 21 01:17:13.429381 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 586/1155] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:13 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:13.664177 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-01beb1c7-cc0e-4245-a5cb-cc88782f6b4b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:13.664711 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-01beb1c7-cc0e-4245-a5cb-cc88782f6b4b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:13.670600 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-01beb1c7-cc0e-4245-a5cb-cc88782f6b4b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:13.671053 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-01beb1c7-cc0e-4245-a5cb-cc88782f6b4b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:13.671860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-01beb1c7-cc0e-4245-a5cb-cc88782f6b4b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:13.672298 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-01beb1c7-cc0e-4245-a5cb-cc88782f6b4b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:13.804520 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-01beb1c7-cc0e-4245-a5cb-cc88782f6b4b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:13.812896 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-01beb1c7-cc0e-4245-a5cb-cc88782f6b4b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:13.814384 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-01beb1c7-cc0e-4245-a5cb-cc88782f6b4b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:13.815535 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-01beb1c7-cc0e-4245-a5cb-cc88782f6b4b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155553 Feb 21 01:17:13.816133 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 570/1156] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:13 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:14.315878 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e7f7f784-ccd6-45eb-b921-f2017237b7d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:14.316786 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e7f7f784-ccd6-45eb-b921-f2017237b7d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:14.322690 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7f7f784-ccd6-45eb-b921-f2017237b7d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:14.323199 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7f7f784-ccd6-45eb-b921-f2017237b7d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:14.323923 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7f7f784-ccd6-45eb-b921-f2017237b7d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:14.324351 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7f7f784-ccd6-45eb-b921-f2017237b7d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:14.353897 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e7f7f784-ccd6-45eb-b921-f2017237b7d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041753 Feb 21 01:17:14.354534 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 587/1157] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:14 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:14.445862 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-10d80f14-7b8a-4c20-8e5d-a63f39775bc9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:14.446424 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-10d80f14-7b8a-4c20-8e5d-a63f39775bc9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:14.452708 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-10d80f14-7b8a-4c20-8e5d-a63f39775bc9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:14.453160 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-10d80f14-7b8a-4c20-8e5d-a63f39775bc9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:14.453955 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-10d80f14-7b8a-4c20-8e5d-a63f39775bc9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:14.454388 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-10d80f14-7b8a-4c20-8e5d-a63f39775bc9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:14.516212 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-10d80f14-7b8a-4c20-8e5d-a63f39775bc9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:14.524270 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-10d80f14-7b8a-4c20-8e5d-a63f39775bc9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082790 Feb 21 01:17:14.524833 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 571/1158] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:14 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:14.834923 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0e7cdd78-bd2d-4000-ba2b-d83490a8577d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:14.835527 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0e7cdd78-bd2d-4000-ba2b-d83490a8577d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:14.841787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0e7cdd78-bd2d-4000-ba2b-d83490a8577d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:14.842242 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0e7cdd78-bd2d-4000-ba2b-d83490a8577d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:14.843022 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0e7cdd78-bd2d-4000-ba2b-d83490a8577d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:14.843449 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0e7cdd78-bd2d-4000-ba2b-d83490a8577d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:14.978150 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0e7cdd78-bd2d-4000-ba2b-d83490a8577d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:14.986560 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0e7cdd78-bd2d-4000-ba2b-d83490a8577d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:14.988075 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0e7cdd78-bd2d-4000-ba2b-d83490a8577d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:14.989228 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0e7cdd78-bd2d-4000-ba2b-d83490a8577d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158850 Feb 21 01:17:14.989785 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 588/1159] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:14 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:15.365547 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5c465259-c722-4eef-9c68-1e8260825f3b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:15.366471 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5c465259-c722-4eef-9c68-1e8260825f3b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:15.372489 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c465259-c722-4eef-9c68-1e8260825f3b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:15.372987 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c465259-c722-4eef-9c68-1e8260825f3b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:15.373774 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c465259-c722-4eef-9c68-1e8260825f3b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:15.374210 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c465259-c722-4eef-9c68-1e8260825f3b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:15.403629 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5c465259-c722-4eef-9c68-1e8260825f3b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041780 Feb 21 01:17:15.404223 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 572/1160] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:15 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:15.541590 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f62b469c-cb2d-4730-8b39-0e88d202f06b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:15.542222 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f62b469c-cb2d-4730-8b39-0e88d202f06b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:15.548209 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f62b469c-cb2d-4730-8b39-0e88d202f06b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:15.548661 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f62b469c-cb2d-4730-8b39-0e88d202f06b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:15.549445 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f62b469c-cb2d-4730-8b39-0e88d202f06b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:15.549878 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f62b469c-cb2d-4730-8b39-0e88d202f06b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:15.611984 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f62b469c-cb2d-4730-8b39-0e88d202f06b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:15.619379 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f62b469c-cb2d-4730-8b39-0e88d202f06b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081692 Feb 21 01:17:15.625739 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 589/1161] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:15 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:16.008119 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-dcc0d7b9-653f-4a5d-a87b-36f98ab127b3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:16.008769 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-dcc0d7b9-653f-4a5d-a87b-36f98ab127b3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:16.015027 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dcc0d7b9-653f-4a5d-a87b-36f98ab127b3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:16.015481 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dcc0d7b9-653f-4a5d-a87b-36f98ab127b3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:16.016305 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dcc0d7b9-653f-4a5d-a87b-36f98ab127b3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:16.016742 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dcc0d7b9-653f-4a5d-a87b-36f98ab127b3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:16.153433 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-dcc0d7b9-653f-4a5d-a87b-36f98ab127b3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:16.161554 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-dcc0d7b9-653f-4a5d-a87b-36f98ab127b3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:16.163201 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-dcc0d7b9-653f-4a5d-a87b-36f98ab127b3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:16.164388 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-dcc0d7b9-653f-4a5d-a87b-36f98ab127b3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.161143 Feb 21 01:17:16.164953 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 573/1162] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:16 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:16.415325 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4fe1f1f8-4dcb-4177-a86c-cfdf9caf0885 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:16.416929 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4fe1f1f8-4dcb-4177-a86c-cfdf9caf0885 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:16.423430 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4fe1f1f8-4dcb-4177-a86c-cfdf9caf0885 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:16.424496 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4fe1f1f8-4dcb-4177-a86c-cfdf9caf0885 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:16.425486 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4fe1f1f8-4dcb-4177-a86c-cfdf9caf0885 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:16.425932 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4fe1f1f8-4dcb-4177-a86c-cfdf9caf0885 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:16.455285 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4fe1f1f8-4dcb-4177-a86c-cfdf9caf0885 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044248 Feb 21 01:17:16.455860 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 590/1163] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:16 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:16.641300 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2e0652d3-2407-4701-a169-c29b31473680 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:16.641822 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2e0652d3-2407-4701-a169-c29b31473680 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:16.648411 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2e0652d3-2407-4701-a169-c29b31473680 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:16.648859 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2e0652d3-2407-4701-a169-c29b31473680 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:16.649643 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2e0652d3-2407-4701-a169-c29b31473680 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:16.650073 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2e0652d3-2407-4701-a169-c29b31473680 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:16.712634 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2e0652d3-2407-4701-a169-c29b31473680 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:16.719988 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2e0652d3-2407-4701-a169-c29b31473680 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082448 Feb 21 01:17:16.720547 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 574/1164] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:16 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:17.182725 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fc4f49f3-4d49-495c-ad3b-6f45447221f6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:17.183346 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fc4f49f3-4d49-495c-ad3b-6f45447221f6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:17.189261 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fc4f49f3-4d49-495c-ad3b-6f45447221f6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:17.192597 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fc4f49f3-4d49-495c-ad3b-6f45447221f6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:17.192597 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fc4f49f3-4d49-495c-ad3b-6f45447221f6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:17.192597 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fc4f49f3-4d49-495c-ad3b-6f45447221f6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:17.328570 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fc4f49f3-4d49-495c-ad3b-6f45447221f6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:17.337565 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fc4f49f3-4d49-495c-ad3b-6f45447221f6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:17.339050 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fc4f49f3-4d49-495c-ad3b-6f45447221f6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:17.340272 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-fc4f49f3-4d49-495c-ad3b-6f45447221f6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.162131 Feb 21 01:17:17.340822 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 591/1165] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:17 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:17:17.466855 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-29360db3-6e57-41e2-89c1-4fab4d40fb08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:17.467783 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-29360db3-6e57-41e2-89c1-4fab4d40fb08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:17.473652 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-29360db3-6e57-41e2-89c1-4fab4d40fb08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:17.474100 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-29360db3-6e57-41e2-89c1-4fab4d40fb08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:17.474882 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-29360db3-6e57-41e2-89c1-4fab4d40fb08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:17.475350 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-29360db3-6e57-41e2-89c1-4fab4d40fb08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:17.504117 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-29360db3-6e57-41e2-89c1-4fab4d40fb08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041083 Feb 21 01:17:17.504683 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 575/1166] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:17 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:17.735986 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-387f57ba-1b9c-4fd1-87bd-1ee41879ba53 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:17.736505 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-387f57ba-1b9c-4fd1-87bd-1ee41879ba53 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:17.743533 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-387f57ba-1b9c-4fd1-87bd-1ee41879ba53 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:17.744023 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-387f57ba-1b9c-4fd1-87bd-1ee41879ba53 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:17.744810 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-387f57ba-1b9c-4fd1-87bd-1ee41879ba53 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:17.745283 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-387f57ba-1b9c-4fd1-87bd-1ee41879ba53 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:17.805589 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-387f57ba-1b9c-4fd1-87bd-1ee41879ba53 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:17.812917 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-387f57ba-1b9c-4fd1-87bd-1ee41879ba53 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080645 Feb 21 01:17:17.813469 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 592/1167] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:17 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:18.358491 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a6baa4b4-66e2-4f85-b5f4-4df7bed31a90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:18.358753 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a6baa4b4-66e2-4f85-b5f4-4df7bed31a90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:18.364822 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a6baa4b4-66e2-4f85-b5f4-4df7bed31a90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:18.365276 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a6baa4b4-66e2-4f85-b5f4-4df7bed31a90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:18.366105 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a6baa4b4-66e2-4f85-b5f4-4df7bed31a90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:18.366537 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a6baa4b4-66e2-4f85-b5f4-4df7bed31a90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:18.501670 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a6baa4b4-66e2-4f85-b5f4-4df7bed31a90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:18.509860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a6baa4b4-66e2-4f85-b5f4-4df7bed31a90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:18.511514 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a6baa4b4-66e2-4f85-b5f4-4df7bed31a90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:18.512702 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a6baa4b4-66e2-4f85-b5f4-4df7bed31a90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158283 Feb 21 01:17:18.513250 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 576/1168] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:18 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:18.516245 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0a5ef531-4205-4edc-b09a-e296be53f96a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:18.517213 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0a5ef531-4205-4edc-b09a-e296be53f96a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:18.524174 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a5ef531-4205-4edc-b09a-e296be53f96a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:18.524630 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a5ef531-4205-4edc-b09a-e296be53f96a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:18.525431 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a5ef531-4205-4edc-b09a-e296be53f96a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:18.525868 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a5ef531-4205-4edc-b09a-e296be53f96a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:18.556347 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0a5ef531-4205-4edc-b09a-e296be53f96a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044004 Feb 21 01:17:18.556908 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 593/1169] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:18 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:17:18.829884 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8e2b386f-a108-409c-94dc-5bd4c68fe119 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:18.830481 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8e2b386f-a108-409c-94dc-5bd4c68fe119 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:18.837100 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8e2b386f-a108-409c-94dc-5bd4c68fe119 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:18.837559 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8e2b386f-a108-409c-94dc-5bd4c68fe119 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:18.838327 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8e2b386f-a108-409c-94dc-5bd4c68fe119 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:18.838758 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8e2b386f-a108-409c-94dc-5bd4c68fe119 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:18.897924 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8e2b386f-a108-409c-94dc-5bd4c68fe119 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:18.905832 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8e2b386f-a108-409c-94dc-5bd4c68fe119 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079613 Feb 21 01:17:18.906400 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 577/1170] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:18 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:19.531436 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2c588219-7646-4d4c-a3f0-516b2b9989d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:19.532086 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2c588219-7646-4d4c-a3f0-516b2b9989d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:19.538410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2c588219-7646-4d4c-a3f0-516b2b9989d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:19.538847 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2c588219-7646-4d4c-a3f0-516b2b9989d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:19.539615 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2c588219-7646-4d4c-a3f0-516b2b9989d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:19.540061 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2c588219-7646-4d4c-a3f0-516b2b9989d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:19.567652 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c6365c80-8356-464e-8a26-33ba55d4cf50 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:19.568594 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c6365c80-8356-464e-8a26-33ba55d4cf50 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:19.574939 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c6365c80-8356-464e-8a26-33ba55d4cf50 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:19.575381 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c6365c80-8356-464e-8a26-33ba55d4cf50 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:19.576204 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c6365c80-8356-464e-8a26-33ba55d4cf50 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:19.576632 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c6365c80-8356-464e-8a26-33ba55d4cf50 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:19.608219 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c6365c80-8356-464e-8a26-33ba55d4cf50 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044178 Feb 21 01:17:19.608700 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 578/1171] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:19 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:17:19.674764 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2c588219-7646-4d4c-a3f0-516b2b9989d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:19.683993 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2c588219-7646-4d4c-a3f0-516b2b9989d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:19.685476 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2c588219-7646-4d4c-a3f0-516b2b9989d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:19.686620 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2c588219-7646-4d4c-a3f0-516b2b9989d8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159115 Feb 21 01:17:19.687176 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 594/1172] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:19 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:19.922462 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-083e635d-f357-4094-9501-ac867cbe4728 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:19.923011 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-083e635d-f357-4094-9501-ac867cbe4728 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:19.929481 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-083e635d-f357-4094-9501-ac867cbe4728 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:19.929918 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-083e635d-f357-4094-9501-ac867cbe4728 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:19.930687 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-083e635d-f357-4094-9501-ac867cbe4728 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:19.931107 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-083e635d-f357-4094-9501-ac867cbe4728 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:19.989774 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-083e635d-f357-4094-9501-ac867cbe4728 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:19.997629 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-083e635d-f357-4094-9501-ac867cbe4728 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.078944 Feb 21 01:17:19.998205 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 579/1173] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:19 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:20.620006 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6f3adf1d-66a4-415e-bcf8-36eb15dba5ac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:20.620834 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6f3adf1d-66a4-415e-bcf8-36eb15dba5ac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:20.626888 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6f3adf1d-66a4-415e-bcf8-36eb15dba5ac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:20.627334 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6f3adf1d-66a4-415e-bcf8-36eb15dba5ac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:20.628151 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6f3adf1d-66a4-415e-bcf8-36eb15dba5ac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:20.628585 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6f3adf1d-66a4-415e-bcf8-36eb15dba5ac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:20.658146 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6f3adf1d-66a4-415e-bcf8-36eb15dba5ac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042495 Feb 21 01:17:20.658689 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 595/1174] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:20 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:20.705334 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8dc4fabb-0f5c-4e45-bb9a-9dd46a00364f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:20.705938 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8dc4fabb-0f5c-4e45-bb9a-9dd46a00364f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:20.713010 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8dc4fabb-0f5c-4e45-bb9a-9dd46a00364f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:20.713459 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8dc4fabb-0f5c-4e45-bb9a-9dd46a00364f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:20.714243 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8dc4fabb-0f5c-4e45-bb9a-9dd46a00364f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:20.714672 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8dc4fabb-0f5c-4e45-bb9a-9dd46a00364f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:20.845879 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8dc4fabb-0f5c-4e45-bb9a-9dd46a00364f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:20.854633 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8dc4fabb-0f5c-4e45-bb9a-9dd46a00364f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:20.856141 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8dc4fabb-0f5c-4e45-bb9a-9dd46a00364f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:20.857298 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8dc4fabb-0f5c-4e45-bb9a-9dd46a00364f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155863 Feb 21 01:17:20.857852 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 580/1175] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:20 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:21.014775 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c59e1b8d-0d8f-4cf7-bc0b-63eeabf439b7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:21.015389 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c59e1b8d-0d8f-4cf7-bc0b-63eeabf439b7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:21.021210 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c59e1b8d-0d8f-4cf7-bc0b-63eeabf439b7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:21.021653 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c59e1b8d-0d8f-4cf7-bc0b-63eeabf439b7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:21.023081 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c59e1b8d-0d8f-4cf7-bc0b-63eeabf439b7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:21.023541 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c59e1b8d-0d8f-4cf7-bc0b-63eeabf439b7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:21.086181 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c59e1b8d-0d8f-4cf7-bc0b-63eeabf439b7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:21.093401 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c59e1b8d-0d8f-4cf7-bc0b-63eeabf439b7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082343 Feb 21 01:17:21.093964 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 596/1176] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:21 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:17:21.669566 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d4a75d58-1a38-4637-9061-ed78e13b4bfb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:21.670398 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d4a75d58-1a38-4637-9061-ed78e13b4bfb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:21.676246 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d4a75d58-1a38-4637-9061-ed78e13b4bfb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:21.676695 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d4a75d58-1a38-4637-9061-ed78e13b4bfb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:21.677478 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d4a75d58-1a38-4637-9061-ed78e13b4bfb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:21.677916 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d4a75d58-1a38-4637-9061-ed78e13b4bfb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:21.707786 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d4a75d58-1a38-4637-9061-ed78e13b4bfb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042128 Feb 21 01:17:21.708452 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 581/1177] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:21 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:21.875624 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b32d14dd-0b64-439b-a04b-e0bd10f68b14 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:21.876248 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b32d14dd-0b64-439b-a04b-e0bd10f68b14 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:21.883309 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b32d14dd-0b64-439b-a04b-e0bd10f68b14 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:21.883755 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b32d14dd-0b64-439b-a04b-e0bd10f68b14 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:21.884555 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b32d14dd-0b64-439b-a04b-e0bd10f68b14 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:21.884979 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b32d14dd-0b64-439b-a04b-e0bd10f68b14 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:22.020144 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b32d14dd-0b64-439b-a04b-e0bd10f68b14 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:22.030165 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b32d14dd-0b64-439b-a04b-e0bd10f68b14 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:22.031718 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b32d14dd-0b64-439b-a04b-e0bd10f68b14 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:22.032874 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b32d14dd-0b64-439b-a04b-e0bd10f68b14 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.161001 Feb 21 01:17:22.033430 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 597/1178] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:21 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:22.109724 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-03b5dc0b-06b7-4b2f-81ed-fd5725eceacb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:22.110341 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-03b5dc0b-06b7-4b2f-81ed-fd5725eceacb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:22.117350 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-03b5dc0b-06b7-4b2f-81ed-fd5725eceacb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:22.117800 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-03b5dc0b-06b7-4b2f-81ed-fd5725eceacb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:22.118583 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-03b5dc0b-06b7-4b2f-81ed-fd5725eceacb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:22.119018 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-03b5dc0b-06b7-4b2f-81ed-fd5725eceacb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:22.182954 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-03b5dc0b-06b7-4b2f-81ed-fd5725eceacb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:22.190334 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-03b5dc0b-06b7-4b2f-81ed-fd5725eceacb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084251 Feb 21 01:17:22.190894 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 582/1179] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:22 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:22.718711 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b65d50f1-12e2-4b88-9afd-f4618479f894 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:22.719630 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b65d50f1-12e2-4b88-9afd-f4618479f894 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:22.726601 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b65d50f1-12e2-4b88-9afd-f4618479f894 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:22.727052 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b65d50f1-12e2-4b88-9afd-f4618479f894 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:22.727855 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b65d50f1-12e2-4b88-9afd-f4618479f894 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:22.728299 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b65d50f1-12e2-4b88-9afd-f4618479f894 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:22.758034 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b65d50f1-12e2-4b88-9afd-f4618479f894 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043063 Feb 21 01:17:22.758583 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 598/1180] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:22 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:23.056094 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-92228c76-c099-4b17-9614-c6203ff67e8a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:23.056678 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-92228c76-c099-4b17-9614-c6203ff67e8a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:23.062511 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-92228c76-c099-4b17-9614-c6203ff67e8a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:23.062950 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-92228c76-c099-4b17-9614-c6203ff67e8a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:23.063724 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-92228c76-c099-4b17-9614-c6203ff67e8a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:23.064179 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-92228c76-c099-4b17-9614-c6203ff67e8a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:23.193322 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-92228c76-c099-4b17-9614-c6203ff67e8a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:23.201951 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-92228c76-c099-4b17-9614-c6203ff67e8a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:23.203434 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-92228c76-c099-4b17-9614-c6203ff67e8a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:23.204603 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-92228c76-c099-4b17-9614-c6203ff67e8a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.152366 Feb 21 01:17:23.205148 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 583/1181] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:23 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:17:23.207685 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8529c917-ce36-4cae-bfa9-e587a7453ac0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:23.208411 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8529c917-ce36-4cae-bfa9-e587a7453ac0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:23.216025 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8529c917-ce36-4cae-bfa9-e587a7453ac0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:23.216479 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8529c917-ce36-4cae-bfa9-e587a7453ac0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:23.217312 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8529c917-ce36-4cae-bfa9-e587a7453ac0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:23.217724 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8529c917-ce36-4cae-bfa9-e587a7453ac0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:23.277071 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8529c917-ce36-4cae-bfa9-e587a7453ac0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:23.284539 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8529c917-ce36-4cae-bfa9-e587a7453ac0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080843 Feb 21 01:17:23.285102 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 599/1182] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:23 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:17:23.769344 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8e385698-0eed-41fe-b975-a9908e1eebbb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:23.770261 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8e385698-0eed-41fe-b975-a9908e1eebbb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:23.776300 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8e385698-0eed-41fe-b975-a9908e1eebbb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:23.776741 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8e385698-0eed-41fe-b975-a9908e1eebbb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:23.777523 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8e385698-0eed-41fe-b975-a9908e1eebbb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:23.777952 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8e385698-0eed-41fe-b975-a9908e1eebbb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:23.808160 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8e385698-0eed-41fe-b975-a9908e1eebbb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042500 Feb 21 01:17:23.808756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 584/1183] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:23 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:24.222246 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-117949ed-8277-4141-a9fd-bcc37b04dc17 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:24.222848 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-117949ed-8277-4141-a9fd-bcc37b04dc17 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:24.229299 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-117949ed-8277-4141-a9fd-bcc37b04dc17 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:24.229751 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-117949ed-8277-4141-a9fd-bcc37b04dc17 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:24.230527 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-117949ed-8277-4141-a9fd-bcc37b04dc17 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:24.230952 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-117949ed-8277-4141-a9fd-bcc37b04dc17 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:24.300580 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-62041c2c-6864-47ad-a6e4-d428d8acf73b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:24.301176 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-62041c2c-6864-47ad-a6e4-d428d8acf73b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:24.308111 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-62041c2c-6864-47ad-a6e4-d428d8acf73b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:24.308558 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-62041c2c-6864-47ad-a6e4-d428d8acf73b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:24.309338 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-62041c2c-6864-47ad-a6e4-d428d8acf73b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:24.309766 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-62041c2c-6864-47ad-a6e4-d428d8acf73b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:24.371418 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-62041c2c-6864-47ad-a6e4-d428d8acf73b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:24.379204 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-62041c2c-6864-47ad-a6e4-d428d8acf73b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082187 Feb 21 01:17:24.379787 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 585/1184] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:24 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:17:24.602349 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-117949ed-8277-4141-a9fd-bcc37b04dc17 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:24.610504 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-117949ed-8277-4141-a9fd-bcc37b04dc17 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:24.612031 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-117949ed-8277-4141-a9fd-bcc37b04dc17 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:24.613222 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-117949ed-8277-4141-a9fd-bcc37b04dc17 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.394696 Feb 21 01:17:24.613778 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 600/1185] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:24 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:24.818863 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1201d528-968d-4ef9-8169-00b5a1019060 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:24.819777 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1201d528-968d-4ef9-8169-00b5a1019060 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:24.825662 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1201d528-968d-4ef9-8169-00b5a1019060 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:24.826113 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1201d528-968d-4ef9-8169-00b5a1019060 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:24.826922 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1201d528-968d-4ef9-8169-00b5a1019060 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:24.827323 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1201d528-968d-4ef9-8169-00b5a1019060 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:24.856428 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1201d528-968d-4ef9-8169-00b5a1019060 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041290 Feb 21 01:17:24.856904 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 586/1186] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:24 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:25.396028 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-30021f61-1f1b-457e-8f2b-a101eec8b030 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:25.396648 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-30021f61-1f1b-457e-8f2b-a101eec8b030 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:25.403811 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-30021f61-1f1b-457e-8f2b-a101eec8b030 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:25.404303 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-30021f61-1f1b-457e-8f2b-a101eec8b030 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:25.405096 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-30021f61-1f1b-457e-8f2b-a101eec8b030 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:25.405533 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-30021f61-1f1b-457e-8f2b-a101eec8b030 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:25.464893 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-30021f61-1f1b-457e-8f2b-a101eec8b030 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:25.472304 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-30021f61-1f1b-457e-8f2b-a101eec8b030 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079904 Feb 21 01:17:25.472863 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 601/1187] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:25 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:25.633020 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b6a6bbaa-54a8-4cc7-b8b9-2d4d93dd75b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:25.633568 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b6a6bbaa-54a8-4cc7-b8b9-2d4d93dd75b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:25.639957 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b6a6bbaa-54a8-4cc7-b8b9-2d4d93dd75b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:25.640409 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b6a6bbaa-54a8-4cc7-b8b9-2d4d93dd75b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:25.641201 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b6a6bbaa-54a8-4cc7-b8b9-2d4d93dd75b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:25.641635 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b6a6bbaa-54a8-4cc7-b8b9-2d4d93dd75b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:25.672791 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:17:25.673032 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:17:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 (ip 10.222.0.91) !!! Feb 21 01:17:25.778570 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b6a6bbaa-54a8-4cc7-b8b9-2d4d93dd75b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:25.786709 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b6a6bbaa-54a8-4cc7-b8b9-2d4d93dd75b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:25.788891 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b6a6bbaa-54a8-4cc7-b8b9-2d4d93dd75b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:25.790045 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b6a6bbaa-54a8-4cc7-b8b9-2d4d93dd75b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.161364 Feb 21 01:17:25.790589 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 587/1188] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:25 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:17:25.867973 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a588b2d0-f83c-43c8-9cf5-312b207a8ad9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:25.868882 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a588b2d0-f83c-43c8-9cf5-312b207a8ad9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:25.874965 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a588b2d0-f83c-43c8-9cf5-312b207a8ad9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:25.877844 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a588b2d0-f83c-43c8-9cf5-312b207a8ad9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:25.877844 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a588b2d0-f83c-43c8-9cf5-312b207a8ad9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:25.877844 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a588b2d0-f83c-43c8-9cf5-312b207a8ad9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:25.907370 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a588b2d0-f83c-43c8-9cf5-312b207a8ad9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043280 Feb 21 01:17:25.907858 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 602/1189] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:25 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:26.489519 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3568405e-ca5f-4666-a227-11250ca753c9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:26.490131 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3568405e-ca5f-4666-a227-11250ca753c9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:26.496855 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3568405e-ca5f-4666-a227-11250ca753c9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:26.497303 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3568405e-ca5f-4666-a227-11250ca753c9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:26.498081 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3568405e-ca5f-4666-a227-11250ca753c9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:26.498515 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3568405e-ca5f-4666-a227-11250ca753c9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:26.557775 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3568405e-ca5f-4666-a227-11250ca753c9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:26.565172 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3568405e-ca5f-4666-a227-11250ca753c9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079383 Feb 21 01:17:26.565732 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 588/1190] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:26 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:26.808003 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-27e002ae-c587-48c0-a171-c433ca55bc03 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:26.808632 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-27e002ae-c587-48c0-a171-c433ca55bc03 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:26.814981 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-27e002ae-c587-48c0-a171-c433ca55bc03 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:26.815434 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-27e002ae-c587-48c0-a171-c433ca55bc03 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:26.816348 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-27e002ae-c587-48c0-a171-c433ca55bc03 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:26.816788 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-27e002ae-c587-48c0-a171-c433ca55bc03 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:26.918423 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-454b42a0-a1c3-40c8-b77d-dc19b1857a46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:26.919336 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-454b42a0-a1c3-40c8-b77d-dc19b1857a46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:26.925285 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-454b42a0-a1c3-40c8-b77d-dc19b1857a46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:26.925728 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-454b42a0-a1c3-40c8-b77d-dc19b1857a46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:26.926509 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-454b42a0-a1c3-40c8-b77d-dc19b1857a46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:26.926935 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-454b42a0-a1c3-40c8-b77d-dc19b1857a46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:26.949126 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-27e002ae-c587-48c0-a171-c433ca55bc03 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:26.955872 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-454b42a0-a1c3-40c8-b77d-dc19b1857a46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041158 Feb 21 01:17:26.956439 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 589/1191] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:26 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:17:26.957117 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-27e002ae-c587-48c0-a171-c433ca55bc03 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:26.958672 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-27e002ae-c587-48c0-a171-c433ca55bc03 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:26.959915 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-27e002ae-c587-48c0-a171-c433ca55bc03 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155709 Feb 21 01:17:26.961108 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 603/1192] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:26 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:27.581772 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-56130826-3a6c-4f5f-a42b-bc97816975f7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:27.582373 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-56130826-3a6c-4f5f-a42b-bc97816975f7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:27.588656 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-56130826-3a6c-4f5f-a42b-bc97816975f7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:27.589096 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-56130826-3a6c-4f5f-a42b-bc97816975f7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:27.589867 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-56130826-3a6c-4f5f-a42b-bc97816975f7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:27.590291 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-56130826-3a6c-4f5f-a42b-bc97816975f7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:27.650194 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-56130826-3a6c-4f5f-a42b-bc97816975f7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:27.657785 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-56130826-3a6c-4f5f-a42b-bc97816975f7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079654 Feb 21 01:17:27.658487 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 590/1193] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:27 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:27.967600 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b18d78eb-1ba1-4505-9ba0-b16c20995de4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:27.968634 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b18d78eb-1ba1-4505-9ba0-b16c20995de4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:27.975188 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b18d78eb-1ba1-4505-9ba0-b16c20995de4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:27.975776 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b18d78eb-1ba1-4505-9ba0-b16c20995de4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:27.976635 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b18d78eb-1ba1-4505-9ba0-b16c20995de4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:27.977069 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b18d78eb-1ba1-4505-9ba0-b16c20995de4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:27.978191 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4bbf307b-c0d7-4710-ba8a-e2ab75caf908 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:27.978792 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4bbf307b-c0d7-4710-ba8a-e2ab75caf908 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:27.984915 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4bbf307b-c0d7-4710-ba8a-e2ab75caf908 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:27.985348 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4bbf307b-c0d7-4710-ba8a-e2ab75caf908 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:27.986128 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4bbf307b-c0d7-4710-ba8a-e2ab75caf908 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:27.986617 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4bbf307b-c0d7-4710-ba8a-e2ab75caf908 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:28.008007 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b18d78eb-1ba1-4505-9ba0-b16c20995de4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043339 Feb 21 01:17:28.008953 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 604/1194] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:27 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:28.118400 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4bbf307b-c0d7-4710-ba8a-e2ab75caf908 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:28.126510 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4bbf307b-c0d7-4710-ba8a-e2ab75caf908 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:28.128036 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4bbf307b-c0d7-4710-ba8a-e2ab75caf908 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:28.129188 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4bbf307b-c0d7-4710-ba8a-e2ab75caf908 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.154707 Feb 21 01:17:28.129754 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 591/1195] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:27 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:17:28.675177 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-00e86be7-99a8-4be1-9dcf-35fe209efde4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:28.675684 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-00e86be7-99a8-4be1-9dcf-35fe209efde4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:28.682002 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-00e86be7-99a8-4be1-9dcf-35fe209efde4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:28.682454 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-00e86be7-99a8-4be1-9dcf-35fe209efde4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:28.683237 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-00e86be7-99a8-4be1-9dcf-35fe209efde4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:28.683700 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-00e86be7-99a8-4be1-9dcf-35fe209efde4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:28.747644 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-00e86be7-99a8-4be1-9dcf-35fe209efde4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:28.755003 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-00e86be7-99a8-4be1-9dcf-35fe209efde4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083623 Feb 21 01:17:28.755555 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 605/1196] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:28 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:29.018453 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-92bcb737-8fa7-4fb5-80a7-895e4d8964b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:29.019362 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-92bcb737-8fa7-4fb5-80a7-895e4d8964b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:29.025841 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-92bcb737-8fa7-4fb5-80a7-895e4d8964b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:29.026276 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-92bcb737-8fa7-4fb5-80a7-895e4d8964b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:29.027051 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-92bcb737-8fa7-4fb5-80a7-895e4d8964b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:29.027479 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-92bcb737-8fa7-4fb5-80a7-895e4d8964b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:29.059699 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-92bcb737-8fa7-4fb5-80a7-895e4d8964b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044967 Feb 21 01:17:29.060273 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 592/1197] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:29 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:29.147066 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0fd62fb4-686f-4cbf-a715-769c532d96a8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:29.147692 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0fd62fb4-686f-4cbf-a715-769c532d96a8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:29.154326 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0fd62fb4-686f-4cbf-a715-769c532d96a8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:29.154776 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0fd62fb4-686f-4cbf-a715-769c532d96a8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:29.155556 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0fd62fb4-686f-4cbf-a715-769c532d96a8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:29.156026 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0fd62fb4-686f-4cbf-a715-769c532d96a8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:29.286431 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0fd62fb4-686f-4cbf-a715-769c532d96a8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:29.295389 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0fd62fb4-686f-4cbf-a715-769c532d96a8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:29.296896 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0fd62fb4-686f-4cbf-a715-769c532d96a8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:29.298047 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0fd62fb4-686f-4cbf-a715-769c532d96a8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.154695 Feb 21 01:17:29.298602 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 606/1198] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:29 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:29.771618 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3e8c07dd-8dcd-4f6e-a707-7b75edfbd23d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:29.772253 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3e8c07dd-8dcd-4f6e-a707-7b75edfbd23d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:29.779528 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3e8c07dd-8dcd-4f6e-a707-7b75edfbd23d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:29.780017 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3e8c07dd-8dcd-4f6e-a707-7b75edfbd23d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:29.780796 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3e8c07dd-8dcd-4f6e-a707-7b75edfbd23d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:29.781228 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3e8c07dd-8dcd-4f6e-a707-7b75edfbd23d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:29.845900 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3e8c07dd-8dcd-4f6e-a707-7b75edfbd23d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:29.853118 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3e8c07dd-8dcd-4f6e-a707-7b75edfbd23d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.085411 Feb 21 01:17:29.853669 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 593/1199] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:29 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:30.000871 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:17:30.001083 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:17:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:17:30.070533 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-cb9c8f79-918e-4ae1-b9e5-4149cc09edd5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:30.071560 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-cb9c8f79-918e-4ae1-b9e5-4149cc09edd5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:30.077468 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cb9c8f79-918e-4ae1-b9e5-4149cc09edd5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:30.077914 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cb9c8f79-918e-4ae1-b9e5-4149cc09edd5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:30.078687 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cb9c8f79-918e-4ae1-b9e5-4149cc09edd5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:30.079119 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cb9c8f79-918e-4ae1-b9e5-4149cc09edd5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:30.108019 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-cb9c8f79-918e-4ae1-b9e5-4149cc09edd5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041197 Feb 21 01:17:30.108491 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 607/1200] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:30 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:30.317083 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-45b53e8a-accb-4d70-bd75-00c80d49d8b8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:30.317679 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-45b53e8a-accb-4d70-bd75-00c80d49d8b8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:30.324114 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-45b53e8a-accb-4d70-bd75-00c80d49d8b8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:30.324555 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-45b53e8a-accb-4d70-bd75-00c80d49d8b8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:30.325317 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-45b53e8a-accb-4d70-bd75-00c80d49d8b8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:30.325740 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-45b53e8a-accb-4d70-bd75-00c80d49d8b8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:30.457332 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-45b53e8a-accb-4d70-bd75-00c80d49d8b8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:30.466070 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-45b53e8a-accb-4d70-bd75-00c80d49d8b8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:30.467573 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-45b53e8a-accb-4d70-bd75-00c80d49d8b8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:30.468743 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-45b53e8a-accb-4d70-bd75-00c80d49d8b8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155434 Feb 21 01:17:30.469288 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 594/1201] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:30 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:30.870152 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-148f4642-c570-4d5c-9247-88e974cc411f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:30.870763 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-148f4642-c570-4d5c-9247-88e974cc411f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:30.877098 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-148f4642-c570-4d5c-9247-88e974cc411f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:30.877542 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-148f4642-c570-4d5c-9247-88e974cc411f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:30.878317 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-148f4642-c570-4d5c-9247-88e974cc411f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:30.878747 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-148f4642-c570-4d5c-9247-88e974cc411f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:30.939103 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-148f4642-c570-4d5c-9247-88e974cc411f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:30.946714 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-148f4642-c570-4d5c-9247-88e974cc411f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080789 Feb 21 01:17:30.947318 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 608/1202] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:30 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:31.119523 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c14a6e85-05da-4778-86b0-28c3ded34bdc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:31.120470 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c14a6e85-05da-4778-86b0-28c3ded34bdc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:31.126340 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c14a6e85-05da-4778-86b0-28c3ded34bdc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:31.126782 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c14a6e85-05da-4778-86b0-28c3ded34bdc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:31.127563 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c14a6e85-05da-4778-86b0-28c3ded34bdc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:31.128029 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c14a6e85-05da-4778-86b0-28c3ded34bdc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:31.157322 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c14a6e85-05da-4778-86b0-28c3ded34bdc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041893 Feb 21 01:17:31.157865 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 595/1203] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:31 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:31.486418 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8eeb18bf-3ed5-46ea-a79f-9a5010fa349f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:31.487028 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8eeb18bf-3ed5-46ea-a79f-9a5010fa349f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:31.493701 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8eeb18bf-3ed5-46ea-a79f-9a5010fa349f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:31.494137 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8eeb18bf-3ed5-46ea-a79f-9a5010fa349f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:31.494915 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8eeb18bf-3ed5-46ea-a79f-9a5010fa349f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:31.495342 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8eeb18bf-3ed5-46ea-a79f-9a5010fa349f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:31.635815 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8eeb18bf-3ed5-46ea-a79f-9a5010fa349f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:31.645212 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8eeb18bf-3ed5-46ea-a79f-9a5010fa349f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:31.646684 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8eeb18bf-3ed5-46ea-a79f-9a5010fa349f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:31.648076 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8eeb18bf-3ed5-46ea-a79f-9a5010fa349f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.165208 Feb 21 01:17:31.648787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 609/1204] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:31 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:31.964765 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e3a4e3c7-8234-404e-ae6f-2ea107040ce8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:31.965324 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e3a4e3c7-8234-404e-ae6f-2ea107040ce8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:31.972128 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e3a4e3c7-8234-404e-ae6f-2ea107040ce8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:31.972868 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e3a4e3c7-8234-404e-ae6f-2ea107040ce8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:31.973528 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e3a4e3c7-8234-404e-ae6f-2ea107040ce8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:31.973961 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e3a4e3c7-8234-404e-ae6f-2ea107040ce8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:32.044525 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e3a4e3c7-8234-404e-ae6f-2ea107040ce8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:32.052558 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e3a4e3c7-8234-404e-ae6f-2ea107040ce8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.092852 Feb 21 01:17:32.053145 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 596/1205] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:31 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:32.169366 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0e966b86-4fec-4b81-9cbf-a04f64bb458b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:32.170285 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0e966b86-4fec-4b81-9cbf-a04f64bb458b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:32.176571 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0e966b86-4fec-4b81-9cbf-a04f64bb458b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:32.177020 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0e966b86-4fec-4b81-9cbf-a04f64bb458b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:32.177809 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0e966b86-4fec-4b81-9cbf-a04f64bb458b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:32.178243 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0e966b86-4fec-4b81-9cbf-a04f64bb458b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:32.207447 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0e966b86-4fec-4b81-9cbf-a04f64bb458b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042099 Feb 21 01:17:32.208028 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 610/1206] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:32 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:32.668067 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f3b44bce-cd51-458a-a00e-ac0d837323d3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:32.668578 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f3b44bce-cd51-458a-a00e-ac0d837323d3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:32.674575 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f3b44bce-cd51-458a-a00e-ac0d837323d3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:32.675021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f3b44bce-cd51-458a-a00e-ac0d837323d3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:32.675783 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f3b44bce-cd51-458a-a00e-ac0d837323d3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:32.676233 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f3b44bce-cd51-458a-a00e-ac0d837323d3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:32.813050 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f3b44bce-cd51-458a-a00e-ac0d837323d3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:32.821584 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f3b44bce-cd51-458a-a00e-ac0d837323d3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:32.823095 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f3b44bce-cd51-458a-a00e-ac0d837323d3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:32.824273 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f3b44bce-cd51-458a-a00e-ac0d837323d3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160077 Feb 21 01:17:32.824824 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 597/1207] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:32 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:33.068743 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9d87d710-59ef-4e42-bc76-182401797b28 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:33.069379 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9d87d710-59ef-4e42-bc76-182401797b28 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:33.075224 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d87d710-59ef-4e42-bc76-182401797b28 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:33.075664 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d87d710-59ef-4e42-bc76-182401797b28 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:33.076461 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d87d710-59ef-4e42-bc76-182401797b28 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:33.076889 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d87d710-59ef-4e42-bc76-182401797b28 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:33.138799 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9d87d710-59ef-4e42-bc76-182401797b28 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:33.146218 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9d87d710-59ef-4e42-bc76-182401797b28 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081309 Feb 21 01:17:33.146768 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 611/1208] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:33 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:33.219707 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e2eda2cd-eb8b-4d36-b63a-a18f9261aa10 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:33.220656 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e2eda2cd-eb8b-4d36-b63a-a18f9261aa10 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:33.227590 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e2eda2cd-eb8b-4d36-b63a-a18f9261aa10 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:33.228076 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e2eda2cd-eb8b-4d36-b63a-a18f9261aa10 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:33.228855 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e2eda2cd-eb8b-4d36-b63a-a18f9261aa10 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:33.229292 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e2eda2cd-eb8b-4d36-b63a-a18f9261aa10 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:33.258262 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e2eda2cd-eb8b-4d36-b63a-a18f9261aa10 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042340 Feb 21 01:17:33.258818 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 598/1209] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:33 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:33.843098 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e0cb8582-0a0e-4127-ae53-0c4217e66fc1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:33.843680 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e0cb8582-0a0e-4127-ae53-0c4217e66fc1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:33.849946 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e0cb8582-0a0e-4127-ae53-0c4217e66fc1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:33.850384 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e0cb8582-0a0e-4127-ae53-0c4217e66fc1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:33.851250 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e0cb8582-0a0e-4127-ae53-0c4217e66fc1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:33.851668 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e0cb8582-0a0e-4127-ae53-0c4217e66fc1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:33.984875 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e0cb8582-0a0e-4127-ae53-0c4217e66fc1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:33.993978 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e0cb8582-0a0e-4127-ae53-0c4217e66fc1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:33.995462 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e0cb8582-0a0e-4127-ae53-0c4217e66fc1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:33.996649 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e0cb8582-0a0e-4127-ae53-0c4217e66fc1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157272 Feb 21 01:17:33.997201 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 612/1210] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:33 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:34.162499 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-be81b429-9410-4dc4-a418-a24dedf66135 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:34.163026 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-be81b429-9410-4dc4-a418-a24dedf66135 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:34.169005 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-be81b429-9410-4dc4-a418-a24dedf66135 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:34.169453 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-be81b429-9410-4dc4-a418-a24dedf66135 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:34.170232 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-be81b429-9410-4dc4-a418-a24dedf66135 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:34.170663 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-be81b429-9410-4dc4-a418-a24dedf66135 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:34.229446 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-be81b429-9410-4dc4-a418-a24dedf66135 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:34.236789 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-be81b429-9410-4dc4-a418-a24dedf66135 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.078105 Feb 21 01:17:34.237351 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 599/1211] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:34 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:34.269380 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3416ab12-f1fe-4810-872c-4e44359822c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:34.270286 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3416ab12-f1fe-4810-872c-4e44359822c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:34.276567 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3416ab12-f1fe-4810-872c-4e44359822c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:34.277011 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3416ab12-f1fe-4810-872c-4e44359822c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:34.278036 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3416ab12-f1fe-4810-872c-4e44359822c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:34.278469 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3416ab12-f1fe-4810-872c-4e44359822c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:34.307030 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3416ab12-f1fe-4810-872c-4e44359822c0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041342 Feb 21 01:17:34.307573 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 613/1212] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:34 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:35.015268 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c7d71df2-3299-4612-8e06-84d5e6d96c51 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:35.015920 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c7d71df2-3299-4612-8e06-84d5e6d96c51 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:35.021976 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c7d71df2-3299-4612-8e06-84d5e6d96c51 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:35.022439 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c7d71df2-3299-4612-8e06-84d5e6d96c51 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:35.023238 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c7d71df2-3299-4612-8e06-84d5e6d96c51 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:35.023665 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c7d71df2-3299-4612-8e06-84d5e6d96c51 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:35.160479 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c7d71df2-3299-4612-8e06-84d5e6d96c51 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:35.169371 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c7d71df2-3299-4612-8e06-84d5e6d96c51 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:35.170869 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c7d71df2-3299-4612-8e06-84d5e6d96c51 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:35.172050 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c7d71df2-3299-4612-8e06-84d5e6d96c51 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.161309 Feb 21 01:17:35.172598 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 600/1213] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:35 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:35.252637 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-dd645899-23bb-4d1a-9da0-43e97a388a65 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:35.253267 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-dd645899-23bb-4d1a-9da0-43e97a388a65 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:35.259981 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dd645899-23bb-4d1a-9da0-43e97a388a65 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:35.260474 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dd645899-23bb-4d1a-9da0-43e97a388a65 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:35.261278 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dd645899-23bb-4d1a-9da0-43e97a388a65 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:35.261708 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dd645899-23bb-4d1a-9da0-43e97a388a65 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:35.318794 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3cc01572-319b-4f10-9cd5-33c75bc60885 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:35.319203 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3cc01572-319b-4f10-9cd5-33c75bc60885 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:35.321139 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-dd645899-23bb-4d1a-9da0-43e97a388a65 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:35.325649 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3cc01572-319b-4f10-9cd5-33c75bc60885 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:35.326107 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3cc01572-319b-4f10-9cd5-33c75bc60885 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:35.326974 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3cc01572-319b-4f10-9cd5-33c75bc60885 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:35.327443 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3cc01572-319b-4f10-9cd5-33c75bc60885 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:35.328561 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-dd645899-23bb-4d1a-9da0-43e97a388a65 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079530 Feb 21 01:17:35.329127 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 614/1214] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:35 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:35.357637 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3cc01572-319b-4f10-9cd5-33c75bc60885 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043128 Feb 21 01:17:35.358423 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 601/1215] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:35 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:36.190643 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1ef39e04-c802-4c43-beab-d0531ed4f7be tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:36.191156 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1ef39e04-c802-4c43-beab-d0531ed4f7be tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:36.197120 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1ef39e04-c802-4c43-beab-d0531ed4f7be tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:36.197555 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1ef39e04-c802-4c43-beab-d0531ed4f7be tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:36.198346 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1ef39e04-c802-4c43-beab-d0531ed4f7be tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:36.198773 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1ef39e04-c802-4c43-beab-d0531ed4f7be tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:36.332062 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1ef39e04-c802-4c43-beab-d0531ed4f7be tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:36.341109 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1ef39e04-c802-4c43-beab-d0531ed4f7be tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:36.342591 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1ef39e04-c802-4c43-beab-d0531ed4f7be tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:36.343730 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1ef39e04-c802-4c43-beab-d0531ed4f7be tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156884 Feb 21 01:17:36.344292 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 615/1216] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:36 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:36.344629 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-01f693d6-98ec-43e4-98c1-6b4f3cc1f1db tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:36.345238 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-01f693d6-98ec-43e4-98c1-6b4f3cc1f1db tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:36.352129 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-01f693d6-98ec-43e4-98c1-6b4f3cc1f1db tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:36.352545 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-01f693d6-98ec-43e4-98c1-6b4f3cc1f1db tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:36.353331 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-01f693d6-98ec-43e4-98c1-6b4f3cc1f1db tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:36.353770 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-01f693d6-98ec-43e4-98c1-6b4f3cc1f1db tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:36.368928 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b5853488-09b3-43ed-8c28-461126be2590 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:36.369830 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b5853488-09b3-43ed-8c28-461126be2590 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:36.375511 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b5853488-09b3-43ed-8c28-461126be2590 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:36.375994 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b5853488-09b3-43ed-8c28-461126be2590 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:36.376774 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b5853488-09b3-43ed-8c28-461126be2590 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:36.377198 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b5853488-09b3-43ed-8c28-461126be2590 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:36.407331 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b5853488-09b3-43ed-8c28-461126be2590 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042102 Feb 21 01:17:36.408098 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 616/1217] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:36 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:17:36.416431 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-01f693d6-98ec-43e4-98c1-6b4f3cc1f1db tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:36.424180 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-01f693d6-98ec-43e4-98c1-6b4f3cc1f1db tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083142 Feb 21 01:17:36.424733 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 602/1218] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:36 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:17:37.362720 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-df173e41-6a75-46c7-ba07-75cacd0e6db5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:37.363328 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-df173e41-6a75-46c7-ba07-75cacd0e6db5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:37.370182 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-df173e41-6a75-46c7-ba07-75cacd0e6db5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:37.370631 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-df173e41-6a75-46c7-ba07-75cacd0e6db5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:37.371451 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-df173e41-6a75-46c7-ba07-75cacd0e6db5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:37.371910 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-df173e41-6a75-46c7-ba07-75cacd0e6db5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:37.418897 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-601e9328-5a4a-468c-8582-699069d0d367 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:37.420037 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-601e9328-5a4a-468c-8582-699069d0d367 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:37.426338 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-601e9328-5a4a-468c-8582-699069d0d367 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:37.426787 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-601e9328-5a4a-468c-8582-699069d0d367 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:37.427579 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-601e9328-5a4a-468c-8582-699069d0d367 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:37.428051 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-601e9328-5a4a-468c-8582-699069d0d367 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:37.457833 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-601e9328-5a4a-468c-8582-699069d0d367 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042930 Feb 21 01:17:37.458402 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 603/1219] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:37 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:37.463399 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7707c120-9dd9-4fcf-8407-cd4f53c9513c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:37.464037 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7707c120-9dd9-4fcf-8407-cd4f53c9513c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:37.469883 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7707c120-9dd9-4fcf-8407-cd4f53c9513c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:37.470332 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7707c120-9dd9-4fcf-8407-cd4f53c9513c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:37.471133 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7707c120-9dd9-4fcf-8407-cd4f53c9513c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:37.471570 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7707c120-9dd9-4fcf-8407-cd4f53c9513c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:37.507204 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-df173e41-6a75-46c7-ba07-75cacd0e6db5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:37.515977 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-df173e41-6a75-46c7-ba07-75cacd0e6db5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:37.517535 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-df173e41-6a75-46c7-ba07-75cacd0e6db5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:37.518700 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-df173e41-6a75-46c7-ba07-75cacd0e6db5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159710 Feb 21 01:17:37.519226 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 617/1220] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:37 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:37.535511 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7707c120-9dd9-4fcf-8407-cd4f53c9513c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:37.544122 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7707c120-9dd9-4fcf-8407-cd4f53c9513c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084756 Feb 21 01:17:37.544680 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 604/1221] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:37 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:38.469098 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5eb9a6cb-41f5-4811-aab5-92906a2a2b07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:38.470013 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5eb9a6cb-41f5-4811-aab5-92906a2a2b07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:38.476605 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5eb9a6cb-41f5-4811-aab5-92906a2a2b07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:38.477096 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5eb9a6cb-41f5-4811-aab5-92906a2a2b07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:38.477802 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5eb9a6cb-41f5-4811-aab5-92906a2a2b07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:38.478240 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5eb9a6cb-41f5-4811-aab5-92906a2a2b07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:38.507780 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5eb9a6cb-41f5-4811-aab5-92906a2a2b07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042443 Feb 21 01:17:38.508356 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 618/1222] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:38 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:38.537903 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2e4e7e8a-211f-432f-9b9c-53cb8451f86d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:38.539648 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2e4e7e8a-211f-432f-9b9c-53cb8451f86d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:38.546051 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2e4e7e8a-211f-432f-9b9c-53cb8451f86d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:38.546506 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2e4e7e8a-211f-432f-9b9c-53cb8451f86d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:38.547294 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2e4e7e8a-211f-432f-9b9c-53cb8451f86d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:38.547731 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2e4e7e8a-211f-432f-9b9c-53cb8451f86d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:38.560741 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-43dee5e2-00d7-47de-911d-9d1d7941b940 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:38.561348 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-43dee5e2-00d7-47de-911d-9d1d7941b940 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:38.567321 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-43dee5e2-00d7-47de-911d-9d1d7941b940 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:38.567790 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-43dee5e2-00d7-47de-911d-9d1d7941b940 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:38.568643 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-43dee5e2-00d7-47de-911d-9d1d7941b940 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:38.569071 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-43dee5e2-00d7-47de-911d-9d1d7941b940 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:38.635192 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-43dee5e2-00d7-47de-911d-9d1d7941b940 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:38.647670 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-43dee5e2-00d7-47de-911d-9d1d7941b940 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.090305 Feb 21 01:17:38.648537 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 619/1223] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:38 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:17:38.686496 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2e4e7e8a-211f-432f-9b9c-53cb8451f86d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:38.695706 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2e4e7e8a-211f-432f-9b9c-53cb8451f86d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:38.697251 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2e4e7e8a-211f-432f-9b9c-53cb8451f86d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:38.698407 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2e4e7e8a-211f-432f-9b9c-53cb8451f86d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.164304 Feb 21 01:17:38.698961 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 605/1224] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:38 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:17:39.519438 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d4eb9c68-d3bd-4fcc-898c-048493e9d8f8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:39.520441 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d4eb9c68-d3bd-4fcc-898c-048493e9d8f8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:39.526910 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d4eb9c68-d3bd-4fcc-898c-048493e9d8f8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:39.527350 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d4eb9c68-d3bd-4fcc-898c-048493e9d8f8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:39.528416 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d4eb9c68-d3bd-4fcc-898c-048493e9d8f8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:39.528845 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d4eb9c68-d3bd-4fcc-898c-048493e9d8f8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:39.557852 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d4eb9c68-d3bd-4fcc-898c-048493e9d8f8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042210 Feb 21 01:17:39.558400 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 620/1225] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:39 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:39.666013 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-bcefea23-bd05-4c54-97aa-c8a63eeb531f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:39.666535 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-bcefea23-bd05-4c54-97aa-c8a63eeb531f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:39.672874 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bcefea23-bd05-4c54-97aa-c8a63eeb531f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:39.673324 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bcefea23-bd05-4c54-97aa-c8a63eeb531f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:39.674104 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bcefea23-bd05-4c54-97aa-c8a63eeb531f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:39.674542 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bcefea23-bd05-4c54-97aa-c8a63eeb531f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:39.716448 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-26b35bcd-00f5-4f38-acb6-b0d7e8531237 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:39.717146 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-26b35bcd-00f5-4f38-acb6-b0d7e8531237 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:39.722993 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-26b35bcd-00f5-4f38-acb6-b0d7e8531237 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:39.723513 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-26b35bcd-00f5-4f38-acb6-b0d7e8531237 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:39.724392 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-26b35bcd-00f5-4f38-acb6-b0d7e8531237 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:39.724892 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-26b35bcd-00f5-4f38-acb6-b0d7e8531237 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:39.734017 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bcefea23-bd05-4c54-97aa-c8a63eeb531f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:39.742015 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-bcefea23-bd05-4c54-97aa-c8a63eeb531f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080428 Feb 21 01:17:39.742591 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 606/1226] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:39 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:39.857122 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-26b35bcd-00f5-4f38-acb6-b0d7e8531237 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:39.865214 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-26b35bcd-00f5-4f38-acb6-b0d7e8531237 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:39.867320 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-26b35bcd-00f5-4f38-acb6-b0d7e8531237 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:39.868499 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-26b35bcd-00f5-4f38-acb6-b0d7e8531237 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155744 Feb 21 01:17:39.869047 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 621/1227] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:39 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:17:40.569995 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3a2ca0a7-5fde-47de-b02f-6fc4c031eef3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:40.570918 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3a2ca0a7-5fde-47de-b02f-6fc4c031eef3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:40.576774 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3a2ca0a7-5fde-47de-b02f-6fc4c031eef3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:40.577256 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3a2ca0a7-5fde-47de-b02f-6fc4c031eef3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:40.578040 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3a2ca0a7-5fde-47de-b02f-6fc4c031eef3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:40.578476 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3a2ca0a7-5fde-47de-b02f-6fc4c031eef3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:40.607312 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3a2ca0a7-5fde-47de-b02f-6fc4c031eef3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041638 Feb 21 01:17:40.607952 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 607/1228] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:40 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:40.759267 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-aee48b15-dca8-4218-a7dc-c8bded974e88 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:40.759889 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-aee48b15-dca8-4218-a7dc-c8bded974e88 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:40.766170 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aee48b15-dca8-4218-a7dc-c8bded974e88 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:40.766615 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aee48b15-dca8-4218-a7dc-c8bded974e88 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:40.767388 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aee48b15-dca8-4218-a7dc-c8bded974e88 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:40.767819 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aee48b15-dca8-4218-a7dc-c8bded974e88 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:40.828223 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-aee48b15-dca8-4218-a7dc-c8bded974e88 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:40.835950 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-aee48b15-dca8-4218-a7dc-c8bded974e88 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080995 Feb 21 01:17:40.836508 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 622/1229] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:40 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:40.886913 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-11633284-da5f-4607-b764-8ebca848d994 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:40.887436 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-11633284-da5f-4607-b764-8ebca848d994 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:40.893878 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-11633284-da5f-4607-b764-8ebca848d994 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:40.894326 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-11633284-da5f-4607-b764-8ebca848d994 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:40.895107 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-11633284-da5f-4607-b764-8ebca848d994 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:40.895546 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-11633284-da5f-4607-b764-8ebca848d994 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:41.029365 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-11633284-da5f-4607-b764-8ebca848d994 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:41.037462 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-11633284-da5f-4607-b764-8ebca848d994 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:41.039126 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-11633284-da5f-4607-b764-8ebca848d994 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:41.040316 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-11633284-da5f-4607-b764-8ebca848d994 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157181 Feb 21 01:17:41.040878 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 608/1230] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:40 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:41.619395 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ce8d8c24-a2bf-49ae-acbe-bf9f7343256e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:41.620262 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ce8d8c24-a2bf-49ae-acbe-bf9f7343256e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:41.626488 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ce8d8c24-a2bf-49ae-acbe-bf9f7343256e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:41.626933 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ce8d8c24-a2bf-49ae-acbe-bf9f7343256e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:41.627719 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ce8d8c24-a2bf-49ae-acbe-bf9f7343256e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:41.628173 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ce8d8c24-a2bf-49ae-acbe-bf9f7343256e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:41.658602 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ce8d8c24-a2bf-49ae-acbe-bf9f7343256e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043731 Feb 21 01:17:41.659163 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 623/1231] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:41 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:41.853266 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b51c7420-dfa3-47ba-af43-6f54012ac808 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:41.853902 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b51c7420-dfa3-47ba-af43-6f54012ac808 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:41.859932 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b51c7420-dfa3-47ba-af43-6f54012ac808 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:41.860381 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b51c7420-dfa3-47ba-af43-6f54012ac808 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:41.861170 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b51c7420-dfa3-47ba-af43-6f54012ac808 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:41.861601 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b51c7420-dfa3-47ba-af43-6f54012ac808 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:41.922368 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b51c7420-dfa3-47ba-af43-6f54012ac808 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:41.930946 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b51c7420-dfa3-47ba-af43-6f54012ac808 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082079 Feb 21 01:17:41.931517 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 609/1232] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:41 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:42.058875 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-97b4e32a-f627-4c20-9f0b-1d2e81abfb5b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:42.059501 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-97b4e32a-f627-4c20-9f0b-1d2e81abfb5b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:42.065776 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-97b4e32a-f627-4c20-9f0b-1d2e81abfb5b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:42.066218 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-97b4e32a-f627-4c20-9f0b-1d2e81abfb5b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:42.067000 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-97b4e32a-f627-4c20-9f0b-1d2e81abfb5b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:42.067411 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-97b4e32a-f627-4c20-9f0b-1d2e81abfb5b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:42.205869 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-97b4e32a-f627-4c20-9f0b-1d2e81abfb5b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:42.214746 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-97b4e32a-f627-4c20-9f0b-1d2e81abfb5b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:42.216262 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-97b4e32a-f627-4c20-9f0b-1d2e81abfb5b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:42.217416 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-97b4e32a-f627-4c20-9f0b-1d2e81abfb5b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.162395 Feb 21 01:17:42.217969 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 624/1233] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:42 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:42.670021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1e98ce46-cc73-450b-b959-6f50fe35bcf6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:42.670935 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1e98ce46-cc73-450b-b959-6f50fe35bcf6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:42.676977 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1e98ce46-cc73-450b-b959-6f50fe35bcf6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:42.677419 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1e98ce46-cc73-450b-b959-6f50fe35bcf6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:42.678207 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1e98ce46-cc73-450b-b959-6f50fe35bcf6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:42.678667 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1e98ce46-cc73-450b-b959-6f50fe35bcf6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:42.707414 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1e98ce46-cc73-450b-b959-6f50fe35bcf6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041180 Feb 21 01:17:42.707991 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 610/1234] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:42 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:42.948523 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a7463382-883e-4433-9900-80774be3322d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:42.949050 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a7463382-883e-4433-9900-80774be3322d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:42.954934 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a7463382-883e-4433-9900-80774be3322d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:42.955381 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a7463382-883e-4433-9900-80774be3322d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:42.956308 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a7463382-883e-4433-9900-80774be3322d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:42.956744 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a7463382-883e-4433-9900-80774be3322d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:43.017035 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a7463382-883e-4433-9900-80774be3322d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:43.024210 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a7463382-883e-4433-9900-80774be3322d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080331 Feb 21 01:17:43.024764 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 625/1235] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:42 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:43.236313 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-971cc438-ca48-4f19-8ad8-0ee4f9d73d0d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:43.236951 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-971cc438-ca48-4f19-8ad8-0ee4f9d73d0d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:43.243902 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-971cc438-ca48-4f19-8ad8-0ee4f9d73d0d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:43.244353 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-971cc438-ca48-4f19-8ad8-0ee4f9d73d0d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:43.245190 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-971cc438-ca48-4f19-8ad8-0ee4f9d73d0d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:43.245571 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-971cc438-ca48-4f19-8ad8-0ee4f9d73d0d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:43.379062 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-971cc438-ca48-4f19-8ad8-0ee4f9d73d0d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:43.388021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-971cc438-ca48-4f19-8ad8-0ee4f9d73d0d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:43.389497 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-971cc438-ca48-4f19-8ad8-0ee4f9d73d0d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:43.390632 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-971cc438-ca48-4f19-8ad8-0ee4f9d73d0d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158022 Feb 21 01:17:43.391173 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 611/1236] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:43 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:43.718587 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d52289c1-04e8-4788-9f98-83b74f666555 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:43.719558 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d52289c1-04e8-4788-9f98-83b74f666555 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:43.726594 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d52289c1-04e8-4788-9f98-83b74f666555 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:43.727062 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d52289c1-04e8-4788-9f98-83b74f666555 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:43.727869 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d52289c1-04e8-4788-9f98-83b74f666555 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:43.728314 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d52289c1-04e8-4788-9f98-83b74f666555 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:43.757062 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d52289c1-04e8-4788-9f98-83b74f666555 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042015 Feb 21 01:17:43.757752 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 626/1237] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:43 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:17:44.042149 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-686ee704-0c50-4e66-8149-8dab59df22b9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:44.042675 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-686ee704-0c50-4e66-8149-8dab59df22b9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:44.048535 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-686ee704-0c50-4e66-8149-8dab59df22b9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:44.048980 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-686ee704-0c50-4e66-8149-8dab59df22b9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:44.049874 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-686ee704-0c50-4e66-8149-8dab59df22b9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:44.050340 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-686ee704-0c50-4e66-8149-8dab59df22b9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:44.112868 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-686ee704-0c50-4e66-8149-8dab59df22b9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:44.120383 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-686ee704-0c50-4e66-8149-8dab59df22b9 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082689 Feb 21 01:17:44.120940 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 612/1238] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:44 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:17:44.409188 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5bd61d20-f0e0-488a-9ab3-0965de553230 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:44.409829 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5bd61d20-f0e0-488a-9ab3-0965de553230 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:44.416458 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5bd61d20-f0e0-488a-9ab3-0965de553230 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:44.416904 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5bd61d20-f0e0-488a-9ab3-0965de553230 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:44.417696 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5bd61d20-f0e0-488a-9ab3-0965de553230 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:44.418128 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5bd61d20-f0e0-488a-9ab3-0965de553230 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:44.550021 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5bd61d20-f0e0-488a-9ab3-0965de553230 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:44.558232 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5bd61d20-f0e0-488a-9ab3-0965de553230 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:44.559723 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5bd61d20-f0e0-488a-9ab3-0965de553230 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:44.560920 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5bd61d20-f0e0-488a-9ab3-0965de553230 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155442 Feb 21 01:17:44.561484 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 627/1239] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:44 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:44.768539 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3f29b0d2-a7f7-4542-9b37-0d7de3fd7bc7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:44.769463 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3f29b0d2-a7f7-4542-9b37-0d7de3fd7bc7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:44.776210 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3f29b0d2-a7f7-4542-9b37-0d7de3fd7bc7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:44.776656 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3f29b0d2-a7f7-4542-9b37-0d7de3fd7bc7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:44.777430 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3f29b0d2-a7f7-4542-9b37-0d7de3fd7bc7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:44.778131 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3f29b0d2-a7f7-4542-9b37-0d7de3fd7bc7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:44.806586 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3f29b0d2-a7f7-4542-9b37-0d7de3fd7bc7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041807 Feb 21 01:17:44.807125 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 613/1240] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:44 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:45.138537 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8eca3b38-c2d8-4424-87e1-c5d90740ff54 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:45.139301 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8eca3b38-c2d8-4424-87e1-c5d90740ff54 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:45.148148 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8eca3b38-c2d8-4424-87e1-c5d90740ff54 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:45.148628 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8eca3b38-c2d8-4424-87e1-c5d90740ff54 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:45.149418 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8eca3b38-c2d8-4424-87e1-c5d90740ff54 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:45.149849 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8eca3b38-c2d8-4424-87e1-c5d90740ff54 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:45.215355 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8eca3b38-c2d8-4424-87e1-c5d90740ff54 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:45.222573 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8eca3b38-c2d8-4424-87e1-c5d90740ff54 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.088537 Feb 21 01:17:45.223124 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 628/1241] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:45 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:17:45.578388 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8b6a9a08-7c2b-43b7-b2a5-b00290d7f65d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:45.579037 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8b6a9a08-7c2b-43b7-b2a5-b00290d7f65d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:45.585335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8b6a9a08-7c2b-43b7-b2a5-b00290d7f65d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:45.585774 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8b6a9a08-7c2b-43b7-b2a5-b00290d7f65d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:45.586539 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8b6a9a08-7c2b-43b7-b2a5-b00290d7f65d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:45.586963 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8b6a9a08-7c2b-43b7-b2a5-b00290d7f65d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:45.719645 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8b6a9a08-7c2b-43b7-b2a5-b00290d7f65d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:45.729017 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8b6a9a08-7c2b-43b7-b2a5-b00290d7f65d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:45.730673 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8b6a9a08-7c2b-43b7-b2a5-b00290d7f65d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:45.731849 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8b6a9a08-7c2b-43b7-b2a5-b00290d7f65d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157187 Feb 21 01:17:45.732412 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 614/1242] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:45 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:45.817166 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7ab473cf-e023-4e69-903e-87deb06b00d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:45.818074 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7ab473cf-e023-4e69-903e-87deb06b00d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:45.824348 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7ab473cf-e023-4e69-903e-87deb06b00d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:45.824796 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7ab473cf-e023-4e69-903e-87deb06b00d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:45.825573 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7ab473cf-e023-4e69-903e-87deb06b00d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:45.826004 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7ab473cf-e023-4e69-903e-87deb06b00d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:45.854702 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7ab473cf-e023-4e69-903e-87deb06b00d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041162 Feb 21 01:17:45.855176 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 629/1243] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:45 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:46.239403 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-98afcee0-0feb-416f-86c4-122a09e1a008 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:46.240175 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-98afcee0-0feb-416f-86c4-122a09e1a008 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:46.246306 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-98afcee0-0feb-416f-86c4-122a09e1a008 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:46.246743 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-98afcee0-0feb-416f-86c4-122a09e1a008 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:46.247513 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-98afcee0-0feb-416f-86c4-122a09e1a008 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:46.247975 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-98afcee0-0feb-416f-86c4-122a09e1a008 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:46.307745 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-98afcee0-0feb-416f-86c4-122a09e1a008 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:46.315204 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-98afcee0-0feb-416f-86c4-122a09e1a008 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079526 Feb 21 01:17:46.315759 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 615/1244] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:46 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:46.750889 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-850de7d2-1387-4ccb-952d-49ccc0b53103 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:46.751535 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-850de7d2-1387-4ccb-952d-49ccc0b53103 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:46.758844 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-850de7d2-1387-4ccb-952d-49ccc0b53103 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:46.759297 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-850de7d2-1387-4ccb-952d-49ccc0b53103 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:46.760120 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-850de7d2-1387-4ccb-952d-49ccc0b53103 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:46.760559 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-850de7d2-1387-4ccb-952d-49ccc0b53103 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:46.865468 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b31095fa-feda-47b8-b55a-0d4ba71fd552 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:46.866953 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b31095fa-feda-47b8-b55a-0d4ba71fd552 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:46.872997 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b31095fa-feda-47b8-b55a-0d4ba71fd552 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:46.873436 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b31095fa-feda-47b8-b55a-0d4ba71fd552 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:46.874214 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b31095fa-feda-47b8-b55a-0d4ba71fd552 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:46.874640 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b31095fa-feda-47b8-b55a-0d4ba71fd552 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:46.900782 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-850de7d2-1387-4ccb-952d-49ccc0b53103 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:46.907249 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b31095fa-feda-47b8-b55a-0d4ba71fd552 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045558 Feb 21 01:17:46.907823 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 616/1245] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:46 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:17:46.909397 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-850de7d2-1387-4ccb-952d-49ccc0b53103 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:46.910904 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-850de7d2-1387-4ccb-952d-49ccc0b53103 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:46.912328 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-850de7d2-1387-4ccb-952d-49ccc0b53103 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.165049 Feb 21 01:17:46.912878 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 630/1246] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:46 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:47.332114 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5e4ce07b-bcbf-4fb5-9a66-8c4adab93731 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:47.332730 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5e4ce07b-bcbf-4fb5-9a66-8c4adab93731 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:47.338744 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5e4ce07b-bcbf-4fb5-9a66-8c4adab93731 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:47.339182 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5e4ce07b-bcbf-4fb5-9a66-8c4adab93731 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:47.340131 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5e4ce07b-bcbf-4fb5-9a66-8c4adab93731 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:47.340830 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5e4ce07b-bcbf-4fb5-9a66-8c4adab93731 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:47.403982 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5e4ce07b-bcbf-4fb5-9a66-8c4adab93731 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:47.411385 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5e4ce07b-bcbf-4fb5-9a66-8c4adab93731 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083170 Feb 21 01:17:47.411982 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 617/1247] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:47 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:47.919033 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e52383c1-ace9-4f8f-93ce-da276f449213 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:47.919976 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e52383c1-ace9-4f8f-93ce-da276f449213 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:47.926274 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e52383c1-ace9-4f8f-93ce-da276f449213 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:47.926769 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e52383c1-ace9-4f8f-93ce-da276f449213 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:47.927514 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e52383c1-ace9-4f8f-93ce-da276f449213 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:47.927988 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e52383c1-ace9-4f8f-93ce-da276f449213 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:47.930756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ea3f0a8c-e1b5-4083-bc9f-6f541d1cde6f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:47.931358 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ea3f0a8c-e1b5-4083-bc9f-6f541d1cde6f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:47.937359 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ea3f0a8c-e1b5-4083-bc9f-6f541d1cde6f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:47.937804 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ea3f0a8c-e1b5-4083-bc9f-6f541d1cde6f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:47.938586 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ea3f0a8c-e1b5-4083-bc9f-6f541d1cde6f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:47.939012 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ea3f0a8c-e1b5-4083-bc9f-6f541d1cde6f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:47.959365 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e52383c1-ace9-4f8f-93ce-da276f449213 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044084 Feb 21 01:17:47.960580 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 631/1248] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:47 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:48.075315 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ea3f0a8c-e1b5-4083-bc9f-6f541d1cde6f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:48.083417 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ea3f0a8c-e1b5-4083-bc9f-6f541d1cde6f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:48.085752 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ea3f0a8c-e1b5-4083-bc9f-6f541d1cde6f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:48.086914 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ea3f0a8c-e1b5-4083-bc9f-6f541d1cde6f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160435 Feb 21 01:17:48.087476 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 618/1249] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:47 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:17:48.428158 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-45383f32-3132-4c0c-abfd-6bad970c06e4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:48.428808 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-45383f32-3132-4c0c-abfd-6bad970c06e4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:48.434639 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-45383f32-3132-4c0c-abfd-6bad970c06e4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:48.435075 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-45383f32-3132-4c0c-abfd-6bad970c06e4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:48.435860 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-45383f32-3132-4c0c-abfd-6bad970c06e4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:48.436285 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-45383f32-3132-4c0c-abfd-6bad970c06e4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:48.495714 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-45383f32-3132-4c0c-abfd-6bad970c06e4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:48.503200 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-45383f32-3132-4c0c-abfd-6bad970c06e4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.078651 Feb 21 01:17:48.503754 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 632/1250] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:48 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:48.971442 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-19d56932-717f-4c14-bd20-ef4211f73576 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:48.972413 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-19d56932-717f-4c14-bd20-ef4211f73576 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:48.979178 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-19d56932-717f-4c14-bd20-ef4211f73576 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:48.979634 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-19d56932-717f-4c14-bd20-ef4211f73576 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:48.980439 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-19d56932-717f-4c14-bd20-ef4211f73576 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:48.980881 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-19d56932-717f-4c14-bd20-ef4211f73576 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:49.012319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-19d56932-717f-4c14-bd20-ef4211f73576 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044565 Feb 21 01:17:49.012918 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 619/1251] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:48 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:49.105607 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-88eebf3f-8f7d-45b1-aa0c-7ffc3da8daa4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:49.106211 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-88eebf3f-8f7d-45b1-aa0c-7ffc3da8daa4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:49.112473 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-88eebf3f-8f7d-45b1-aa0c-7ffc3da8daa4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:49.112919 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-88eebf3f-8f7d-45b1-aa0c-7ffc3da8daa4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:49.113687 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-88eebf3f-8f7d-45b1-aa0c-7ffc3da8daa4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:49.114113 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-88eebf3f-8f7d-45b1-aa0c-7ffc3da8daa4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:49.250110 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-88eebf3f-8f7d-45b1-aa0c-7ffc3da8daa4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:49.258284 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-88eebf3f-8f7d-45b1-aa0c-7ffc3da8daa4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:49.259757 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-88eebf3f-8f7d-45b1-aa0c-7ffc3da8daa4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:49.260931 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-88eebf3f-8f7d-45b1-aa0c-7ffc3da8daa4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159152 Feb 21 01:17:49.261478 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 633/1252] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:49 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:17:49.519636 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-bbf36a04-6622-48f2-b8e6-8f57597fb951 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:49.520181 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-bbf36a04-6622-48f2-b8e6-8f57597fb951 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:49.526978 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bbf36a04-6622-48f2-b8e6-8f57597fb951 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:49.527704 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bbf36a04-6622-48f2-b8e6-8f57597fb951 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:49.528508 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bbf36a04-6622-48f2-b8e6-8f57597fb951 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:49.528942 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bbf36a04-6622-48f2-b8e6-8f57597fb951 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:49.588606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bbf36a04-6622-48f2-b8e6-8f57597fb951 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:49.596114 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-bbf36a04-6622-48f2-b8e6-8f57597fb951 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080174 Feb 21 01:17:49.596674 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 620/1253] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:49 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:50.024212 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ca7e91a5-ea79-4326-b7ab-af591384735a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:50.025135 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ca7e91a5-ea79-4326-b7ab-af591384735a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:50.031292 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ca7e91a5-ea79-4326-b7ab-af591384735a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:50.031736 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ca7e91a5-ea79-4326-b7ab-af591384735a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:50.032552 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ca7e91a5-ea79-4326-b7ab-af591384735a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:50.032987 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ca7e91a5-ea79-4326-b7ab-af591384735a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:50.062347 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ca7e91a5-ea79-4326-b7ab-af591384735a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042317 Feb 21 01:17:50.062890 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 634/1254] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:50 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:50.278732 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-51bbc29a-d300-491b-bc3e-99d6dbf78604 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:50.279279 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-51bbc29a-d300-491b-bc3e-99d6dbf78604 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:50.285517 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51bbc29a-d300-491b-bc3e-99d6dbf78604 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:50.285965 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51bbc29a-d300-491b-bc3e-99d6dbf78604 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:50.286752 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51bbc29a-d300-491b-bc3e-99d6dbf78604 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:50.287187 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51bbc29a-d300-491b-bc3e-99d6dbf78604 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:50.424642 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-51bbc29a-d300-491b-bc3e-99d6dbf78604 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:50.433858 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-51bbc29a-d300-491b-bc3e-99d6dbf78604 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:50.435348 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-51bbc29a-d300-491b-bc3e-99d6dbf78604 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:50.436525 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-51bbc29a-d300-491b-bc3e-99d6dbf78604 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.161874 Feb 21 01:17:50.437844 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 621/1255] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:50 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:50.612985 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ad1c3d60-1b36-4c1e-bde3-42159cef9de6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:50.613530 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ad1c3d60-1b36-4c1e-bde3-42159cef9de6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:50.619580 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad1c3d60-1b36-4c1e-bde3-42159cef9de6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:50.620080 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad1c3d60-1b36-4c1e-bde3-42159cef9de6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:50.620895 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad1c3d60-1b36-4c1e-bde3-42159cef9de6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:50.621334 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad1c3d60-1b36-4c1e-bde3-42159cef9de6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:50.681289 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ad1c3d60-1b36-4c1e-bde3-42159cef9de6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:50.688647 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ad1c3d60-1b36-4c1e-bde3-42159cef9de6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079386 Feb 21 01:17:50.689197 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 635/1256] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:50 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:51.073463 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-addf6901-7191-4777-956e-35da9b0a9823 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:51.074389 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-addf6901-7191-4777-956e-35da9b0a9823 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:51.080296 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-addf6901-7191-4777-956e-35da9b0a9823 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:51.080741 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-addf6901-7191-4777-956e-35da9b0a9823 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:51.081532 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-addf6901-7191-4777-956e-35da9b0a9823 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:51.081967 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-addf6901-7191-4777-956e-35da9b0a9823 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:51.111816 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-addf6901-7191-4777-956e-35da9b0a9823 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042715 Feb 21 01:17:51.112944 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 622/1257] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:51 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:17:51.454826 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3652e624-a360-4f71-b804-2cdf95c2909b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:51.455434 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3652e624-a360-4f71-b804-2cdf95c2909b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:51.462485 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3652e624-a360-4f71-b804-2cdf95c2909b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:51.462935 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3652e624-a360-4f71-b804-2cdf95c2909b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:51.463731 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3652e624-a360-4f71-b804-2cdf95c2909b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:51.464175 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3652e624-a360-4f71-b804-2cdf95c2909b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:51.595889 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3652e624-a360-4f71-b804-2cdf95c2909b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:51.604928 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3652e624-a360-4f71-b804-2cdf95c2909b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:51.606418 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3652e624-a360-4f71-b804-2cdf95c2909b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:51.607559 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3652e624-a360-4f71-b804-2cdf95c2909b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156575 Feb 21 01:17:51.608194 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 636/1258] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:51 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:51.705353 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-77e34e3e-99a5-41d3-a39f-f9e788856243 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:51.705973 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-77e34e3e-99a5-41d3-a39f-f9e788856243 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:51.712326 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-77e34e3e-99a5-41d3-a39f-f9e788856243 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:51.712776 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-77e34e3e-99a5-41d3-a39f-f9e788856243 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:51.713545 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-77e34e3e-99a5-41d3-a39f-f9e788856243 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:51.713972 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-77e34e3e-99a5-41d3-a39f-f9e788856243 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:51.776763 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-77e34e3e-99a5-41d3-a39f-f9e788856243 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:51.784577 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-77e34e3e-99a5-41d3-a39f-f9e788856243 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082888 Feb 21 01:17:51.785163 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 623/1259] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:51 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:52.125372 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e7614059-2283-46be-ab3c-94ba38099f98 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:52.126288 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e7614059-2283-46be-ab3c-94ba38099f98 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:52.132199 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7614059-2283-46be-ab3c-94ba38099f98 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:52.132649 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7614059-2283-46be-ab3c-94ba38099f98 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:52.133488 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7614059-2283-46be-ab3c-94ba38099f98 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:52.133866 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7614059-2283-46be-ab3c-94ba38099f98 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:52.163490 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e7614059-2283-46be-ab3c-94ba38099f98 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041260 Feb 21 01:17:52.164179 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 637/1260] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:52 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:52.626521 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8887f090-3de6-4efc-880d-1b224f6d8354 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:52.627112 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8887f090-3de6-4efc-880d-1b224f6d8354 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:52.633620 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8887f090-3de6-4efc-880d-1b224f6d8354 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:52.634089 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8887f090-3de6-4efc-880d-1b224f6d8354 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:52.634854 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8887f090-3de6-4efc-880d-1b224f6d8354 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:52.635279 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8887f090-3de6-4efc-880d-1b224f6d8354 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:52.768762 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8887f090-3de6-4efc-880d-1b224f6d8354 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:52.777903 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8887f090-3de6-4efc-880d-1b224f6d8354 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:52.779465 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8887f090-3de6-4efc-880d-1b224f6d8354 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:52.781641 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8887f090-3de6-4efc-880d-1b224f6d8354 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158489 Feb 21 01:17:52.782227 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 624/1261] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:52 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:52.803067 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fe443e05-e79a-4799-a38f-66f2bd33284a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:52.803718 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fe443e05-e79a-4799-a38f-66f2bd33284a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:52.809871 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fe443e05-e79a-4799-a38f-66f2bd33284a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:52.810308 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fe443e05-e79a-4799-a38f-66f2bd33284a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:52.811075 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fe443e05-e79a-4799-a38f-66f2bd33284a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:52.811500 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fe443e05-e79a-4799-a38f-66f2bd33284a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:52.872461 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fe443e05-e79a-4799-a38f-66f2bd33284a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:52.879790 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-fe443e05-e79a-4799-a38f-66f2bd33284a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081009 Feb 21 01:17:52.880299 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 638/1262] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:52 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:53.174989 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0e8cb4d1-86d9-4f5f-a477-0d69824f261f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:53.175815 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0e8cb4d1-86d9-4f5f-a477-0d69824f261f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:53.182414 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0e8cb4d1-86d9-4f5f-a477-0d69824f261f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:53.182846 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0e8cb4d1-86d9-4f5f-a477-0d69824f261f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:53.183615 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0e8cb4d1-86d9-4f5f-a477-0d69824f261f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:53.184172 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0e8cb4d1-86d9-4f5f-a477-0d69824f261f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:53.212565 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0e8cb4d1-86d9-4f5f-a477-0d69824f261f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041421 Feb 21 01:17:53.213120 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 625/1263] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:53 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:53.803558 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-242ef8c8-5f0f-4cc6-9124-af24d9ce5cf6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:53.804208 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-242ef8c8-5f0f-4cc6-9124-af24d9ce5cf6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:53.810677 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-242ef8c8-5f0f-4cc6-9124-af24d9ce5cf6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:53.811130 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-242ef8c8-5f0f-4cc6-9124-af24d9ce5cf6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:53.811955 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-242ef8c8-5f0f-4cc6-9124-af24d9ce5cf6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:53.812392 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-242ef8c8-5f0f-4cc6-9124-af24d9ce5cf6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:53.896843 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c25643e9-0599-4d54-95b8-841cb26a1730 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:53.897447 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c25643e9-0599-4d54-95b8-841cb26a1730 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:53.904079 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c25643e9-0599-4d54-95b8-841cb26a1730 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:53.904526 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c25643e9-0599-4d54-95b8-841cb26a1730 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:53.905193 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c25643e9-0599-4d54-95b8-841cb26a1730 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:53.905621 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c25643e9-0599-4d54-95b8-841cb26a1730 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:53.949086 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-242ef8c8-5f0f-4cc6-9124-af24d9ce5cf6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:53.957500 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-242ef8c8-5f0f-4cc6-9124-af24d9ce5cf6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:53.958979 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-242ef8c8-5f0f-4cc6-9124-af24d9ce5cf6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:53.960141 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-242ef8c8-5f0f-4cc6-9124-af24d9ce5cf6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160254 Feb 21 01:17:53.960711 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 639/1264] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:53 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:53.966399 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c25643e9-0599-4d54-95b8-841cb26a1730 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:53.974566 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c25643e9-0599-4d54-95b8-841cb26a1730 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081370 Feb 21 01:17:53.975124 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 626/1265] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:53 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:17:54.223557 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6970aeba-04f5-4d28-b4aa-1b81bb1ac2d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:54.224495 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6970aeba-04f5-4d28-b4aa-1b81bb1ac2d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:54.231162 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6970aeba-04f5-4d28-b4aa-1b81bb1ac2d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:54.231599 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6970aeba-04f5-4d28-b4aa-1b81bb1ac2d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:54.232395 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6970aeba-04f5-4d28-b4aa-1b81bb1ac2d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:54.232819 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6970aeba-04f5-4d28-b4aa-1b81bb1ac2d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:54.261441 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6970aeba-04f5-4d28-b4aa-1b81bb1ac2d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041558 Feb 21 01:17:54.261988 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 640/1266] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:54 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:54.978489 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b31925d7-f728-4f4a-a2b8-9e4730a68ad1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:54.979157 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b31925d7-f728-4f4a-a2b8-9e4730a68ad1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:54.985273 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b31925d7-f728-4f4a-a2b8-9e4730a68ad1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:54.985712 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b31925d7-f728-4f4a-a2b8-9e4730a68ad1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:54.986479 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b31925d7-f728-4f4a-a2b8-9e4730a68ad1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:54.986904 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b31925d7-f728-4f4a-a2b8-9e4730a68ad1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:54.992481 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-80f3bb25-bb02-4f84-9cc2-19cc8c1be4d7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:54.993767 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-80f3bb25-bb02-4f84-9cc2-19cc8c1be4d7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:55.000317 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-80f3bb25-bb02-4f84-9cc2-19cc8c1be4d7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:55.000766 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-80f3bb25-bb02-4f84-9cc2-19cc8c1be4d7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:55.001556 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-80f3bb25-bb02-4f84-9cc2-19cc8c1be4d7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:55.001996 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-80f3bb25-bb02-4f84-9cc2-19cc8c1be4d7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:55.062928 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-80f3bb25-bb02-4f84-9cc2-19cc8c1be4d7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:55.070707 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-80f3bb25-bb02-4f84-9cc2-19cc8c1be4d7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081688 Feb 21 01:17:55.071584 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 641/1267] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:54 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:17:55.126040 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b31925d7-f728-4f4a-a2b8-9e4730a68ad1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:55.134898 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b31925d7-f728-4f4a-a2b8-9e4730a68ad1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:55.136436 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b31925d7-f728-4f4a-a2b8-9e4730a68ad1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:55.137587 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b31925d7-f728-4f4a-a2b8-9e4730a68ad1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.162954 Feb 21 01:17:55.138136 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 627/1268] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:54 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:55.272896 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-374fc817-edc3-4caf-8514-6d30816080b0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:55.274159 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-374fc817-edc3-4caf-8514-6d30816080b0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:55.280257 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-374fc817-edc3-4caf-8514-6d30816080b0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:55.280711 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-374fc817-edc3-4caf-8514-6d30816080b0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:55.281500 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-374fc817-edc3-4caf-8514-6d30816080b0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:55.282027 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-374fc817-edc3-4caf-8514-6d30816080b0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:55.311424 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-374fc817-edc3-4caf-8514-6d30816080b0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042331 Feb 21 01:17:55.311992 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 642/1269] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:55 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:56.087402 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-174b0cbc-6d61-45a7-bca2-52c235ac5952 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:56.088116 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-174b0cbc-6d61-45a7-bca2-52c235ac5952 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:56.094275 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-174b0cbc-6d61-45a7-bca2-52c235ac5952 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:56.094715 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-174b0cbc-6d61-45a7-bca2-52c235ac5952 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:56.095489 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-174b0cbc-6d61-45a7-bca2-52c235ac5952 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:56.095949 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-174b0cbc-6d61-45a7-bca2-52c235ac5952 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:56.156023 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3bc810f9-35ff-4cfe-8ca1-625929d63f91 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:56.156447 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-174b0cbc-6d61-45a7-bca2-52c235ac5952 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:56.156764 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3bc810f9-35ff-4cfe-8ca1-625929d63f91 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:56.163073 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3bc810f9-35ff-4cfe-8ca1-625929d63f91 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:56.163524 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3bc810f9-35ff-4cfe-8ca1-625929d63f91 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:56.164170 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-174b0cbc-6d61-45a7-bca2-52c235ac5952 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080068 Feb 21 01:17:56.164655 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 628/1270] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:56 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:56.165453 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3bc810f9-35ff-4cfe-8ca1-625929d63f91 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:56.165903 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3bc810f9-35ff-4cfe-8ca1-625929d63f91 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:56.295890 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3bc810f9-35ff-4cfe-8ca1-625929d63f91 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:56.304070 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3bc810f9-35ff-4cfe-8ca1-625929d63f91 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:56.306793 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3bc810f9-35ff-4cfe-8ca1-625929d63f91 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:56.307959 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3bc810f9-35ff-4cfe-8ca1-625929d63f91 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155989 Feb 21 01:17:56.308513 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 643/1271] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:56 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:17:56.322731 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-97da2907-f462-446c-b9c0-3e6f8ffa04be tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:56.323616 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-97da2907-f462-446c-b9c0-3e6f8ffa04be tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:56.329374 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-97da2907-f462-446c-b9c0-3e6f8ffa04be tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:56.329825 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-97da2907-f462-446c-b9c0-3e6f8ffa04be tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:56.330609 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-97da2907-f462-446c-b9c0-3e6f8ffa04be tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:56.331048 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-97da2907-f462-446c-b9c0-3e6f8ffa04be tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:56.362447 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-97da2907-f462-446c-b9c0-3e6f8ffa04be tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043387 Feb 21 01:17:56.362600 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 629/1272] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:56 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:57.180542 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-882a087e-8a8a-4cb7-8084-05b1db4ca587 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:57.181145 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-882a087e-8a8a-4cb7-8084-05b1db4ca587 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:57.187549 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-882a087e-8a8a-4cb7-8084-05b1db4ca587 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:57.188153 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-882a087e-8a8a-4cb7-8084-05b1db4ca587 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:57.188932 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-882a087e-8a8a-4cb7-8084-05b1db4ca587 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:57.189366 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-882a087e-8a8a-4cb7-8084-05b1db4ca587 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:57.253108 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-882a087e-8a8a-4cb7-8084-05b1db4ca587 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:57.261151 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-882a087e-8a8a-4cb7-8084-05b1db4ca587 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084379 Feb 21 01:17:57.261715 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 644/1273] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:57 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:57.326804 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ce62b559-eba5-4e21-9812-dd6d69d6762f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:57.327432 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ce62b559-eba5-4e21-9812-dd6d69d6762f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:57.333663 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ce62b559-eba5-4e21-9812-dd6d69d6762f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:57.334113 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ce62b559-eba5-4e21-9812-dd6d69d6762f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:57.334890 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ce62b559-eba5-4e21-9812-dd6d69d6762f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:57.335327 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ce62b559-eba5-4e21-9812-dd6d69d6762f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:57.373852 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9e3b775b-46f8-4e3e-a3fa-9ef58c1d5c22 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:57.374787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9e3b775b-46f8-4e3e-a3fa-9ef58c1d5c22 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:57.380653 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9e3b775b-46f8-4e3e-a3fa-9ef58c1d5c22 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:57.381106 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9e3b775b-46f8-4e3e-a3fa-9ef58c1d5c22 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:57.381895 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9e3b775b-46f8-4e3e-a3fa-9ef58c1d5c22 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:57.382332 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9e3b775b-46f8-4e3e-a3fa-9ef58c1d5c22 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:57.413375 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9e3b775b-46f8-4e3e-a3fa-9ef58c1d5c22 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043121 Feb 21 01:17:57.414006 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 645/1274] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:57 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:17:57.468108 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ce62b559-eba5-4e21-9812-dd6d69d6762f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:57.478200 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ce62b559-eba5-4e21-9812-dd6d69d6762f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:57.479857 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ce62b559-eba5-4e21-9812-dd6d69d6762f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:57.481026 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ce62b559-eba5-4e21-9812-dd6d69d6762f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157985 Feb 21 01:17:57.481581 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 630/1275] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:57 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:58.277883 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-98ca5b48-99c0-4843-953c-9113cbe38fe2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:58.278527 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-98ca5b48-99c0-4843-953c-9113cbe38fe2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:58.284956 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-98ca5b48-99c0-4843-953c-9113cbe38fe2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:58.285405 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-98ca5b48-99c0-4843-953c-9113cbe38fe2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:58.286192 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-98ca5b48-99c0-4843-953c-9113cbe38fe2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:58.286626 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-98ca5b48-99c0-4843-953c-9113cbe38fe2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:58.346681 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-98ca5b48-99c0-4843-953c-9113cbe38fe2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:58.354736 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-98ca5b48-99c0-4843-953c-9113cbe38fe2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080734 Feb 21 01:17:58.355365 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 646/1276] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:58 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:58.424977 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-182a6095-7e15-4780-bc45-0ace3add16bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:58.425885 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-182a6095-7e15-4780-bc45-0ace3add16bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:58.433061 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-182a6095-7e15-4780-bc45-0ace3add16bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:58.433507 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-182a6095-7e15-4780-bc45-0ace3add16bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:58.434286 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-182a6095-7e15-4780-bc45-0ace3add16bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:58.434720 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-182a6095-7e15-4780-bc45-0ace3add16bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:58.462789 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-182a6095-7e15-4780-bc45-0ace3add16bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041553 Feb 21 01:17:58.463343 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 631/1277] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:58 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:58.499156 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1f502765-8ded-40df-906f-e5adf52ef830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:58.499769 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1f502765-8ded-40df-906f-e5adf52ef830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:58.505667 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1f502765-8ded-40df-906f-e5adf52ef830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:58.506159 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1f502765-8ded-40df-906f-e5adf52ef830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:58.506942 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1f502765-8ded-40df-906f-e5adf52ef830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:58.507429 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1f502765-8ded-40df-906f-e5adf52ef830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:58.638851 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1f502765-8ded-40df-906f-e5adf52ef830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:58.647581 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1f502765-8ded-40df-906f-e5adf52ef830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:58.649346 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1f502765-8ded-40df-906f-e5adf52ef830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:58.650502 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1f502765-8ded-40df-906f-e5adf52ef830 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155106 Feb 21 01:17:58.651044 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 647/1278] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:58 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:17:59.370496 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c255a8c8-7d21-4cf0-8a51-b86982ffc20c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:59.371131 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c255a8c8-7d21-4cf0-8a51-b86982ffc20c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:59.377283 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c255a8c8-7d21-4cf0-8a51-b86982ffc20c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:59.377732 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c255a8c8-7d21-4cf0-8a51-b86982ffc20c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:59.378542 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c255a8c8-7d21-4cf0-8a51-b86982ffc20c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:59.379040 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c255a8c8-7d21-4cf0-8a51-b86982ffc20c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:59.448335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c255a8c8-7d21-4cf0-8a51-b86982ffc20c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:59.456855 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c255a8c8-7d21-4cf0-8a51-b86982ffc20c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.090109 Feb 21 01:17:59.457466 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 632/1279] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:59 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:17:59.473777 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0f8b4b3e-ad42-4a0f-a7b4-f98d92fef071 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:59.474859 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0f8b4b3e-ad42-4a0f-a7b4-f98d92fef071 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:59.481326 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0f8b4b3e-ad42-4a0f-a7b4-f98d92fef071 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:59.481776 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0f8b4b3e-ad42-4a0f-a7b4-f98d92fef071 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:59.482570 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0f8b4b3e-ad42-4a0f-a7b4-f98d92fef071 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:59.483008 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0f8b4b3e-ad42-4a0f-a7b4-f98d92fef071 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:59.514825 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0f8b4b3e-ad42-4a0f-a7b4-f98d92fef071 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044762 Feb 21 01:17:59.515403 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 648/1280] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:17:59 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:59.669109 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a3c9749b-ac5d-4f90-b105-7d2faced8e62 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:59.669630 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a3c9749b-ac5d-4f90-b105-7d2faced8e62 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:59.675540 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a3c9749b-ac5d-4f90-b105-7d2faced8e62 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:59.676034 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a3c9749b-ac5d-4f90-b105-7d2faced8e62 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:59.676815 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a3c9749b-ac5d-4f90-b105-7d2faced8e62 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:59.677255 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a3c9749b-ac5d-4f90-b105-7d2faced8e62 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:59.810247 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a3c9749b-ac5d-4f90-b105-7d2faced8e62 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:59.818569 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a3c9749b-ac5d-4f90-b105-7d2faced8e62 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:59.820763 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a3c9749b-ac5d-4f90-b105-7d2faced8e62 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:59.821911 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a3c9749b-ac5d-4f90-b105-7d2faced8e62 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156643 Feb 21 01:17:59.822599 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 633/1281] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:59 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:00.474186 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-75cf0ed0-209f-4e31-8671-70b6c3b3025a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:00.474794 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-75cf0ed0-209f-4e31-8671-70b6c3b3025a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:00.481748 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-75cf0ed0-209f-4e31-8671-70b6c3b3025a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:00.482188 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-75cf0ed0-209f-4e31-8671-70b6c3b3025a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:00.482953 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-75cf0ed0-209f-4e31-8671-70b6c3b3025a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:00.483379 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-75cf0ed0-209f-4e31-8671-70b6c3b3025a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:00.527313 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-081dae20-9a1f-4770-a4ed-d57442a2f394 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:00.528304 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-081dae20-9a1f-4770-a4ed-d57442a2f394 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:00.534763 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-081dae20-9a1f-4770-a4ed-d57442a2f394 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:00.535212 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-081dae20-9a1f-4770-a4ed-d57442a2f394 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:00.536033 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-081dae20-9a1f-4770-a4ed-d57442a2f394 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:00.536461 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-081dae20-9a1f-4770-a4ed-d57442a2f394 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:00.546618 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-75cf0ed0-209f-4e31-8671-70b6c3b3025a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:00.553894 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-75cf0ed0-209f-4e31-8671-70b6c3b3025a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083438 Feb 21 01:18:00.554670 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 649/1282] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:00 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:00.566840 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-081dae20-9a1f-4770-a4ed-d57442a2f394 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044408 Feb 21 01:18:00.567404 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 634/1283] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:18:00 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:18:00.840346 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-61139c1a-07ef-4a8c-bb7d-32931eded5bd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:00.840981 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-61139c1a-07ef-4a8c-bb7d-32931eded5bd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:00.846959 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-61139c1a-07ef-4a8c-bb7d-32931eded5bd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:00.847400 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-61139c1a-07ef-4a8c-bb7d-32931eded5bd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:00.848203 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-61139c1a-07ef-4a8c-bb7d-32931eded5bd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:00.848630 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-61139c1a-07ef-4a8c-bb7d-32931eded5bd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:00.980517 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-61139c1a-07ef-4a8c-bb7d-32931eded5bd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:00.989052 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-61139c1a-07ef-4a8c-bb7d-32931eded5bd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:00.990558 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-61139c1a-07ef-4a8c-bb7d-32931eded5bd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:00.992824 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-61139c1a-07ef-4a8c-bb7d-32931eded5bd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155619 Feb 21 01:18:00.994367 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 650/1284] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:00 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:01.571157 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-68658ee1-0b82-4674-a8b7-29bb094b952c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:01.571799 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-68658ee1-0b82-4674-a8b7-29bb094b952c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:01.578208 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68658ee1-0b82-4674-a8b7-29bb094b952c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:01.578578 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-da1edac3-91f7-4cec-b8af-bca9053c9936 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:01.579098 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68658ee1-0b82-4674-a8b7-29bb094b952c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:01.579423 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68658ee1-0b82-4674-a8b7-29bb094b952c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:01.579541 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-da1edac3-91f7-4cec-b8af-bca9053c9936 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:01.579870 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68658ee1-0b82-4674-a8b7-29bb094b952c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:01.586467 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-da1edac3-91f7-4cec-b8af-bca9053c9936 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:01.586914 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-da1edac3-91f7-4cec-b8af-bca9053c9936 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:01.587691 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-da1edac3-91f7-4cec-b8af-bca9053c9936 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:01.588217 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-da1edac3-91f7-4cec-b8af-bca9053c9936 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:01.617577 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-da1edac3-91f7-4cec-b8af-bca9053c9936 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042508 Feb 21 01:18:01.618047 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 651/1285] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:18:01 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:18:01.641075 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-68658ee1-0b82-4674-a8b7-29bb094b952c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:01.649598 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-68658ee1-0b82-4674-a8b7-29bb094b952c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082294 Feb 21 01:18:01.650179 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 635/1286] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:01 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:02.012310 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fff8156f-7c3f-4a23-a331-822f34786741 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:02.012929 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fff8156f-7c3f-4a23-a331-822f34786741 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:02.018748 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fff8156f-7c3f-4a23-a331-822f34786741 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:02.019201 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fff8156f-7c3f-4a23-a331-822f34786741 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:02.020016 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fff8156f-7c3f-4a23-a331-822f34786741 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:02.020448 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fff8156f-7c3f-4a23-a331-822f34786741 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:02.153142 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fff8156f-7c3f-4a23-a331-822f34786741 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:02.161353 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fff8156f-7c3f-4a23-a331-822f34786741 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:02.162896 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fff8156f-7c3f-4a23-a331-822f34786741 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:02.164392 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-fff8156f-7c3f-4a23-a331-822f34786741 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156343 Feb 21 01:18:02.164941 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 652/1287] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:02 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:02.629008 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-53b5b86b-9a93-4c25-a78d-eb7fa362d582 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:02.629831 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-53b5b86b-9a93-4c25-a78d-eb7fa362d582 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:02.636107 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-53b5b86b-9a93-4c25-a78d-eb7fa362d582 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:02.636549 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-53b5b86b-9a93-4c25-a78d-eb7fa362d582 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:02.637317 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-53b5b86b-9a93-4c25-a78d-eb7fa362d582 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:02.637743 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-53b5b86b-9a93-4c25-a78d-eb7fa362d582 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:02.667619 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e5d08eda-0e4a-4f4c-9f16-55013d839011 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:02.668256 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-53b5b86b-9a93-4c25-a78d-eb7fa362d582 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042697 Feb 21 01:18:02.668429 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 636/1288] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:18:02 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:18:02.668544 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e5d08eda-0e4a-4f4c-9f16-55013d839011 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:02.674865 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e5d08eda-0e4a-4f4c-9f16-55013d839011 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:02.675317 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e5d08eda-0e4a-4f4c-9f16-55013d839011 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:02.676133 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e5d08eda-0e4a-4f4c-9f16-55013d839011 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:02.676570 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e5d08eda-0e4a-4f4c-9f16-55013d839011 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:02.739384 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e5d08eda-0e4a-4f4c-9f16-55013d839011 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:02.746877 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e5d08eda-0e4a-4f4c-9f16-55013d839011 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084116 Feb 21 01:18:02.747430 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 653/1289] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:02 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:18:03.182336 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-92d0c160-d617-46fe-af46-097096a7bc4f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:03.182988 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-92d0c160-d617-46fe-af46-097096a7bc4f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:03.188760 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-92d0c160-d617-46fe-af46-097096a7bc4f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:03.189198 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-92d0c160-d617-46fe-af46-097096a7bc4f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:03.189964 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-92d0c160-d617-46fe-af46-097096a7bc4f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:03.190384 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-92d0c160-d617-46fe-af46-097096a7bc4f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:03.326273 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-92d0c160-d617-46fe-af46-097096a7bc4f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:03.334468 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-92d0c160-d617-46fe-af46-097096a7bc4f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:03.336161 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-92d0c160-d617-46fe-af46-097096a7bc4f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:03.337305 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-92d0c160-d617-46fe-af46-097096a7bc4f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158766 Feb 21 01:18:03.337858 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 637/1290] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:03 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:03.679784 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f90aa9d8-6fb9-4940-904a-ee33b2aec98b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:03.680727 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f90aa9d8-6fb9-4940-904a-ee33b2aec98b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:03.686937 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f90aa9d8-6fb9-4940-904a-ee33b2aec98b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:03.687385 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f90aa9d8-6fb9-4940-904a-ee33b2aec98b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:03.688206 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f90aa9d8-6fb9-4940-904a-ee33b2aec98b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:03.688647 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f90aa9d8-6fb9-4940-904a-ee33b2aec98b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:03.716988 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f90aa9d8-6fb9-4940-904a-ee33b2aec98b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041689 Feb 21 01:18:03.717536 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 654/1291] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:18:03 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:18:03.762558 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1123dc1d-e4fd-4131-9c4d-c6795cbe3658 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:03.763173 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1123dc1d-e4fd-4131-9c4d-c6795cbe3658 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:03.769463 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1123dc1d-e4fd-4131-9c4d-c6795cbe3658 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:03.769910 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1123dc1d-e4fd-4131-9c4d-c6795cbe3658 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:03.770691 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1123dc1d-e4fd-4131-9c4d-c6795cbe3658 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:03.771128 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1123dc1d-e4fd-4131-9c4d-c6795cbe3658 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:03.832635 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1123dc1d-e4fd-4131-9c4d-c6795cbe3658 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:03.840162 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1123dc1d-e4fd-4131-9c4d-c6795cbe3658 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081154 Feb 21 01:18:03.840726 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 638/1292] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:03 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:04.355154 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0948f2e9-352e-4082-8b6d-79603cc488aa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:04.355756 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0948f2e9-352e-4082-8b6d-79603cc488aa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:04.361726 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0948f2e9-352e-4082-8b6d-79603cc488aa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:04.362177 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0948f2e9-352e-4082-8b6d-79603cc488aa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:04.362954 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0948f2e9-352e-4082-8b6d-79603cc488aa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:04.363385 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0948f2e9-352e-4082-8b6d-79603cc488aa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:04.497778 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0948f2e9-352e-4082-8b6d-79603cc488aa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:04.505954 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0948f2e9-352e-4082-8b6d-79603cc488aa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:04.507982 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0948f2e9-352e-4082-8b6d-79603cc488aa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:04.509130 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0948f2e9-352e-4082-8b6d-79603cc488aa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157718 Feb 21 01:18:04.509683 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 655/1293] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:04 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:04.728162 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-53776a8d-fb84-4b2a-ab31-d9f5575ca11e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:04.729068 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-53776a8d-fb84-4b2a-ab31-d9f5575ca11e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:04.734928 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-53776a8d-fb84-4b2a-ab31-d9f5575ca11e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:04.735366 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-53776a8d-fb84-4b2a-ab31-d9f5575ca11e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:04.736166 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-53776a8d-fb84-4b2a-ab31-d9f5575ca11e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:04.736598 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-53776a8d-fb84-4b2a-ab31-d9f5575ca11e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:04.765951 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-53776a8d-fb84-4b2a-ab31-d9f5575ca11e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041703 Feb 21 01:18:04.766607 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 639/1294] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:18:04 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:18:04.857647 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5db67638-aef7-4ef9-b9e0-ee3e522ab1aa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:04.858247 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5db67638-aef7-4ef9-b9e0-ee3e522ab1aa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:04.864383 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5db67638-aef7-4ef9-b9e0-ee3e522ab1aa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:04.864827 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5db67638-aef7-4ef9-b9e0-ee3e522ab1aa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:04.865613 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5db67638-aef7-4ef9-b9e0-ee3e522ab1aa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:04.866050 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5db67638-aef7-4ef9-b9e0-ee3e522ab1aa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:04.929963 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5db67638-aef7-4ef9-b9e0-ee3e522ab1aa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:04.937373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5db67638-aef7-4ef9-b9e0-ee3e522ab1aa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084375 Feb 21 01:18:04.938059 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 656/1295] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:04 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:05.527700 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-988825e5-1009-4654-b24e-66dff10a9732 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:05.528341 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-988825e5-1009-4654-b24e-66dff10a9732 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:05.534560 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-988825e5-1009-4654-b24e-66dff10a9732 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:05.535005 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-988825e5-1009-4654-b24e-66dff10a9732 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:05.535779 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-988825e5-1009-4654-b24e-66dff10a9732 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:05.536235 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-988825e5-1009-4654-b24e-66dff10a9732 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:05.679474 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-988825e5-1009-4654-b24e-66dff10a9732 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:05.688760 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-988825e5-1009-4654-b24e-66dff10a9732 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:05.690237 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-988825e5-1009-4654-b24e-66dff10a9732 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:05.691455 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-988825e5-1009-4654-b24e-66dff10a9732 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.168237 Feb 21 01:18:05.692036 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 640/1296] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:05 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:05.777624 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0800a638-9381-4ece-96f9-db7191a84b84 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:05.778543 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0800a638-9381-4ece-96f9-db7191a84b84 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:05.784399 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0800a638-9381-4ece-96f9-db7191a84b84 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:05.784841 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0800a638-9381-4ece-96f9-db7191a84b84 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:05.785622 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0800a638-9381-4ece-96f9-db7191a84b84 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:05.786094 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0800a638-9381-4ece-96f9-db7191a84b84 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:05.816652 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0800a638-9381-4ece-96f9-db7191a84b84 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043352 Feb 21 01:18:05.817199 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 657/1297] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:18:05 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:18:05.955164 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9abe5d08-0993-44bf-8cf8-ed7875a5b3b4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:05.955793 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9abe5d08-0993-44bf-8cf8-ed7875a5b3b4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:05.961747 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9abe5d08-0993-44bf-8cf8-ed7875a5b3b4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:05.962196 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9abe5d08-0993-44bf-8cf8-ed7875a5b3b4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:05.962990 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9abe5d08-0993-44bf-8cf8-ed7875a5b3b4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:05.964072 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9abe5d08-0993-44bf-8cf8-ed7875a5b3b4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:06.034183 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9abe5d08-0993-44bf-8cf8-ed7875a5b3b4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:06.042859 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9abe5d08-0993-44bf-8cf8-ed7875a5b3b4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.091810 Feb 21 01:18:06.043442 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 641/1298] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:05 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:18:06.710301 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-24882119-00cc-462d-9099-3397d45c4df2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:06.710866 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-24882119-00cc-462d-9099-3397d45c4df2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:06.718062 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-24882119-00cc-462d-9099-3397d45c4df2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:06.718505 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-24882119-00cc-462d-9099-3397d45c4df2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:06.719285 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-24882119-00cc-462d-9099-3397d45c4df2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:06.719716 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-24882119-00cc-462d-9099-3397d45c4df2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:06.828821 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-31ecf2b1-26d6-46bb-9033-83c32b58f53d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:06.829734 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-31ecf2b1-26d6-46bb-9033-83c32b58f53d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:06.835907 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31ecf2b1-26d6-46bb-9033-83c32b58f53d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:06.836360 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31ecf2b1-26d6-46bb-9033-83c32b58f53d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:06.837186 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31ecf2b1-26d6-46bb-9033-83c32b58f53d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:06.837615 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31ecf2b1-26d6-46bb-9033-83c32b58f53d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:06.858184 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-24882119-00cc-462d-9099-3397d45c4df2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:06.866593 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-24882119-00cc-462d-9099-3397d45c4df2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:06.867645 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-31ecf2b1-26d6-46bb-9033-83c32b58f53d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042688 Feb 21 01:18:06.868174 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-24882119-00cc-462d-9099-3397d45c4df2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:06.868317 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 642/1299] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:18:06 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:18:06.869523 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-24882119-00cc-462d-9099-3397d45c4df2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.162831 Feb 21 01:18:06.870465 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 658/1300] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:06 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:07.060381 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ad90b47e-b221-47db-a198-8b6ad74cb49e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:07.060978 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ad90b47e-b221-47db-a198-8b6ad74cb49e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:07.067412 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ad90b47e-b221-47db-a198-8b6ad74cb49e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:07.067860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ad90b47e-b221-47db-a198-8b6ad74cb49e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:07.068643 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ad90b47e-b221-47db-a198-8b6ad74cb49e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:07.069066 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ad90b47e-b221-47db-a198-8b6ad74cb49e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:07.130639 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ad90b47e-b221-47db-a198-8b6ad74cb49e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:07.138723 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ad90b47e-b221-47db-a198-8b6ad74cb49e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082570 Feb 21 01:18:07.139292 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 643/1301] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:07 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:07.878466 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-36b25283-beed-487f-8096-2c0015066b18 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:07.879383 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-36b25283-beed-487f-8096-2c0015066b18 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:07.886072 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-36b25283-beed-487f-8096-2c0015066b18 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:07.886522 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-36b25283-beed-487f-8096-2c0015066b18 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:07.887314 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-36b25283-beed-487f-8096-2c0015066b18 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:07.887752 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-36b25283-beed-487f-8096-2c0015066b18 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:07.888003 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7fc91e40-a42e-40ae-b4df-488439168c1a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:07.888613 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7fc91e40-a42e-40ae-b4df-488439168c1a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:07.894791 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7fc91e40-a42e-40ae-b4df-488439168c1a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:07.895237 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7fc91e40-a42e-40ae-b4df-488439168c1a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:07.896048 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7fc91e40-a42e-40ae-b4df-488439168c1a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:07.896478 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7fc91e40-a42e-40ae-b4df-488439168c1a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:07.919787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-36b25283-beed-487f-8096-2c0015066b18 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044987 Feb 21 01:18:07.920371 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 659/1302] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:18:07 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:18:08.033738 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7fc91e40-a42e-40ae-b4df-488439168c1a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:08.042135 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7fc91e40-a42e-40ae-b4df-488439168c1a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:08.043635 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7fc91e40-a42e-40ae-b4df-488439168c1a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:08.044835 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7fc91e40-a42e-40ae-b4df-488439168c1a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160668 Feb 21 01:18:08.045388 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 644/1303] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:07 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:18:08.156255 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0fefc86c-638c-48aa-b0b0-11f9d1bbedb2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:08.156815 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0fefc86c-638c-48aa-b0b0-11f9d1bbedb2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:08.162619 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0fefc86c-638c-48aa-b0b0-11f9d1bbedb2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:08.163069 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0fefc86c-638c-48aa-b0b0-11f9d1bbedb2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:08.163854 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0fefc86c-638c-48aa-b0b0-11f9d1bbedb2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:08.164311 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0fefc86c-638c-48aa-b0b0-11f9d1bbedb2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:08.223641 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0fefc86c-638c-48aa-b0b0-11f9d1bbedb2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:08.231499 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0fefc86c-638c-48aa-b0b0-11f9d1bbedb2 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079210 Feb 21 01:18:08.232098 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 660/1304] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:08 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:08.930240 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0c615ad8-90d4-445d-a9f7-37b5a50729ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:08.931154 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0c615ad8-90d4-445d-a9f7-37b5a50729ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:08.937913 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c615ad8-90d4-445d-a9f7-37b5a50729ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:08.938360 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c615ad8-90d4-445d-a9f7-37b5a50729ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:08.939145 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c615ad8-90d4-445d-a9f7-37b5a50729ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:08.939578 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c615ad8-90d4-445d-a9f7-37b5a50729ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:08.970752 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0c615ad8-90d4-445d-a9f7-37b5a50729ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044351 Feb 21 01:18:08.971331 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 645/1305] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:18:08 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:18:09.064126 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0a9efa3f-23a2-4498-939d-1f6f9620929d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:09.064762 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0a9efa3f-23a2-4498-939d-1f6f9620929d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:09.071131 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a9efa3f-23a2-4498-939d-1f6f9620929d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:09.071575 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a9efa3f-23a2-4498-939d-1f6f9620929d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:09.072751 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a9efa3f-23a2-4498-939d-1f6f9620929d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:09.073293 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a9efa3f-23a2-4498-939d-1f6f9620929d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:09.204959 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0a9efa3f-23a2-4498-939d-1f6f9620929d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:09.213535 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0a9efa3f-23a2-4498-939d-1f6f9620929d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:09.215225 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0a9efa3f-23a2-4498-939d-1f6f9620929d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:09.216391 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0a9efa3f-23a2-4498-939d-1f6f9620929d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156291 Feb 21 01:18:09.216937 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 661/1306] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:09 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:09.248383 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a993eda3-14b4-4679-9056-b0f3189c696b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:09.249000 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a993eda3-14b4-4679-9056-b0f3189c696b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:09.254819 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a993eda3-14b4-4679-9056-b0f3189c696b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:09.255319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a993eda3-14b4-4679-9056-b0f3189c696b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:09.256120 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a993eda3-14b4-4679-9056-b0f3189c696b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:09.256552 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a993eda3-14b4-4679-9056-b0f3189c696b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:09.319774 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a993eda3-14b4-4679-9056-b0f3189c696b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:09.328111 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a993eda3-14b4-4679-9056-b0f3189c696b tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083972 Feb 21 01:18:09.328669 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 646/1307] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:09 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:09.983137 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-83ca0dee-6e9d-4152-b084-0127e1f3212f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:18:09.984090 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-83ca0dee-6e9d-4152-b084-0127e1f3212f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:09.989942 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83ca0dee-6e9d-4152-b084-0127e1f3212f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:09.990393 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83ca0dee-6e9d-4152-b084-0127e1f3212f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:09.991180 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83ca0dee-6e9d-4152-b084-0127e1f3212f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:09.991617 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83ca0dee-6e9d-4152-b084-0127e1f3212f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:10.065555 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-83ca0dee-6e9d-4152-b084-0127e1f3212f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "POST /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/action" status: 200 len: 72442 microversion: 2.1 time: 0.086860 Feb 21 01:18:10.066243 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 662/1308] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Feb 21 01:18:09 2022] POST /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab/action => generated 72442 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:18:10.234833 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fa7f56ce-55e8-4f8f-a837-10ece389fcee tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:10.235396 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fa7f56ce-55e8-4f8f-a837-10ece389fcee tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:10.241748 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fa7f56ce-55e8-4f8f-a837-10ece389fcee tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:10.242191 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fa7f56ce-55e8-4f8f-a837-10ece389fcee tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:10.242962 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fa7f56ce-55e8-4f8f-a837-10ece389fcee tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:10.243393 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fa7f56ce-55e8-4f8f-a837-10ece389fcee tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:10.345301 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1ed9908c-197a-4eb7-823a-1bacb582938a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:10.346014 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1ed9908c-197a-4eb7-823a-1bacb582938a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:10.352821 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1ed9908c-197a-4eb7-823a-1bacb582938a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:10.354273 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1ed9908c-197a-4eb7-823a-1bacb582938a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:10.354590 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1ed9908c-197a-4eb7-823a-1bacb582938a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:10.355186 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1ed9908c-197a-4eb7-823a-1bacb582938a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:10.378757 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fa7f56ce-55e8-4f8f-a837-10ece389fcee tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:10.387655 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fa7f56ce-55e8-4f8f-a837-10ece389fcee tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:10.389186 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fa7f56ce-55e8-4f8f-a837-10ece389fcee tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:10.390358 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fa7f56ce-55e8-4f8f-a837-10ece389fcee tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159360 Feb 21 01:18:10.390943 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 647/1309] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:10 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:10.418025 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1ed9908c-197a-4eb7-823a-1bacb582938a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:10.425270 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1ed9908c-197a-4eb7-823a-1bacb582938a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083918 Feb 21 01:18:10.425819 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 663/1310] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:10 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:18:11.408901 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e7bf590f-c418-4a5b-9e27-cea9918fe7d5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:11.409584 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e7bf590f-c418-4a5b-9e27-cea9918fe7d5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:11.416033 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e7bf590f-c418-4a5b-9e27-cea9918fe7d5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:11.416500 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e7bf590f-c418-4a5b-9e27-cea9918fe7d5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:11.417287 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e7bf590f-c418-4a5b-9e27-cea9918fe7d5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:11.417723 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e7bf590f-c418-4a5b-9e27-cea9918fe7d5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:11.442367 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6053feae-b6b4-41f4-9883-3c689278786a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:11.443077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6053feae-b6b4-41f4-9883-3c689278786a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:11.450573 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6053feae-b6b4-41f4-9883-3c689278786a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:11.451113 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6053feae-b6b4-41f4-9883-3c689278786a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:11.452044 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6053feae-b6b4-41f4-9883-3c689278786a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:11.452545 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6053feae-b6b4-41f4-9883-3c689278786a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:11.517557 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-6053feae-b6b4-41f4-9883-3c689278786a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:11.525012 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6053feae-b6b4-41f4-9883-3c689278786a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.086416 Feb 21 01:18:11.525861 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 664/1311] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:11 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:18:11.551297 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e7bf590f-c418-4a5b-9e27-cea9918fe7d5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:11.560078 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e7bf590f-c418-4a5b-9e27-cea9918fe7d5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:11.561571 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e7bf590f-c418-4a5b-9e27-cea9918fe7d5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:11.562727 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e7bf590f-c418-4a5b-9e27-cea9918fe7d5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157999 Feb 21 01:18:11.563270 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 648/1312] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:11 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:12.542314 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2e853362-414b-4d51-bfd1-75e192d8b97f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:12.542916 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2e853362-414b-4d51-bfd1-75e192d8b97f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:12.549313 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e853362-414b-4d51-bfd1-75e192d8b97f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:12.549758 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e853362-414b-4d51-bfd1-75e192d8b97f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:12.550574 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e853362-414b-4d51-bfd1-75e192d8b97f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:12.550968 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e853362-414b-4d51-bfd1-75e192d8b97f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:12.581058 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e79d2b21-1f6f-4ecb-bf97-1bf3480331c3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:12.581639 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e79d2b21-1f6f-4ecb-bf97-1bf3480331c3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:12.588498 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e79d2b21-1f6f-4ecb-bf97-1bf3480331c3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:12.589056 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e79d2b21-1f6f-4ecb-bf97-1bf3480331c3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:12.589903 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e79d2b21-1f6f-4ecb-bf97-1bf3480331c3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:12.590330 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e79d2b21-1f6f-4ecb-bf97-1bf3480331c3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:12.610424 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2e853362-414b-4d51-bfd1-75e192d8b97f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:12.617634 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2e853362-414b-4d51-bfd1-75e192d8b97f tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079104 Feb 21 01:18:12.618191 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 665/1313] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:12 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:12.729352 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e79d2b21-1f6f-4ecb-bf97-1bf3480331c3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:12.737567 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e79d2b21-1f6f-4ecb-bf97-1bf3480331c3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:12.739041 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e79d2b21-1f6f-4ecb-bf97-1bf3480331c3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:12.740224 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e79d2b21-1f6f-4ecb-bf97-1bf3480331c3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.162789 Feb 21 01:18:12.740794 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 649/1314] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:12 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:18:13.633537 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4be274ab-2a76-4144-9f7b-274aade23721 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:13.634086 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4be274ab-2a76-4144-9f7b-274aade23721 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:13.641022 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4be274ab-2a76-4144-9f7b-274aade23721 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:13.641461 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4be274ab-2a76-4144-9f7b-274aade23721 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:13.642248 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4be274ab-2a76-4144-9f7b-274aade23721 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:13.642665 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4be274ab-2a76-4144-9f7b-274aade23721 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:13.704886 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4be274ab-2a76-4144-9f7b-274aade23721 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:13.712189 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4be274ab-2a76-4144-9f7b-274aade23721 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082339 Feb 21 01:18:13.714548 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 666/1315] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:13 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:13.758294 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-87bc7f01-3814-43aa-bc73-6810aa38c3e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:13.758906 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-87bc7f01-3814-43aa-bc73-6810aa38c3e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:13.765850 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-87bc7f01-3814-43aa-bc73-6810aa38c3e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:13.766330 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-87bc7f01-3814-43aa-bc73-6810aa38c3e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:13.767114 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-87bc7f01-3814-43aa-bc73-6810aa38c3e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:13.767547 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-87bc7f01-3814-43aa-bc73-6810aa38c3e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:13.898829 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-87bc7f01-3814-43aa-bc73-6810aa38c3e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:13.907939 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-87bc7f01-3814-43aa-bc73-6810aa38c3e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:13.909418 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-87bc7f01-3814-43aa-bc73-6810aa38c3e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:13.910555 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-87bc7f01-3814-43aa-bc73-6810aa38c3e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156096 Feb 21 01:18:13.911110 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 650/1316] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:13 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:14.731062 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b1a8443a-6d1a-492c-b691-aa54a25966cc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:14.731678 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b1a8443a-6d1a-492c-b691-aa54a25966cc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:14.738033 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b1a8443a-6d1a-492c-b691-aa54a25966cc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:14.738484 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b1a8443a-6d1a-492c-b691-aa54a25966cc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:14.739274 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b1a8443a-6d1a-492c-b691-aa54a25966cc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:14.739704 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b1a8443a-6d1a-492c-b691-aa54a25966cc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:14.801010 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b1a8443a-6d1a-492c-b691-aa54a25966cc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:14.808600 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b1a8443a-6d1a-492c-b691-aa54a25966cc tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081997 Feb 21 01:18:14.809157 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 667/1317] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:14 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:14.929130 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7ea854c4-68f7-4935-9987-210ea7e3d4cf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:14.929771 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7ea854c4-68f7-4935-9987-210ea7e3d4cf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:14.936961 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7ea854c4-68f7-4935-9987-210ea7e3d4cf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:14.937401 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7ea854c4-68f7-4935-9987-210ea7e3d4cf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:14.938174 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7ea854c4-68f7-4935-9987-210ea7e3d4cf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:14.938600 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7ea854c4-68f7-4935-9987-210ea7e3d4cf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:15.067600 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7ea854c4-68f7-4935-9987-210ea7e3d4cf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:15.077035 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7ea854c4-68f7-4935-9987-210ea7e3d4cf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:15.078564 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7ea854c4-68f7-4935-9987-210ea7e3d4cf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:15.079756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7ea854c4-68f7-4935-9987-210ea7e3d4cf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.154368 Feb 21 01:18:15.080340 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 651/1318] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:14 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:15.825583 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ff796158-5387-4830-9fd3-e651c991231d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:15.826174 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ff796158-5387-4830-9fd3-e651c991231d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:15.832644 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ff796158-5387-4830-9fd3-e651c991231d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:15.833095 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ff796158-5387-4830-9fd3-e651c991231d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:15.833878 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ff796158-5387-4830-9fd3-e651c991231d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:15.834314 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ff796158-5387-4830-9fd3-e651c991231d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:15.895382 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ff796158-5387-4830-9fd3-e651c991231d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:15.903777 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ff796158-5387-4830-9fd3-e651c991231d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082522 Feb 21 01:18:15.904397 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 668/1319] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:15 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:16.098713 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0c571f0e-ec0c-466e-af96-f1e3fd860d12 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:16.099273 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0c571f0e-ec0c-466e-af96-f1e3fd860d12 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:16.106310 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c571f0e-ec0c-466e-af96-f1e3fd860d12 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:16.106759 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c571f0e-ec0c-466e-af96-f1e3fd860d12 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:16.107535 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c571f0e-ec0c-466e-af96-f1e3fd860d12 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:16.107997 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c571f0e-ec0c-466e-af96-f1e3fd860d12 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:16.241213 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0c571f0e-ec0c-466e-af96-f1e3fd860d12 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:16.249536 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0c571f0e-ec0c-466e-af96-f1e3fd860d12 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:16.251006 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0c571f0e-ec0c-466e-af96-f1e3fd860d12 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:16.252182 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0c571f0e-ec0c-466e-af96-f1e3fd860d12 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157252 Feb 21 01:18:16.252727 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 652/1320] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:16 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:18:16.920383 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0ac8fdbf-9186-491c-a868-2dc68f1755f0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:16.920977 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0ac8fdbf-9186-491c-a868-2dc68f1755f0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:16.927413 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0ac8fdbf-9186-491c-a868-2dc68f1755f0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:16.927894 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0ac8fdbf-9186-491c-a868-2dc68f1755f0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:16.928687 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0ac8fdbf-9186-491c-a868-2dc68f1755f0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:16.929123 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0ac8fdbf-9186-491c-a868-2dc68f1755f0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:16.988636 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0ac8fdbf-9186-491c-a868-2dc68f1755f0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:16.996906 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0ac8fdbf-9186-491c-a868-2dc68f1755f0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080214 Feb 21 01:18:16.997472 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 669/1321] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:16 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:17.270441 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5c12ef32-2115-45fd-8f98-d12caef03b1e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:17.271056 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5c12ef32-2115-45fd-8f98-d12caef03b1e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:17.277343 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c12ef32-2115-45fd-8f98-d12caef03b1e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:17.277790 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c12ef32-2115-45fd-8f98-d12caef03b1e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:17.278604 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c12ef32-2115-45fd-8f98-d12caef03b1e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:17.279041 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c12ef32-2115-45fd-8f98-d12caef03b1e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:17.412369 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5c12ef32-2115-45fd-8f98-d12caef03b1e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:17.421720 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5c12ef32-2115-45fd-8f98-d12caef03b1e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:17.423228 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5c12ef32-2115-45fd-8f98-d12caef03b1e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:17.424422 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5c12ef32-2115-45fd-8f98-d12caef03b1e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157775 Feb 21 01:18:17.424985 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 653/1322] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:17 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:18.013943 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-849c80b1-ac10-4531-84c7-959482e1befa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:18.014539 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-849c80b1-ac10-4531-84c7-959482e1befa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:18.020972 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-849c80b1-ac10-4531-84c7-959482e1befa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:18.021427 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-849c80b1-ac10-4531-84c7-959482e1befa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:18.022210 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-849c80b1-ac10-4531-84c7-959482e1befa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:18.022648 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-849c80b1-ac10-4531-84c7-959482e1befa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:18.086129 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-849c80b1-ac10-4531-84c7-959482e1befa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:18.094609 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-849c80b1-ac10-4531-84c7-959482e1befa tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084721 Feb 21 01:18:18.095174 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 670/1323] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:18 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:18.443133 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b19e1478-6ab3-4dd5-b0d6-35b021714219 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:18.443746 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b19e1478-6ab3-4dd5-b0d6-35b021714219 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:18.450568 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b19e1478-6ab3-4dd5-b0d6-35b021714219 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:18.451038 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b19e1478-6ab3-4dd5-b0d6-35b021714219 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:18.451874 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b19e1478-6ab3-4dd5-b0d6-35b021714219 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:18.452289 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b19e1478-6ab3-4dd5-b0d6-35b021714219 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:18.885723 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b19e1478-6ab3-4dd5-b0d6-35b021714219 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:18.894190 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b19e1478-6ab3-4dd5-b0d6-35b021714219 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:18.895693 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b19e1478-6ab3-4dd5-b0d6-35b021714219 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:18.896903 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b19e1478-6ab3-4dd5-b0d6-35b021714219 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.457705 Feb 21 01:18:18.897461 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 654/1324] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:18 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:19.113129 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f0a99e6a-68a6-4738-84d7-52b1138db01d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:19.113784 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f0a99e6a-68a6-4738-84d7-52b1138db01d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:19.120630 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f0a99e6a-68a6-4738-84d7-52b1138db01d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:19.121080 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f0a99e6a-68a6-4738-84d7-52b1138db01d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:19.121871 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f0a99e6a-68a6-4738-84d7-52b1138db01d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:19.122306 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f0a99e6a-68a6-4738-84d7-52b1138db01d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:19.183054 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f0a99e6a-68a6-4738-84d7-52b1138db01d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:19.190206 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f0a99e6a-68a6-4738-84d7-52b1138db01d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080785 Feb 21 01:18:19.190763 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 671/1325] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:19 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:18:19.915980 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3b8b224b-29ed-4d65-b028-5413bf5549d5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:19.916569 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3b8b224b-29ed-4d65-b028-5413bf5549d5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:19.922810 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3b8b224b-29ed-4d65-b028-5413bf5549d5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:19.923265 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3b8b224b-29ed-4d65-b028-5413bf5549d5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:19.924077 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3b8b224b-29ed-4d65-b028-5413bf5549d5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:19.924520 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3b8b224b-29ed-4d65-b028-5413bf5549d5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:20.059211 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3b8b224b-29ed-4d65-b028-5413bf5549d5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:20.067245 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3b8b224b-29ed-4d65-b028-5413bf5549d5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:20.068754 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3b8b224b-29ed-4d65-b028-5413bf5549d5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:20.069893 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3b8b224b-29ed-4d65-b028-5413bf5549d5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157825 Feb 21 01:18:20.070447 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 655/1326] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:19 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:20.207574 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d2f3d30d-16ab-4c18-8de1-52a7636946b6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:20.208212 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d2f3d30d-16ab-4c18-8de1-52a7636946b6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:20.214513 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d2f3d30d-16ab-4c18-8de1-52a7636946b6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:20.214967 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d2f3d30d-16ab-4c18-8de1-52a7636946b6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:20.215741 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d2f3d30d-16ab-4c18-8de1-52a7636946b6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:20.216200 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d2f3d30d-16ab-4c18-8de1-52a7636946b6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:20.275199 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d2f3d30d-16ab-4c18-8de1-52a7636946b6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:20.282727 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d2f3d30d-16ab-4c18-8de1-52a7636946b6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.078804 Feb 21 01:18:20.283291 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 672/1327] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:20 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:21.087992 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f31a3690-e5fe-4f54-972a-83fbd1160cf2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:21.089319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f31a3690-e5fe-4f54-972a-83fbd1160cf2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:21.095505 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f31a3690-e5fe-4f54-972a-83fbd1160cf2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:21.095997 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f31a3690-e5fe-4f54-972a-83fbd1160cf2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:21.096780 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f31a3690-e5fe-4f54-972a-83fbd1160cf2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:21.097218 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f31a3690-e5fe-4f54-972a-83fbd1160cf2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:21.234010 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f31a3690-e5fe-4f54-972a-83fbd1160cf2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:21.242192 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f31a3690-e5fe-4f54-972a-83fbd1160cf2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:21.243683 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f31a3690-e5fe-4f54-972a-83fbd1160cf2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:21.245503 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f31a3690-e5fe-4f54-972a-83fbd1160cf2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.161169 Feb 21 01:18:21.246126 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 656/1328] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:21 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:21.300381 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8db8a592-3db4-49c9-bbf1-194d108098a5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:21.300986 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8db8a592-3db4-49c9-bbf1-194d108098a5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:21.307730 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8db8a592-3db4-49c9-bbf1-194d108098a5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:21.308213 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8db8a592-3db4-49c9-bbf1-194d108098a5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:21.308999 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8db8a592-3db4-49c9-bbf1-194d108098a5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:21.309436 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8db8a592-3db4-49c9-bbf1-194d108098a5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:21.369406 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8db8a592-3db4-49c9-bbf1-194d108098a5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:21.377472 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8db8a592-3db4-49c9-bbf1-194d108098a5 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080689 Feb 21 01:18:21.378041 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 673/1329] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:21 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:22.263988 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-63a2c5bf-cd6d-4a7f-855f-2c2c89eac305 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:22.264601 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-63a2c5bf-cd6d-4a7f-855f-2c2c89eac305 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:22.270795 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-63a2c5bf-cd6d-4a7f-855f-2c2c89eac305 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:22.271242 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-63a2c5bf-cd6d-4a7f-855f-2c2c89eac305 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:22.272130 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-63a2c5bf-cd6d-4a7f-855f-2c2c89eac305 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:22.272567 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-63a2c5bf-cd6d-4a7f-855f-2c2c89eac305 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:22.394410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8109b375-db11-4d96-98d6-6a979dbed40d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:22.395001 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8109b375-db11-4d96-98d6-6a979dbed40d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:22.401418 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8109b375-db11-4d96-98d6-6a979dbed40d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:22.402199 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8109b375-db11-4d96-98d6-6a979dbed40d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:22.403224 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8109b375-db11-4d96-98d6-6a979dbed40d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:22.403347 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-63a2c5bf-cd6d-4a7f-855f-2c2c89eac305 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:22.403660 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8109b375-db11-4d96-98d6-6a979dbed40d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:22.411958 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-63a2c5bf-cd6d-4a7f-855f-2c2c89eac305 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:22.413417 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-63a2c5bf-cd6d-4a7f-855f-2c2c89eac305 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:22.414568 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-63a2c5bf-cd6d-4a7f-855f-2c2c89eac305 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.154709 Feb 21 01:18:22.415120 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 657/1330] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:22 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:22.463663 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8109b375-db11-4d96-98d6-6a979dbed40d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:22.471060 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8109b375-db11-4d96-98d6-6a979dbed40d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080500 Feb 21 01:18:22.471627 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 674/1331] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:22 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:18:23.434379 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3f55b567-4caa-4ffc-873d-c6c3c6c5dc86 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:23.434992 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3f55b567-4caa-4ffc-873d-c6c3c6c5dc86 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:23.441306 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3f55b567-4caa-4ffc-873d-c6c3c6c5dc86 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:23.441760 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3f55b567-4caa-4ffc-873d-c6c3c6c5dc86 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:23.442575 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3f55b567-4caa-4ffc-873d-c6c3c6c5dc86 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:23.443013 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3f55b567-4caa-4ffc-873d-c6c3c6c5dc86 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:23.487947 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a72ab05c-83c0-43fd-8eeb-f8498a4cb35a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:23.488733 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a72ab05c-83c0-43fd-8eeb-f8498a4cb35a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:23.495496 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a72ab05c-83c0-43fd-8eeb-f8498a4cb35a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:23.496138 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a72ab05c-83c0-43fd-8eeb-f8498a4cb35a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:23.496920 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a72ab05c-83c0-43fd-8eeb-f8498a4cb35a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:23.497349 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a72ab05c-83c0-43fd-8eeb-f8498a4cb35a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:23.559324 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a72ab05c-83c0-43fd-8eeb-f8498a4cb35a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:23.566686 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a72ab05c-83c0-43fd-8eeb-f8498a4cb35a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082431 Feb 21 01:18:23.567249 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 675/1332] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:23 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:18:23.576754 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3f55b567-4caa-4ffc-873d-c6c3c6c5dc86 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:23.584995 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3f55b567-4caa-4ffc-873d-c6c3c6c5dc86 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:23.586505 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3f55b567-4caa-4ffc-873d-c6c3c6c5dc86 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:23.587666 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3f55b567-4caa-4ffc-873d-c6c3c6c5dc86 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157836 Feb 21 01:18:23.588256 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 658/1333] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:23 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:24.584135 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-834bceb5-e261-44f7-ba1e-25b7cb34aa70 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:24.584784 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-834bceb5-e261-44f7-ba1e-25b7cb34aa70 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:24.591680 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-834bceb5-e261-44f7-ba1e-25b7cb34aa70 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:24.592145 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-834bceb5-e261-44f7-ba1e-25b7cb34aa70 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:24.592915 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-834bceb5-e261-44f7-ba1e-25b7cb34aa70 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:24.593341 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-834bceb5-e261-44f7-ba1e-25b7cb34aa70 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:24.605924 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d42b2fa5-429e-4ecc-b9a0-0ec81b108654 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:24.606528 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d42b2fa5-429e-4ecc-b9a0-0ec81b108654 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:24.613018 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d42b2fa5-429e-4ecc-b9a0-0ec81b108654 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:24.613393 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d42b2fa5-429e-4ecc-b9a0-0ec81b108654 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:24.614168 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d42b2fa5-429e-4ecc-b9a0-0ec81b108654 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:24.614597 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d42b2fa5-429e-4ecc-b9a0-0ec81b108654 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:24.657667 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-834bceb5-e261-44f7-ba1e-25b7cb34aa70 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:24.665081 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-834bceb5-e261-44f7-ba1e-25b7cb34aa70 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084501 Feb 21 01:18:24.665679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 676/1334] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:24 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:24.752664 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d42b2fa5-429e-4ecc-b9a0-0ec81b108654 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:24.761387 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d42b2fa5-429e-4ecc-b9a0-0ec81b108654 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:24.762995 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d42b2fa5-429e-4ecc-b9a0-0ec81b108654 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:24.764154 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d42b2fa5-429e-4ecc-b9a0-0ec81b108654 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.162213 Feb 21 01:18:24.764708 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 659/1335] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:24 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:18:25.682183 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-977e3f18-6a58-44b2-8bb7-c516e676c604 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:25.683021 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-977e3f18-6a58-44b2-8bb7-c516e676c604 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:25.690108 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-977e3f18-6a58-44b2-8bb7-c516e676c604 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:25.690556 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-977e3f18-6a58-44b2-8bb7-c516e676c604 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:25.691341 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-977e3f18-6a58-44b2-8bb7-c516e676c604 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:25.691786 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-977e3f18-6a58-44b2-8bb7-c516e676c604 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:25.755414 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-977e3f18-6a58-44b2-8bb7-c516e676c604 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:25.765313 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-977e3f18-6a58-44b2-8bb7-c516e676c604 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.087301 Feb 21 01:18:25.765874 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 677/1336] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:25 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:18:25.782812 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c16ab2f7-b101-477f-976c-bc439c0d80d7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:25.788472 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c16ab2f7-b101-477f-976c-bc439c0d80d7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:25.790573 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c16ab2f7-b101-477f-976c-bc439c0d80d7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:25.791049 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c16ab2f7-b101-477f-976c-bc439c0d80d7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:25.792496 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c16ab2f7-b101-477f-976c-bc439c0d80d7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:25.792937 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c16ab2f7-b101-477f-976c-bc439c0d80d7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:25.933659 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c16ab2f7-b101-477f-976c-bc439c0d80d7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:25.942135 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c16ab2f7-b101-477f-976c-bc439c0d80d7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:25.943618 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c16ab2f7-b101-477f-976c-bc439c0d80d7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:25.944794 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c16ab2f7-b101-477f-976c-bc439c0d80d7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.165839 Feb 21 01:18:25.945355 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 660/1337] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:25 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:26.783171 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-309a663f-b4af-43d4-b2bb-090091e732af tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:26.784187 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-309a663f-b4af-43d4-b2bb-090091e732af tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:26.790594 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-309a663f-b4af-43d4-b2bb-090091e732af tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:26.791042 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-309a663f-b4af-43d4-b2bb-090091e732af tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:26.791883 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-309a663f-b4af-43d4-b2bb-090091e732af tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:26.792900 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-309a663f-b4af-43d4-b2bb-090091e732af tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:26.855421 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-309a663f-b4af-43d4-b2bb-090091e732af tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:26.863126 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-309a663f-b4af-43d4-b2bb-090091e732af tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083881 Feb 21 01:18:26.863685 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 678/1338] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:26 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:26.962999 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6b4a34f5-b13f-470f-bb42-edebd85f69c2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:26.963631 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6b4a34f5-b13f-470f-bb42-edebd85f69c2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:26.970040 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b4a34f5-b13f-470f-bb42-edebd85f69c2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:26.970482 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b4a34f5-b13f-470f-bb42-edebd85f69c2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:26.971253 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b4a34f5-b13f-470f-bb42-edebd85f69c2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:26.971678 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b4a34f5-b13f-470f-bb42-edebd85f69c2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:27.110968 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6b4a34f5-b13f-470f-bb42-edebd85f69c2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:27.119313 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6b4a34f5-b13f-470f-bb42-edebd85f69c2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:27.121399 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6b4a34f5-b13f-470f-bb42-edebd85f69c2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:27.122566 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6b4a34f5-b13f-470f-bb42-edebd85f69c2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.163315 Feb 21 01:18:27.123129 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 661/1339] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:26 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:27.880489 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a6f5f07c-b392-4dad-af68-51699721b91c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:27.881117 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a6f5f07c-b392-4dad-af68-51699721b91c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:27.888475 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a6f5f07c-b392-4dad-af68-51699721b91c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:27.888926 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a6f5f07c-b392-4dad-af68-51699721b91c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:27.889773 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a6f5f07c-b392-4dad-af68-51699721b91c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:27.890300 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a6f5f07c-b392-4dad-af68-51699721b91c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:27.950991 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a6f5f07c-b392-4dad-af68-51699721b91c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:27.958241 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a6f5f07c-b392-4dad-af68-51699721b91c tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081571 Feb 21 01:18:27.958801 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 679/1340] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:27 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:28.141758 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-75f4bf57-30d6-4edb-9f92-f4726a57853e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:28.142320 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-75f4bf57-30d6-4edb-9f92-f4726a57853e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:28.148440 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-75f4bf57-30d6-4edb-9f92-f4726a57853e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:28.148880 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-75f4bf57-30d6-4edb-9f92-f4726a57853e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:28.149645 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-75f4bf57-30d6-4edb-9f92-f4726a57853e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:28.150074 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-75f4bf57-30d6-4edb-9f92-f4726a57853e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:28.281734 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-75f4bf57-30d6-4edb-9f92-f4726a57853e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:28.290143 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-75f4bf57-30d6-4edb-9f92-f4726a57853e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:28.291634 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-75f4bf57-30d6-4edb-9f92-f4726a57853e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:28.293373 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-75f4bf57-30d6-4edb-9f92-f4726a57853e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155997 Feb 21 01:18:28.293919 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 662/1341] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:28 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:28.974753 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e239f388-a44d-4442-af73-0f0688b0cb69 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:28.975368 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e239f388-a44d-4442-af73-0f0688b0cb69 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:28.982263 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e239f388-a44d-4442-af73-0f0688b0cb69 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:28.982705 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e239f388-a44d-4442-af73-0f0688b0cb69 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:28.983486 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e239f388-a44d-4442-af73-0f0688b0cb69 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:28.983948 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e239f388-a44d-4442-af73-0f0688b0cb69 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:29.044186 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e239f388-a44d-4442-af73-0f0688b0cb69 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:29.051568 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e239f388-a44d-4442-af73-0f0688b0cb69 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080518 Feb 21 01:18:29.052163 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 680/1342] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:28 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:29.311611 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9e3058ad-dcbc-4257-877e-94e2bfc5170c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:29.312185 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9e3058ad-dcbc-4257-877e-94e2bfc5170c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:29.318525 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9e3058ad-dcbc-4257-877e-94e2bfc5170c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:29.318991 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9e3058ad-dcbc-4257-877e-94e2bfc5170c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:29.319768 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9e3058ad-dcbc-4257-877e-94e2bfc5170c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:29.320230 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9e3058ad-dcbc-4257-877e-94e2bfc5170c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:29.455536 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9e3058ad-dcbc-4257-877e-94e2bfc5170c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:29.464230 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9e3058ad-dcbc-4257-877e-94e2bfc5170c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:29.465845 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9e3058ad-dcbc-4257-877e-94e2bfc5170c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:29.467116 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9e3058ad-dcbc-4257-877e-94e2bfc5170c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159427 Feb 21 01:18:29.467709 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 663/1343] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:29 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:30.068156 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7ab275ac-1de8-4022-806c-d4764555bfc4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:30.068751 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7ab275ac-1de8-4022-806c-d4764555bfc4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:30.075154 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7ab275ac-1de8-4022-806c-d4764555bfc4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:30.075592 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7ab275ac-1de8-4022-806c-d4764555bfc4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:30.076394 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7ab275ac-1de8-4022-806c-d4764555bfc4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:30.076824 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7ab275ac-1de8-4022-806c-d4764555bfc4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:30.135590 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7ab275ac-1de8-4022-806c-d4764555bfc4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:30.142965 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7ab275ac-1de8-4022-806c-d4764555bfc4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.078491 Feb 21 01:18:30.143514 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 681/1344] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:30 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:30.486066 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1fa0365a-5d44-49db-b946-466e0c81c93b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:30.486666 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1fa0365a-5d44-49db-b946-466e0c81c93b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:30.492876 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1fa0365a-5d44-49db-b946-466e0c81c93b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:30.493321 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1fa0365a-5d44-49db-b946-466e0c81c93b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:30.494101 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1fa0365a-5d44-49db-b946-466e0c81c93b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:30.494535 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1fa0365a-5d44-49db-b946-466e0c81c93b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:30.628236 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1fa0365a-5d44-49db-b946-466e0c81c93b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:30.636957 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1fa0365a-5d44-49db-b946-466e0c81c93b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:30.638458 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1fa0365a-5d44-49db-b946-466e0c81c93b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:30.639623 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1fa0365a-5d44-49db-b946-466e0c81c93b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157326 Feb 21 01:18:30.640216 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 664/1345] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:30 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:31.160088 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f13a642f-6eb4-49aa-84a7-56299a3bdf21 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:31.160701 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f13a642f-6eb4-49aa-84a7-56299a3bdf21 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:31.166943 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f13a642f-6eb4-49aa-84a7-56299a3bdf21 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:31.167693 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f13a642f-6eb4-49aa-84a7-56299a3bdf21 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:31.168515 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f13a642f-6eb4-49aa-84a7-56299a3bdf21 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:31.168967 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f13a642f-6eb4-49aa-84a7-56299a3bdf21 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:31.235528 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f13a642f-6eb4-49aa-84a7-56299a3bdf21 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:31.243039 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f13a642f-6eb4-49aa-84a7-56299a3bdf21 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.086615 Feb 21 01:18:31.243704 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 682/1346] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:31 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:31.658808 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7472b2bf-1d3c-4cf6-907e-af32a013de9d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:31.659412 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7472b2bf-1d3c-4cf6-907e-af32a013de9d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:31.665677 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7472b2bf-1d3c-4cf6-907e-af32a013de9d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:31.666127 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7472b2bf-1d3c-4cf6-907e-af32a013de9d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:31.667795 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7472b2bf-1d3c-4cf6-907e-af32a013de9d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:31.668627 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7472b2bf-1d3c-4cf6-907e-af32a013de9d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:31.800469 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7472b2bf-1d3c-4cf6-907e-af32a013de9d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:31.808937 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7472b2bf-1d3c-4cf6-907e-af32a013de9d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:31.810428 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7472b2bf-1d3c-4cf6-907e-af32a013de9d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:31.811595 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7472b2bf-1d3c-4cf6-907e-af32a013de9d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156582 Feb 21 01:18:31.812192 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 665/1347] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:31 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:32.262026 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c469ab3f-5440-4741-adb6-50694e4d6378 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:32.262833 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c469ab3f-5440-4741-adb6-50694e4d6378 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:32.269163 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c469ab3f-5440-4741-adb6-50694e4d6378 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:32.269610 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c469ab3f-5440-4741-adb6-50694e4d6378 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:32.270394 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c469ab3f-5440-4741-adb6-50694e4d6378 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:32.270828 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c469ab3f-5440-4741-adb6-50694e4d6378 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:32.330613 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c469ab3f-5440-4741-adb6-50694e4d6378 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:32.337976 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c469ab3f-5440-4741-adb6-50694e4d6378 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081930 Feb 21 01:18:32.338532 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 683/1348] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:32 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:32.831659 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c632a624-58ff-4d36-8def-bdf762185f16 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:32.832309 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c632a624-58ff-4d36-8def-bdf762185f16 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:32.839275 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c632a624-58ff-4d36-8def-bdf762185f16 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:32.839943 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c632a624-58ff-4d36-8def-bdf762185f16 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:32.840745 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c632a624-58ff-4d36-8def-bdf762185f16 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:32.841174 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c632a624-58ff-4d36-8def-bdf762185f16 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:32.997407 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c632a624-58ff-4d36-8def-bdf762185f16 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:33.005747 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c632a624-58ff-4d36-8def-bdf762185f16 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:33.007252 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c632a624-58ff-4d36-8def-bdf762185f16 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:33.008414 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c632a624-58ff-4d36-8def-bdf762185f16 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.182301 Feb 21 01:18:33.008991 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 666/1349] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:32 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:33.355742 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d0616ad1-8622-4c22-81d8-a85b0f3f9861 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:33.356390 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d0616ad1-8622-4c22-81d8-a85b0f3f9861 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:33.363357 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d0616ad1-8622-4c22-81d8-a85b0f3f9861 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:33.363807 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d0616ad1-8622-4c22-81d8-a85b0f3f9861 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:33.364628 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d0616ad1-8622-4c22-81d8-a85b0f3f9861 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:33.365058 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d0616ad1-8622-4c22-81d8-a85b0f3f9861 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:33.428877 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d0616ad1-8622-4c22-81d8-a85b0f3f9861 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:33.438242 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d0616ad1-8622-4c22-81d8-a85b0f3f9861 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.086166 Feb 21 01:18:33.438817 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 684/1350] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:33 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:34.027590 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2860ef39-57ec-45c1-bb48-595d2da44249 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:34.028267 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2860ef39-57ec-45c1-bb48-595d2da44249 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:34.034592 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2860ef39-57ec-45c1-bb48-595d2da44249 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:34.035044 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2860ef39-57ec-45c1-bb48-595d2da44249 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:34.035858 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2860ef39-57ec-45c1-bb48-595d2da44249 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:34.036299 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2860ef39-57ec-45c1-bb48-595d2da44249 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:34.169088 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2860ef39-57ec-45c1-bb48-595d2da44249 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:34.177174 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2860ef39-57ec-45c1-bb48-595d2da44249 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:34.178653 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2860ef39-57ec-45c1-bb48-595d2da44249 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:34.179820 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2860ef39-57ec-45c1-bb48-595d2da44249 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157180 Feb 21 01:18:34.180389 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 667/1351] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:34 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:34.454811 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-84a3d86b-2932-4b58-ba4b-6f67e9edbc30 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:34.455421 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-84a3d86b-2932-4b58-ba4b-6f67e9edbc30 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:34.461884 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84a3d86b-2932-4b58-ba4b-6f67e9edbc30 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:34.462428 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84a3d86b-2932-4b58-ba4b-6f67e9edbc30 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:34.463198 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84a3d86b-2932-4b58-ba4b-6f67e9edbc30 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:34.464606 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84a3d86b-2932-4b58-ba4b-6f67e9edbc30 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:34.529654 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-84a3d86b-2932-4b58-ba4b-6f67e9edbc30 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:34.537074 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-84a3d86b-2932-4b58-ba4b-6f67e9edbc30 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.086063 Feb 21 01:18:34.537630 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 685/1352] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:34 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:35.200329 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0931e286-630c-4ba9-afe8-1e03925ad708 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:35.200902 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0931e286-630c-4ba9-afe8-1e03925ad708 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:35.207120 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0931e286-630c-4ba9-afe8-1e03925ad708 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:35.207461 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0931e286-630c-4ba9-afe8-1e03925ad708 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:35.208260 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0931e286-630c-4ba9-afe8-1e03925ad708 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:35.208684 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0931e286-630c-4ba9-afe8-1e03925ad708 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:35.349094 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0931e286-630c-4ba9-afe8-1e03925ad708 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:35.357474 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0931e286-630c-4ba9-afe8-1e03925ad708 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:35.358986 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0931e286-630c-4ba9-afe8-1e03925ad708 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:35.360177 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0931e286-630c-4ba9-afe8-1e03925ad708 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.164159 Feb 21 01:18:35.360731 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 668/1353] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:35 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:35.554196 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ae5b3af9-75be-4ba7-a853-9d7ad70cb3b4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:35.554808 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ae5b3af9-75be-4ba7-a853-9d7ad70cb3b4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:35.561823 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ae5b3af9-75be-4ba7-a853-9d7ad70cb3b4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:35.562272 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ae5b3af9-75be-4ba7-a853-9d7ad70cb3b4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:35.563052 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ae5b3af9-75be-4ba7-a853-9d7ad70cb3b4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:35.563515 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ae5b3af9-75be-4ba7-a853-9d7ad70cb3b4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:35.623981 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ae5b3af9-75be-4ba7-a853-9d7ad70cb3b4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:35.631741 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ae5b3af9-75be-4ba7-a853-9d7ad70cb3b4 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081168 Feb 21 01:18:35.632425 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 686/1354] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:35 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:36.378251 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d359dfac-7281-495b-a64d-a3785e59c6e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:36.378853 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d359dfac-7281-495b-a64d-a3785e59c6e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:36.385145 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d359dfac-7281-495b-a64d-a3785e59c6e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:36.386220 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d359dfac-7281-495b-a64d-a3785e59c6e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:36.387021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d359dfac-7281-495b-a64d-a3785e59c6e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:36.387461 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d359dfac-7281-495b-a64d-a3785e59c6e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:36.519457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d359dfac-7281-495b-a64d-a3785e59c6e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:36.527776 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d359dfac-7281-495b-a64d-a3785e59c6e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:36.529309 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d359dfac-7281-495b-a64d-a3785e59c6e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:36.530447 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d359dfac-7281-495b-a64d-a3785e59c6e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155893 Feb 21 01:18:36.531036 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 669/1355] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:36 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:36.649097 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-459edfaa-4c4b-46ea-98c9-30d975b83ab7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:36.649643 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-459edfaa-4c4b-46ea-98c9-30d975b83ab7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:36.656283 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-459edfaa-4c4b-46ea-98c9-30d975b83ab7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:36.656727 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-459edfaa-4c4b-46ea-98c9-30d975b83ab7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:36.657496 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-459edfaa-4c4b-46ea-98c9-30d975b83ab7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:36.657919 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-459edfaa-4c4b-46ea-98c9-30d975b83ab7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:36.716540 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-459edfaa-4c4b-46ea-98c9-30d975b83ab7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:36.724121 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-459edfaa-4c4b-46ea-98c9-30d975b83ab7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.078749 Feb 21 01:18:36.724685 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 687/1356] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:36 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:37.548178 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9e995284-d9b4-4964-a4e6-9caa54abd833 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:37.548766 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9e995284-d9b4-4964-a4e6-9caa54abd833 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:37.554916 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9e995284-d9b4-4964-a4e6-9caa54abd833 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:37.555383 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9e995284-d9b4-4964-a4e6-9caa54abd833 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:37.556181 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9e995284-d9b4-4964-a4e6-9caa54abd833 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:37.556607 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9e995284-d9b4-4964-a4e6-9caa54abd833 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:37.689158 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9e995284-d9b4-4964-a4e6-9caa54abd833 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:37.697357 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9e995284-d9b4-4964-a4e6-9caa54abd833 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:37.699467 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9e995284-d9b4-4964-a4e6-9caa54abd833 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:37.700639 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9e995284-d9b4-4964-a4e6-9caa54abd833 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156163 Feb 21 01:18:37.701183 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 670/1357] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:37 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:37.740074 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7a637a48-6ce6-48d5-bade-f64819cf0ef6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:37.740691 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7a637a48-6ce6-48d5-bade-f64819cf0ef6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:37.747745 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7a637a48-6ce6-48d5-bade-f64819cf0ef6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:37.748214 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7a637a48-6ce6-48d5-bade-f64819cf0ef6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:37.748995 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7a637a48-6ce6-48d5-bade-f64819cf0ef6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:37.749422 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7a637a48-6ce6-48d5-bade-f64819cf0ef6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:37.813018 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7a637a48-6ce6-48d5-bade-f64819cf0ef6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:37.820435 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7a637a48-6ce6-48d5-bade-f64819cf0ef6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084022 Feb 21 01:18:37.821120 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 688/1358] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:37 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:38.718009 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8995e02e-95f3-4c48-81c7-b1046e366a6c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:38.718617 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8995e02e-95f3-4c48-81c7-b1046e366a6c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:38.724946 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8995e02e-95f3-4c48-81c7-b1046e366a6c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:38.725390 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8995e02e-95f3-4c48-81c7-b1046e366a6c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:38.726166 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8995e02e-95f3-4c48-81c7-b1046e366a6c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:38.726598 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8995e02e-95f3-4c48-81c7-b1046e366a6c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:38.837072 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ec89b97b-5a64-4740-a5d3-e017f9419ecb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:38.837680 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ec89b97b-5a64-4740-a5d3-e017f9419ecb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:38.845679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec89b97b-5a64-4740-a5d3-e017f9419ecb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:38.846126 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec89b97b-5a64-4740-a5d3-e017f9419ecb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:38.846919 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec89b97b-5a64-4740-a5d3-e017f9419ecb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:38.847350 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec89b97b-5a64-4740-a5d3-e017f9419ecb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:38.866104 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8995e02e-95f3-4c48-81c7-b1046e366a6c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:38.874593 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8995e02e-95f3-4c48-81c7-b1046e366a6c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:38.876164 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8995e02e-95f3-4c48-81c7-b1046e366a6c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:38.877345 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8995e02e-95f3-4c48-81c7-b1046e366a6c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.163347 Feb 21 01:18:38.877905 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 671/1359] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:38 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:38.909415 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ec89b97b-5a64-4740-a5d3-e017f9419ecb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:38.916889 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ec89b97b-5a64-4740-a5d3-e017f9419ecb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083519 Feb 21 01:18:38.917447 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 689/1360] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:38 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:18:39.898108 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d154161b-3a68-4af3-964f-e2e80df11065 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:39.898700 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d154161b-3a68-4af3-964f-e2e80df11065 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:39.906145 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d154161b-3a68-4af3-964f-e2e80df11065 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:39.906597 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d154161b-3a68-4af3-964f-e2e80df11065 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:39.907387 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d154161b-3a68-4af3-964f-e2e80df11065 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:39.907821 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d154161b-3a68-4af3-964f-e2e80df11065 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:39.934840 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-39bc2326-d543-46c6-add0-9ae821e775f3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:39.935486 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-39bc2326-d543-46c6-add0-9ae821e775f3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:39.941844 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-39bc2326-d543-46c6-add0-9ae821e775f3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:39.942306 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-39bc2326-d543-46c6-add0-9ae821e775f3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:39.943099 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-39bc2326-d543-46c6-add0-9ae821e775f3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:39.943528 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-39bc2326-d543-46c6-add0-9ae821e775f3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:40.003894 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-39bc2326-d543-46c6-add0-9ae821e775f3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:40.011349 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-39bc2326-d543-46c6-add0-9ae821e775f3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080896 Feb 21 01:18:40.012230 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 690/1361] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:39 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:18:40.045156 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d154161b-3a68-4af3-964f-e2e80df11065 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:40.053883 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d154161b-3a68-4af3-964f-e2e80df11065 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:40.055376 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d154161b-3a68-4af3-964f-e2e80df11065 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:40.056563 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d154161b-3a68-4af3-964f-e2e80df11065 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.162241 Feb 21 01:18:40.057116 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 672/1362] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:39 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:41.028039 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1cfd2ee5-5ba5-4507-96ba-ace5dbe3b1a3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:41.028841 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1cfd2ee5-5ba5-4507-96ba-ace5dbe3b1a3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:41.035060 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1cfd2ee5-5ba5-4507-96ba-ace5dbe3b1a3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:41.035499 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1cfd2ee5-5ba5-4507-96ba-ace5dbe3b1a3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:41.036302 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1cfd2ee5-5ba5-4507-96ba-ace5dbe3b1a3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:41.036725 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1cfd2ee5-5ba5-4507-96ba-ace5dbe3b1a3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:41.074300 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3570db64-ce64-4456-ab78-00ac7d93ba5e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:41.075481 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3570db64-ce64-4456-ab78-00ac7d93ba5e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:41.082022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3570db64-ce64-4456-ab78-00ac7d93ba5e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:41.082468 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3570db64-ce64-4456-ab78-00ac7d93ba5e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:41.083264 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3570db64-ce64-4456-ab78-00ac7d93ba5e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:41.083715 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3570db64-ce64-4456-ab78-00ac7d93ba5e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:41.098468 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1cfd2ee5-5ba5-4507-96ba-ace5dbe3b1a3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:41.105726 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1cfd2ee5-5ba5-4507-96ba-ace5dbe3b1a3 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081767 Feb 21 01:18:41.106293 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 691/1363] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:41 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:41.221048 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3570db64-ce64-4456-ab78-00ac7d93ba5e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:41.229213 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3570db64-ce64-4456-ab78-00ac7d93ba5e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:41.230713 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3570db64-ce64-4456-ab78-00ac7d93ba5e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:41.232762 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3570db64-ce64-4456-ab78-00ac7d93ba5e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.161824 Feb 21 01:18:41.233561 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 673/1364] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:41 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:18:42.122099 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a7a2c5fb-6f94-4ba1-a438-40ba1e892bb6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:42.122699 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a7a2c5fb-6f94-4ba1-a438-40ba1e892bb6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:42.129467 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a7a2c5fb-6f94-4ba1-a438-40ba1e892bb6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:42.129918 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a7a2c5fb-6f94-4ba1-a438-40ba1e892bb6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:42.130693 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a7a2c5fb-6f94-4ba1-a438-40ba1e892bb6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:42.131125 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a7a2c5fb-6f94-4ba1-a438-40ba1e892bb6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:42.190066 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a7a2c5fb-6f94-4ba1-a438-40ba1e892bb6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:42.197363 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a7a2c5fb-6f94-4ba1-a438-40ba1e892bb6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.078973 Feb 21 01:18:42.197923 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 692/1365] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:42 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:42.251791 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-67e73395-034e-46d8-8555-c6ee2d5f454c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:42.252447 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-67e73395-034e-46d8-8555-c6ee2d5f454c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:42.258864 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-67e73395-034e-46d8-8555-c6ee2d5f454c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:42.259315 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-67e73395-034e-46d8-8555-c6ee2d5f454c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:42.260168 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-67e73395-034e-46d8-8555-c6ee2d5f454c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:42.260605 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-67e73395-034e-46d8-8555-c6ee2d5f454c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:42.395430 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-67e73395-034e-46d8-8555-c6ee2d5f454c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:42.403826 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-67e73395-034e-46d8-8555-c6ee2d5f454c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:42.406137 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-67e73395-034e-46d8-8555-c6ee2d5f454c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:42.407311 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-67e73395-034e-46d8-8555-c6ee2d5f454c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160148 Feb 21 01:18:42.407885 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 674/1366] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:42 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:43.214235 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-46638538-2f98-417e-8647-a10c503c1b10 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:43.214842 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-46638538-2f98-417e-8647-a10c503c1b10 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:43.221498 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-46638538-2f98-417e-8647-a10c503c1b10 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:43.221902 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-46638538-2f98-417e-8647-a10c503c1b10 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:43.222696 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-46638538-2f98-417e-8647-a10c503c1b10 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:43.223129 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-46638538-2f98-417e-8647-a10c503c1b10 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:43.284357 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-46638538-2f98-417e-8647-a10c503c1b10 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:43.291855 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-46638538-2f98-417e-8647-a10c503c1b10 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081206 Feb 21 01:18:43.292419 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 693/1367] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:43 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:43.425717 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-244d8356-466b-4770-aa69-e6d62f878e80 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:43.426324 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-244d8356-466b-4770-aa69-e6d62f878e80 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:43.432598 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-244d8356-466b-4770-aa69-e6d62f878e80 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:43.433043 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-244d8356-466b-4770-aa69-e6d62f878e80 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:43.433824 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-244d8356-466b-4770-aa69-e6d62f878e80 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:43.434263 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-244d8356-466b-4770-aa69-e6d62f878e80 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:43.566031 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-244d8356-466b-4770-aa69-e6d62f878e80 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:43.574317 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-244d8356-466b-4770-aa69-e6d62f878e80 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:43.575861 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-244d8356-466b-4770-aa69-e6d62f878e80 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:43.577337 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-244d8356-466b-4770-aa69-e6d62f878e80 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.155318 Feb 21 01:18:43.577898 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 675/1368] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:43 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:44.308529 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c6a72df0-2f43-4ace-959c-2e0d50004509 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:44.309133 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c6a72df0-2f43-4ace-959c-2e0d50004509 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:44.316222 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c6a72df0-2f43-4ace-959c-2e0d50004509 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:44.316674 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c6a72df0-2f43-4ace-959c-2e0d50004509 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:44.317458 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c6a72df0-2f43-4ace-959c-2e0d50004509 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:44.317893 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c6a72df0-2f43-4ace-959c-2e0d50004509 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:44.381446 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c6a72df0-2f43-4ace-959c-2e0d50004509 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:44.389979 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c6a72df0-2f43-4ace-959c-2e0d50004509 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084873 Feb 21 01:18:44.390536 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 694/1369] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:44 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:44.596000 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-41c29963-f4ba-4031-9da2-d90ee71cd5a5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:44.596550 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-41c29963-f4ba-4031-9da2-d90ee71cd5a5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:44.602628 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-41c29963-f4ba-4031-9da2-d90ee71cd5a5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:44.603061 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-41c29963-f4ba-4031-9da2-d90ee71cd5a5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:44.603906 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-41c29963-f4ba-4031-9da2-d90ee71cd5a5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:44.604331 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-41c29963-f4ba-4031-9da2-d90ee71cd5a5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:44.740298 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-41c29963-f4ba-4031-9da2-d90ee71cd5a5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:44.748537 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-41c29963-f4ba-4031-9da2-d90ee71cd5a5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:44.750031 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-41c29963-f4ba-4031-9da2-d90ee71cd5a5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:44.751614 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-41c29963-f4ba-4031-9da2-d90ee71cd5a5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159576 Feb 21 01:18:44.751761 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 676/1370] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:44 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:45.406907 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-571d700a-3716-4eff-85c8-30589dcab217 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:45.407528 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-571d700a-3716-4eff-85c8-30589dcab217 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:45.414024 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-571d700a-3716-4eff-85c8-30589dcab217 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:45.414475 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-571d700a-3716-4eff-85c8-30589dcab217 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:45.415275 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-571d700a-3716-4eff-85c8-30589dcab217 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:45.415710 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-571d700a-3716-4eff-85c8-30589dcab217 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:45.476404 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-571d700a-3716-4eff-85c8-30589dcab217 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:45.484431 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-571d700a-3716-4eff-85c8-30589dcab217 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081512 Feb 21 01:18:45.484985 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 695/1371] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:45 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:45.768875 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c96ecf46-c42e-413d-a554-a7d0d7ba9d89 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:45.769468 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c96ecf46-c42e-413d-a554-a7d0d7ba9d89 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:45.776170 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c96ecf46-c42e-413d-a554-a7d0d7ba9d89 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:45.776623 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c96ecf46-c42e-413d-a554-a7d0d7ba9d89 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:45.777409 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c96ecf46-c42e-413d-a554-a7d0d7ba9d89 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:45.777867 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c96ecf46-c42e-413d-a554-a7d0d7ba9d89 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:45.912848 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c96ecf46-c42e-413d-a554-a7d0d7ba9d89 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:45.921893 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c96ecf46-c42e-413d-a554-a7d0d7ba9d89 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:45.923383 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c96ecf46-c42e-413d-a554-a7d0d7ba9d89 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:45.924601 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c96ecf46-c42e-413d-a554-a7d0d7ba9d89 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.159567 Feb 21 01:18:45.925154 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 677/1372] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:45 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:46.500856 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-66432d6d-01e9-4030-a9f3-9f045947d438 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:46.501464 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-66432d6d-01e9-4030-a9f3-9f045947d438 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:46.507748 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-66432d6d-01e9-4030-a9f3-9f045947d438 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:46.508223 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-66432d6d-01e9-4030-a9f3-9f045947d438 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:46.509001 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-66432d6d-01e9-4030-a9f3-9f045947d438 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:46.509434 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-66432d6d-01e9-4030-a9f3-9f045947d438 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:46.570186 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-66432d6d-01e9-4030-a9f3-9f045947d438 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:46.578202 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-66432d6d-01e9-4030-a9f3-9f045947d438 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081102 Feb 21 01:18:46.578752 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 696/1373] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:46 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:46.942767 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e2c006a0-132d-4b1f-9f60-66cf4b2e35ea tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:46.943380 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e2c006a0-132d-4b1f-9f60-66cf4b2e35ea tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:46.949772 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e2c006a0-132d-4b1f-9f60-66cf4b2e35ea tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:46.950223 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e2c006a0-132d-4b1f-9f60-66cf4b2e35ea tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:46.951009 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e2c006a0-132d-4b1f-9f60-66cf4b2e35ea tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:46.951782 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e2c006a0-132d-4b1f-9f60-66cf4b2e35ea tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:47.087904 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e2c006a0-132d-4b1f-9f60-66cf4b2e35ea tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:47.096641 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e2c006a0-132d-4b1f-9f60-66cf4b2e35ea tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:47.098224 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e2c006a0-132d-4b1f-9f60-66cf4b2e35ea tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:47.099391 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e2c006a0-132d-4b1f-9f60-66cf4b2e35ea tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.160340 Feb 21 01:18:47.099979 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 678/1374] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:46 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:47.595506 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b96a2ff9-970f-44a3-bd22-92b5b11c88e6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:47.596149 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b96a2ff9-970f-44a3-bd22-92b5b11c88e6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:47.602421 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b96a2ff9-970f-44a3-bd22-92b5b11c88e6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:47.602868 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b96a2ff9-970f-44a3-bd22-92b5b11c88e6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:47.603645 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b96a2ff9-970f-44a3-bd22-92b5b11c88e6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:47.604110 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b96a2ff9-970f-44a3-bd22-92b5b11c88e6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:47.665758 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b96a2ff9-970f-44a3-bd22-92b5b11c88e6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:47.673965 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b96a2ff9-970f-44a3-bd22-92b5b11c88e6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082590 Feb 21 01:18:47.674550 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 697/1375] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:47 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:48.118563 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a5d15a35-8c09-42b7-921a-236a88088df0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:48.119224 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a5d15a35-8c09-42b7-921a-236a88088df0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:48.125953 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a5d15a35-8c09-42b7-921a-236a88088df0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:48.126403 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a5d15a35-8c09-42b7-921a-236a88088df0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:48.127188 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a5d15a35-8c09-42b7-921a-236a88088df0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:48.127623 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a5d15a35-8c09-42b7-921a-236a88088df0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:48.266404 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a5d15a35-8c09-42b7-921a-236a88088df0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:48.274721 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a5d15a35-8c09-42b7-921a-236a88088df0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:48.276525 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a5d15a35-8c09-42b7-921a-236a88088df0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:48.277675 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a5d15a35-8c09-42b7-921a-236a88088df0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.163055 Feb 21 01:18:48.278251 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 679/1376] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:48 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:48.691013 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-53182629-d575-4548-8ebe-c9dfb0afcdc0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:48.691698 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-53182629-d575-4548-8ebe-c9dfb0afcdc0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:48.697939 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-53182629-d575-4548-8ebe-c9dfb0afcdc0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:48.698386 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-53182629-d575-4548-8ebe-c9dfb0afcdc0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:48.699164 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-53182629-d575-4548-8ebe-c9dfb0afcdc0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:48.699601 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-53182629-d575-4548-8ebe-c9dfb0afcdc0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:48.760643 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-53182629-d575-4548-8ebe-c9dfb0afcdc0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:48.767971 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-53182629-d575-4548-8ebe-c9dfb0afcdc0 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.080585 Feb 21 01:18:48.768529 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 698/1377] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:48 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:49.295850 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ee5b71cd-3f03-43ca-b947-bfe46cd66060 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:49.296485 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ee5b71cd-3f03-43ca-b947-bfe46cd66060 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:49.302776 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee5b71cd-3f03-43ca-b947-bfe46cd66060 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:49.303227 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee5b71cd-3f03-43ca-b947-bfe46cd66060 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:49.304037 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee5b71cd-3f03-43ca-b947-bfe46cd66060 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:49.304476 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee5b71cd-3f03-43ca-b947-bfe46cd66060 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:49.442558 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ee5b71cd-3f03-43ca-b947-bfe46cd66060 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:49.451211 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ee5b71cd-3f03-43ca-b947-bfe46cd66060 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:49.452839 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ee5b71cd-3f03-43ca-b947-bfe46cd66060 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:49.453985 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ee5b71cd-3f03-43ca-b947-bfe46cd66060 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.162605 Feb 21 01:18:49.454545 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 680/1378] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:49 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:49.784509 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5d137429-6058-4f62-b85e-0666d2b773ce tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:49.785120 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5d137429-6058-4f62-b85e-0666d2b773ce tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:49.790958 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5d137429-6058-4f62-b85e-0666d2b773ce tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:49.791398 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5d137429-6058-4f62-b85e-0666d2b773ce tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:49.792210 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5d137429-6058-4f62-b85e-0666d2b773ce tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:49.792645 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5d137429-6058-4f62-b85e-0666d2b773ce tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:49.851826 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5d137429-6058-4f62-b85e-0666d2b773ce tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:49.860183 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5d137429-6058-4f62-b85e-0666d2b773ce tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079452 Feb 21 01:18:49.860748 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 699/1379] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:49 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:50.472161 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ebb271f2-8469-41c4-8647-303d14187acc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:50.472769 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ebb271f2-8469-41c4-8647-303d14187acc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:50.479041 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ebb271f2-8469-41c4-8647-303d14187acc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:50.479484 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ebb271f2-8469-41c4-8647-303d14187acc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:50.480292 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ebb271f2-8469-41c4-8647-303d14187acc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:50.480723 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ebb271f2-8469-41c4-8647-303d14187acc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:50.614357 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ebb271f2-8469-41c4-8647-303d14187acc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:50.622717 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ebb271f2-8469-41c4-8647-303d14187acc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:50.624844 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ebb271f2-8469-41c4-8647-303d14187acc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:50.626016 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ebb271f2-8469-41c4-8647-303d14187acc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.157637 Feb 21 01:18:50.626577 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 681/1380] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:50 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:50.876510 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-28539e77-c5e7-4bbc-9b6c-bf49b322a380 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:50.877078 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-28539e77-c5e7-4bbc-9b6c-bf49b322a380 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:50.883455 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-28539e77-c5e7-4bbc-9b6c-bf49b322a380 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:50.886903 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-28539e77-c5e7-4bbc-9b6c-bf49b322a380 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:50.886903 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-28539e77-c5e7-4bbc-9b6c-bf49b322a380 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:50.886903 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-28539e77-c5e7-4bbc-9b6c-bf49b322a380 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:50.947525 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-28539e77-c5e7-4bbc-9b6c-bf49b322a380 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:50.955465 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-28539e77-c5e7-4bbc-9b6c-bf49b322a380 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082869 Feb 21 01:18:50.956050 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 700/1381] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:50 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:18:51.644416 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-17b3be00-0656-45bd-97a6-d1fa7d382148 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:51.644950 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-17b3be00-0656-45bd-97a6-d1fa7d382148 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:51.651336 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-17b3be00-0656-45bd-97a6-d1fa7d382148 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:51.651779 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-17b3be00-0656-45bd-97a6-d1fa7d382148 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:51.652585 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-17b3be00-0656-45bd-97a6-d1fa7d382148 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:51.653016 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-17b3be00-0656-45bd-97a6-d1fa7d382148 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:51.785752 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-17b3be00-0656-45bd-97a6-d1fa7d382148 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:51.794038 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-17b3be00-0656-45bd-97a6-d1fa7d382148 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:51.796314 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-17b3be00-0656-45bd-97a6-d1fa7d382148 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:51.810991 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-17b3be00-0656-45bd-97a6-d1fa7d382148 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.156887 Feb 21 01:18:51.810991 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 682/1382] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:51 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:51.972704 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4b695a34-86ab-4929-9705-4f81dac90003 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:51.973352 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4b695a34-86ab-4929-9705-4f81dac90003 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:51.979613 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4b695a34-86ab-4929-9705-4f81dac90003 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:51.980086 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4b695a34-86ab-4929-9705-4f81dac90003 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:51.980871 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4b695a34-86ab-4929-9705-4f81dac90003 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:51.981310 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4b695a34-86ab-4929-9705-4f81dac90003 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:52.044009 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4b695a34-86ab-4929-9705-4f81dac90003 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:52.052112 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4b695a34-86ab-4929-9705-4f81dac90003 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083023 Feb 21 01:18:52.052673 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 701/1383] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:51 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:52.815657 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-63cb9881-3bbf-4241-a1b9-303cdea71331 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:52.816276 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-63cb9881-3bbf-4241-a1b9-303cdea71331 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:52.822734 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-63cb9881-3bbf-4241-a1b9-303cdea71331 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:52.823187 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-63cb9881-3bbf-4241-a1b9-303cdea71331 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:52.824055 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-63cb9881-3bbf-4241-a1b9-303cdea71331 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:52.824495 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-63cb9881-3bbf-4241-a1b9-303cdea71331 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:52.963985 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-63cb9881-3bbf-4241-a1b9-303cdea71331 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:52.972932 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-63cb9881-3bbf-4241-a1b9-303cdea71331 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:52.974425 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-63cb9881-3bbf-4241-a1b9-303cdea71331 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:52.975577 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-63cb9881-3bbf-4241-a1b9-303cdea71331 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.163619 Feb 21 01:18:52.976172 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 683/1384] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:52 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:18:53.069043 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d1570d30-9c6b-4a2a-b938-a04ec8490eda tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:53.069561 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d1570d30-9c6b-4a2a-b938-a04ec8490eda tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:53.076323 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d1570d30-9c6b-4a2a-b938-a04ec8490eda tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:53.076769 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d1570d30-9c6b-4a2a-b938-a04ec8490eda tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:53.077555 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d1570d30-9c6b-4a2a-b938-a04ec8490eda tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:53.077988 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d1570d30-9c6b-4a2a-b938-a04ec8490eda tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:53.137000 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d1570d30-9c6b-4a2a-b938-a04ec8490eda tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:53.144363 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d1570d30-9c6b-4a2a-b938-a04ec8490eda tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079097 Feb 21 01:18:53.144914 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 702/1385] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:53 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:53.994290 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4ed671a0-ebbc-45e6-9f8f-f5732e593ab3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:53.994887 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4ed671a0-ebbc-45e6-9f8f-f5732e593ab3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:54.001251 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ed671a0-ebbc-45e6-9f8f-f5732e593ab3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:54.001698 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ed671a0-ebbc-45e6-9f8f-f5732e593ab3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:54.002473 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ed671a0-ebbc-45e6-9f8f-f5732e593ab3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:54.002899 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ed671a0-ebbc-45e6-9f8f-f5732e593ab3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:54.137869 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4ed671a0-ebbc-45e6-9f8f-f5732e593ab3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:54.146808 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4ed671a0-ebbc-45e6-9f8f-f5732e593ab3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:54.148336 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4ed671a0-ebbc-45e6-9f8f-f5732e593ab3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:54.149491 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4ed671a0-ebbc-45e6-9f8f-f5732e593ab3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 200 len: 1753 microversion: 2.20 time: 0.158901 Feb 21 01:18:54.150047 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 684/1386] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:18:53 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:18:54.160952 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b2c99d58-4e98-48a8-80b8-72365f4e3620 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:54.161560 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b2c99d58-4e98-48a8-80b8-72365f4e3620 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:54.167859 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b2c99d58-4e98-48a8-80b8-72365f4e3620 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:54.168350 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b2c99d58-4e98-48a8-80b8-72365f4e3620 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:54.169111 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b2c99d58-4e98-48a8-80b8-72365f4e3620 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:54.169567 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b2c99d58-4e98-48a8-80b8-72365f4e3620 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:54.229308 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b2c99d58-4e98-48a8-80b8-72365f4e3620 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:54.236861 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b2c99d58-4e98-48a8-80b8-72365f4e3620 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.079566 Feb 21 01:18:54.237418 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 703/1387] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:54 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:55.253633 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7923847b-3f56-4a74-8215-bd5cfff9dce7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:55.254238 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7923847b-3f56-4a74-8215-bd5cfff9dce7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:55.260758 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7923847b-3f56-4a74-8215-bd5cfff9dce7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:55.261201 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7923847b-3f56-4a74-8215-bd5cfff9dce7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:55.261973 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7923847b-3f56-4a74-8215-bd5cfff9dce7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:55.262399 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7923847b-3f56-4a74-8215-bd5cfff9dce7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:55.324679 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7923847b-3f56-4a74-8215-bd5cfff9dce7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:55.333313 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7923847b-3f56-4a74-8215-bd5cfff9dce7 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083378 Feb 21 01:18:55.333886 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 685/1388] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:55 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:56.350439 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f44e069a-24c9-4eff-a136-4a393f29fef6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:56.351078 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f44e069a-24c9-4eff-a136-4a393f29fef6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:56.357767 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f44e069a-24c9-4eff-a136-4a393f29fef6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:56.358632 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f44e069a-24c9-4eff-a136-4a393f29fef6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:56.358994 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f44e069a-24c9-4eff-a136-4a393f29fef6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:56.359960 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f44e069a-24c9-4eff-a136-4a393f29fef6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:56.430540 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f44e069a-24c9-4eff-a136-4a393f29fef6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:56.438783 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f44e069a-24c9-4eff-a136-4a393f29fef6 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.091979 Feb 21 01:18:56.439351 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 704/1389] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:56 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:57.455992 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cd841fd1-6965-478c-aad5-83d791354138 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:57.456601 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cd841fd1-6965-478c-aad5-83d791354138 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:57.462762 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cd841fd1-6965-478c-aad5-83d791354138 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:57.463205 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cd841fd1-6965-478c-aad5-83d791354138 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:57.464020 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cd841fd1-6965-478c-aad5-83d791354138 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:57.464462 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cd841fd1-6965-478c-aad5-83d791354138 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:57.527694 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cd841fd1-6965-478c-aad5-83d791354138 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:57.535059 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cd841fd1-6965-478c-aad5-83d791354138 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.082838 Feb 21 01:18:57.535627 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 686/1390] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:57 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:58.552579 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a9ee739e-5d4d-424c-8e71-52be8747ce25 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:58.553184 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a9ee739e-5d4d-424c-8e71-52be8747ce25 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:58.559619 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a9ee739e-5d4d-424c-8e71-52be8747ce25 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:58.560685 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a9ee739e-5d4d-424c-8e71-52be8747ce25 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:58.561473 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a9ee739e-5d4d-424c-8e71-52be8747ce25 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:58.561901 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a9ee739e-5d4d-424c-8e71-52be8747ce25 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:58.621889 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a9ee739e-5d4d-424c-8e71-52be8747ce25 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:58.630360 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a9ee739e-5d4d-424c-8e71-52be8747ce25 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.081390 Feb 21 01:18:58.630918 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 705/1391] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:58 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:59.647907 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-29453342-4527-413f-b8e9-26b45eaf0b6a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:59.648465 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-29453342-4527-413f-b8e9-26b45eaf0b6a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:59.656580 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-29453342-4527-413f-b8e9-26b45eaf0b6a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:59.657031 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-29453342-4527-413f-b8e9-26b45eaf0b6a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:59.657830 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-29453342-4527-413f-b8e9-26b45eaf0b6a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:59.658269 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-29453342-4527-413f-b8e9-26b45eaf0b6a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:59.721305 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-29453342-4527-413f-b8e9-26b45eaf0b6a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:59.728668 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-29453342-4527-413f-b8e9-26b45eaf0b6a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084610 Feb 21 01:18:59.729233 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 687/1392] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:59 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:19:00.745918 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9d84a5c3-92c8-4951-8000-3ee5833aad38 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:00.774747 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9d84a5c3-92c8-4951-8000-3ee5833aad38 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:00.774747 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d84a5c3-92c8-4951-8000-3ee5833aad38 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:00.774747 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d84a5c3-92c8-4951-8000-3ee5833aad38 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:00.774747 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d84a5c3-92c8-4951-8000-3ee5833aad38 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:00.775210 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d84a5c3-92c8-4951-8000-3ee5833aad38 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:00.819939 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9d84a5c3-92c8-4951-8000-3ee5833aad38 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:19:00.828114 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9d84a5c3-92c8-4951-8000-3ee5833aad38 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.085810 Feb 21 01:19:00.828685 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 706/1393] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:19:00 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:19:01.844638 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c30f75cd-2c70-447e-ab55-4099e314d60d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:01.845242 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c30f75cd-2c70-447e-ab55-4099e314d60d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:01.851500 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c30f75cd-2c70-447e-ab55-4099e314d60d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:01.851975 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c30f75cd-2c70-447e-ab55-4099e314d60d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:01.852757 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c30f75cd-2c70-447e-ab55-4099e314d60d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:01.853189 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c30f75cd-2c70-447e-ab55-4099e314d60d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:01.915905 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c30f75cd-2c70-447e-ab55-4099e314d60d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:19:01.924236 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c30f75cd-2c70-447e-ab55-4099e314d60d tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.083427 Feb 21 01:19:01.924819 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 688/1394] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:19:01 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:19:02.695361 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-02002052-ca8d-48a9-80a6-f685341ac066 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:02.695965 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-02002052-ca8d-48a9-80a6-f685341ac066 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:02.702840 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-02002052-ca8d-48a9-80a6-f685341ac066 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:02.703230 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-02002052-ca8d-48a9-80a6-f685341ac066 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:02.703932 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-02002052-ca8d-48a9-80a6-f685341ac066 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:02.704371 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-02002052-ca8d-48a9-80a6-f685341ac066 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:02.709848 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b8198745-c525-452f-a48b-e1b1c8ec7d33 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:02.710338 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b8198745-c525-452f-a48b-e1b1c8ec7d33 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:02.716688 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b8198745-c525-452f-a48b-e1b1c8ec7d33 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:02.717269 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b8198745-c525-452f-a48b-e1b1c8ec7d33 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:02.718059 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b8198745-c525-452f-a48b-e1b1c8ec7d33 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:02.724917 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b8198745-c525-452f-a48b-e1b1c8ec7d33 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:02.742883 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-02002052-ca8d-48a9-80a6-f685341ac066 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Going to try to terminate instance {{(pid=117139) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:19:03.054935 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-02002052-ca8d-48a9-80a6-f685341ac066 tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "DELETE /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 204 len: 0 microversion: 2.1 time: 0.362702 Feb 21 01:19:03.055505 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 707/1395] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Feb 21 01:19:02 2022] DELETE /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:19:03.061490 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fec8d1c9-7440-4188-bc88-e05e47add05b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:03.062063 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fec8d1c9-7440-4188-bc88-e05e47add05b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:03.068219 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fec8d1c9-7440-4188-bc88-e05e47add05b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:03.068680 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fec8d1c9-7440-4188-bc88-e05e47add05b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:03.069481 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fec8d1c9-7440-4188-bc88-e05e47add05b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:03.069905 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fec8d1c9-7440-4188-bc88-e05e47add05b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:10.788792 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:19:10.789487 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:19:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments/088448d8-321e-47c3-9151-35cd7666ce14 (ip 10.222.0.91) !!! Feb 21 01:19:23.133178 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:19:23.133757 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:19:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc/os-volume_attachments/859d92fe-750a-4e98-b4a2-1be720fbbb02 (ip 10.222.0.91) !!! Feb 21 01:20:01.898984 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.objects.instance [None req-b8198745-c525-452f-a48b-e1b1c8ec7d33 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lazy-loading 'services' on Instance uuid 9d1f7594-329f-44cb-a627-184aa02bd0fc {{(pid=117138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:20:01.990075 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-fec8d1c9-7440-4188-bc88-e05e47add05b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] HTTP exception thrown: Cannot 'detach_volume' instance e2aa103a-4f89-45a6-8c62-09282555e3b3 while it is in task_state spawning Feb 21 01:20:01.990680 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fec8d1c9-7440-4188-bc88-e05e47add05b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Returning 409 to user: Cannot 'detach_volume' instance e2aa103a-4f89-45a6-8c62-09282555e3b3 while it is in task_state spawning {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:20:01.991635 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-fec8d1c9-7440-4188-bc88-e05e47add05b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "DELETE /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments/088448d8-321e-47c3-9151-35cd7666ce14" status: 409 len: 155 microversion: 2.20 time: 58.934889 Feb 21 01:20:01.992215 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 708/1396] 10.222.0.91 () {60 vars in 1456 bytes} [Mon Feb 21 01:19:03 2022] DELETE /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments/088448d8-321e-47c3-9151-35cd7666ce14 => generated 155 bytes in 58936 msecs (HTTP/1.1 409) 9 headers in 380 bytes (1 switches on core 0) Feb 21 01:20:01.996810 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e3700d8e-645b-4bb9-8995-a20611f49cd8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:20:01.997270 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e3700d8e-645b-4bb9-8995-a20611f49cd8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:20:02.003408 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e3700d8e-645b-4bb9-8995-a20611f49cd8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:20:02.003878 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e3700d8e-645b-4bb9-8995-a20611f49cd8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:20:02.004682 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e3700d8e-645b-4bb9-8995-a20611f49cd8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:20:02.005157 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e3700d8e-645b-4bb9-8995-a20611f49cd8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:20:02.070375 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e3700d8e-645b-4bb9-8995-a20611f49cd8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:20:02.077828 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e3700d8e-645b-4bb9-8995-a20611f49cd8 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084666 Feb 21 01:20:02.078396 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 709/1397] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:20:01 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:20:02.157902 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-88c769b0-47a1-43ee-8451-cbc7a833922f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:20:02.158327 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-88c769b0-47a1-43ee-8451-cbc7a833922f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] [instance: 9aa6aec1-9bd9-4713-aec8-c472d32aac72] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:20:02.164194 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-88c769b0-47a1-43ee-8451-cbc7a833922f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:20:02.164633 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-88c769b0-47a1-43ee-8451-cbc7a833922f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:20:02.165602 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-88c769b0-47a1-43ee-8451-cbc7a833922f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:20:02.166028 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-88c769b0-47a1-43ee-8451-cbc7a833922f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:20:02.179514 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-88c769b0-47a1-43ee-8451-cbc7a833922f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] HTTP exception thrown: Instance 9aa6aec1-9bd9-4713-aec8-c472d32aac72 could not be found. Feb 21 01:20:02.180135 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-88c769b0-47a1-43ee-8451-cbc7a833922f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] Returning 404 to user: Instance 9aa6aec1-9bd9-4713-aec8-c472d32aac72 could not be found. {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:20:02.180953 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-88c769b0-47a1-43ee-8451-cbc7a833922f tempest-AttachVolumeNegativeTest-1140026515 tempest-AttachVolumeNegativeTest-1140026515-project] 10.222.0.91 "GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72" status: 404 len: 111 microversion: 2.1 time: 0.100957 Feb 21 01:20:02.181489 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 710/1398] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:20:02 2022] GET /compute/v2.1/servers/9aa6aec1-9bd9-4713-aec8-c472d32aac72 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:20:02.244270 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-362bd614-e649-4c8b-901c-0ee360fe2e0c req-563f6bb3-f054-4c02-a760-67f933401223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa6aec1-9bd9-4713-aec8-c472d32aac72", "name": "network-vif-deleted", "tag": "6f9526d4-7752-4bd3-924b-5a3062434379"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:20:02.245839 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:20:02.245839 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:20:02.253737 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-362bd614-e649-4c8b-901c-0ee360fe2e0c req-563f6bb3-f054-4c02-a760-67f933401223 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:20:02.254875 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-362bd614-e649-4c8b-901c-0ee360fe2e0c req-563f6bb3-f054-4c02-a760-67f933401223 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:20:02.268697 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-362bd614-e649-4c8b-901c-0ee360fe2e0c req-563f6bb3-f054-4c02-a760-67f933401223 service nova] Creating event network-vif-deleted:6f9526d4-7752-4bd3-924b-5a3062434379 for instance 9aa6aec1-9bd9-4713-aec8-c472d32aac72 on hv-cinder-81322 Feb 21 01:20:02.274290 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-362bd614-e649-4c8b-901c-0ee360fe2e0c req-563f6bb3-f054-4c02-a760-67f933401223 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091254 Feb 21 01:20:02.275009 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 711/1399] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:20:02.280592 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d2b00c40-2be8-42d8-b757-99cab2beba3d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:20:02.281733 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d2b00c40-2be8-42d8-b757-99cab2beba3d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:20:02.287806 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d2b00c40-2be8-42d8-b757-99cab2beba3d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:20:02.288286 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d2b00c40-2be8-42d8-b757-99cab2beba3d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:20:02.289075 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d2b00c40-2be8-42d8-b757-99cab2beba3d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:20:02.289504 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d2b00c40-2be8-42d8-b757-99cab2beba3d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:20:02.322244 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d2b00c40-2be8-42d8-b757-99cab2beba3d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045767 Feb 21 01:20:02.324713 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 712/1400] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:20:02 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:20:02.704490 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2bbad0dd-a3e7-4137-9602-8abe1aab5844 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:20:02.704991 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2bbad0dd-a3e7-4137-9602-8abe1aab5844 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:20:02.711089 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2bbad0dd-a3e7-4137-9602-8abe1aab5844 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:20:02.711526 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2bbad0dd-a3e7-4137-9602-8abe1aab5844 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:20:02.712337 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2bbad0dd-a3e7-4137-9602-8abe1aab5844 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:20:02.712771 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2bbad0dd-a3e7-4137-9602-8abe1aab5844 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:20:02.738322 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2bbad0dd-a3e7-4137-9602-8abe1aab5844 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Going to try to terminate instance {{(pid=117139) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:20:02.891191 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.compute.api [None req-2bbad0dd-a3e7-4137-9602-8abe1aab5844 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Instance is already in deleting state, ignoring this request Feb 21 01:20:02.892084 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2bbad0dd-a3e7-4137-9602-8abe1aab5844 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "DELETE /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 204 len: 0 microversion: 2.1 time: 0.191288 Feb 21 01:20:02.892759 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 713/1401] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Feb 21 01:20:02 2022] DELETE /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 21 01:20:02.897556 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ce043e10-09f9-4aeb-95f2-d9ffbb82b2b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:20:02.898053 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ce043e10-09f9-4aeb-95f2-d9ffbb82b2b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:20:02.904868 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ce043e10-09f9-4aeb-95f2-d9ffbb82b2b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:20:02.905322 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ce043e10-09f9-4aeb-95f2-d9ffbb82b2b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:20:02.906129 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ce043e10-09f9-4aeb-95f2-d9ffbb82b2b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:20:02.906567 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ce043e10-09f9-4aeb-95f2-d9ffbb82b2b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:20:23.163751 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:20:23.164562 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:20:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc/os-volume_attachments/859d92fe-750a-4e98-b4a2-1be720fbbb02 (ip 10.222.0.91) !!! Feb 21 01:20:45.681967 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:20:45.682603 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:20:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc/os-volume_attachments/859d92fe-750a-4e98-b4a2-1be720fbbb02 (ip 10.222.0.91) !!! Feb 21 01:20:50.008965 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:20:50.009742 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:20:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc/os-volume_attachments/859d92fe-750a-4e98-b4a2-1be720fbbb02 (ip 10.222.0.91) !!! Feb 21 01:21:03.030094 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.objects.instance [None req-ce043e10-09f9-4aeb-95f2-d9ffbb82b2b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lazy-loading 'services' on Instance uuid 9d1f7594-329f-44cb-a627-184aa02bd0fc {{(pid=117139) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:21:03.074450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b8198745-c525-452f-a48b-e1b1c8ec7d33 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "DELETE /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc/os-volume_attachments/859d92fe-750a-4e98-b4a2-1be720fbbb02" status: 202 len: 0 microversion: 2.1 time: 120.368049 Feb 21 01:21:03.075052 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 689/1402] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Feb 21 01:19:02 2022] DELETE /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc/os-volume_attachments/859d92fe-750a-4e98-b4a2-1be720fbbb02 => generated 0 bytes in 120369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 01:21:03.276088 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6b13b0eb-8e96-496c-a5f6-b8a0fd8e674e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:21:03.276845 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6b13b0eb-8e96-496c-a5f6-b8a0fd8e674e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:21:03.283318 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b13b0eb-8e96-496c-a5f6-b8a0fd8e674e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:21:03.283805 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b13b0eb-8e96-496c-a5f6-b8a0fd8e674e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:21:03.284865 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b13b0eb-8e96-496c-a5f6-b8a0fd8e674e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:21:03.285228 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b13b0eb-8e96-496c-a5f6-b8a0fd8e674e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:21:03.361554 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6b13b0eb-8e96-496c-a5f6-b8a0fd8e674e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:21:03.369019 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6b13b0eb-8e96-496c-a5f6-b8a0fd8e674e tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.292827 Feb 21 01:21:03.369608 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 690/1403] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:21:03 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:21:03.501366 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-93e2afe9-ba70-440f-b5f5-c9bfa7c429c8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:21:03.502405 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-93e2afe9-ba70-440f-b5f5-c9bfa7c429c8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:21:03.508763 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-93e2afe9-ba70-440f-b5f5-c9bfa7c429c8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:21:03.509219 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-93e2afe9-ba70-440f-b5f5-c9bfa7c429c8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:21:03.510005 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-93e2afe9-ba70-440f-b5f5-c9bfa7c429c8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:21:03.510442 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-93e2afe9-ba70-440f-b5f5-c9bfa7c429c8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:21:03.539678 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-93e2afe9-ba70-440f-b5f5-c9bfa7c429c8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.168962 Feb 21 01:21:03.540454 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 691/1404] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:21:03 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:21:03.544709 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a8d91375-f6bf-4355-b54b-3462ef2c28c3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:21:03.545191 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a8d91375-f6bf-4355-b54b-3462ef2c28c3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:21:03.550408 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a8d91375-f6bf-4355-b54b-3462ef2c28c3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:21:03.550861 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a8d91375-f6bf-4355-b54b-3462ef2c28c3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:21:03.551630 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a8d91375-f6bf-4355-b54b-3462ef2c28c3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:21:03.552199 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a8d91375-f6bf-4355-b54b-3462ef2c28c3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:22:02.328566 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-ce043e10-09f9-4aeb-95f2-d9ffbb82b2b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-da11f2f2-2b8e-4339-ac8c-d2a5cabcd6e0) Feb 21 01:22:02.329209 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ce043e10-09f9-4aeb-95f2-d9ffbb82b2b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-da11f2f2-2b8e-4339-ac8c-d2a5cabcd6e0) {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:22:02.330055 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ce043e10-09f9-4aeb-95f2-d9ffbb82b2b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "DELETE /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc/os-volume_attachments/859d92fe-750a-4e98-b4a2-1be720fbbb02" status: 400 len: 269 microversion: 2.1 time: 119.436382 Feb 21 01:22:02.330621 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 714/1405] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Feb 21 01:20:02 2022] DELETE /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc/os-volume_attachments/859d92fe-750a-4e98-b4a2-1be720fbbb02 => generated 269 bytes in 119437 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:22:02.336235 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-abbcb846-4f09-469e-9339-f1a1bfc13882 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:22:02.336845 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-abbcb846-4f09-469e-9339-f1a1bfc13882 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:22:02.343161 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-abbcb846-4f09-469e-9339-f1a1bfc13882 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:22:02.343614 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-abbcb846-4f09-469e-9339-f1a1bfc13882 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:22:02.344440 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-abbcb846-4f09-469e-9339-f1a1bfc13882 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:22:02.344942 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-abbcb846-4f09-469e-9339-f1a1bfc13882 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:22:02.408673 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-abbcb846-4f09-469e-9339-f1a1bfc13882 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:22:02.417468 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-abbcb846-4f09-469e-9339-f1a1bfc13882 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.085888 Feb 21 01:22:02.418089 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 715/1406] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:22:02 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:22:02.422641 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a23958f7-4fe4-4d4a-a660-197e531d282b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:22:02.423596 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a23958f7-4fe4-4d4a-a660-197e531d282b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:22:02.430116 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a23958f7-4fe4-4d4a-a660-197e531d282b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:22:02.430567 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a23958f7-4fe4-4d4a-a660-197e531d282b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:22:02.431363 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a23958f7-4fe4-4d4a-a660-197e531d282b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:22:02.431862 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a23958f7-4fe4-4d4a-a660-197e531d282b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:22:02.461690 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a23958f7-4fe4-4d4a-a660-197e531d282b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042571 Feb 21 01:22:02.462457 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 716/1407] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:22:02 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:22:02.750864 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.objects.instance [None req-a8d91375-f6bf-4355-b54b-3462ef2c28c3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lazy-loading 'services' on Instance uuid 9d1f7594-329f-44cb-a627-184aa02bd0fc {{(pid=117138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:22:02.883342 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c7a300ee-542e-4840-8670-c04ed6be6913 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:22:02.883869 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c7a300ee-542e-4840-8670-c04ed6be6913 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:22:02.889606 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c7a300ee-542e-4840-8670-c04ed6be6913 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:22:02.890047 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c7a300ee-542e-4840-8670-c04ed6be6913 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:22:02.890823 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c7a300ee-542e-4840-8670-c04ed6be6913 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:22:02.891254 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c7a300ee-542e-4840-8670-c04ed6be6913 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:22:30.797011 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:22:30.797679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:22:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc/os-volume_attachments/859d92fe-750a-4e98-b4a2-1be720fbbb02 (ip 10.222.0.91) !!! Feb 21 01:22:44.071349 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:22:44.072091 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:22:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc/os-volume_attachments/859d92fe-750a-4e98-b4a2-1be720fbbb02 (ip 10.222.0.91) !!! Feb 21 01:23:03.853933 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.wsgi [None req-a8d91375-f6bf-4355-b54b-3462ef2c28c3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3cffb14-f1b3-4451-940c-8703f12a36f7) Feb 21 01:23:03.854533 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a8d91375-f6bf-4355-b54b-3462ef2c28c3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e3cffb14-f1b3-4451-940c-8703f12a36f7) {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:23:03.855433 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a8d91375-f6bf-4355-b54b-3462ef2c28c3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "DELETE /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc/os-volume_attachments/859d92fe-750a-4e98-b4a2-1be720fbbb02" status: 400 len: 269 microversion: 2.1 time: 120.314030 Feb 21 01:23:03.855947 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 692/1408] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Feb 21 01:21:03 2022] DELETE /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc/os-volume_attachments/859d92fe-750a-4e98-b4a2-1be720fbbb02 => generated 269 bytes in 120315 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:23:03.860948 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-32407a5e-bfa9-4d89-8fba-8958b805bb9a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:23:03.861551 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-32407a5e-bfa9-4d89-8fba-8958b805bb9a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:23:03.869309 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-32407a5e-bfa9-4d89-8fba-8958b805bb9a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:23:03.869758 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-32407a5e-bfa9-4d89-8fba-8958b805bb9a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:23:03.870551 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-32407a5e-bfa9-4d89-8fba-8958b805bb9a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:23:03.870987 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-32407a5e-bfa9-4d89-8fba-8958b805bb9a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:23:03.908310 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.objects.instance [None req-c7a300ee-542e-4840-8670-c04ed6be6913 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lazy-loading 'services' on Instance uuid 9d1f7594-329f-44cb-a627-184aa02bd0fc {{(pid=117139) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:23:03.935390 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-32407a5e-bfa9-4d89-8fba-8958b805bb9a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:23:03.942700 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-32407a5e-bfa9-4d89-8fba-8958b805bb9a tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.085809 Feb 21 01:23:03.943862 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 693/1409] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:23:03 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:23:03.948513 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a9615054-b4cb-40e2-a36c-ef7362e0defa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:23:03.949583 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a9615054-b4cb-40e2-a36c-ef7362e0defa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:23:03.955181 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a9615054-b4cb-40e2-a36c-ef7362e0defa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:23:03.955620 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a9615054-b4cb-40e2-a36c-ef7362e0defa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:23:03.956416 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a9615054-b4cb-40e2-a36c-ef7362e0defa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:23:03.956847 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a9615054-b4cb-40e2-a36c-ef7362e0defa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:23:03.987045 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a9615054-b4cb-40e2-a36c-ef7362e0defa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041738 Feb 21 01:23:03.987543 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 694/1410] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:23:03 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:23:03.992208 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-408c4db4-0f7e-4aa0-ad41-2c09d3b6f458 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:23:03.992797 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-408c4db4-0f7e-4aa0-ad41-2c09d3b6f458 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:23:03.998478 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-408c4db4-0f7e-4aa0-ad41-2c09d3b6f458 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:23:03.999028 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-408c4db4-0f7e-4aa0-ad41-2c09d3b6f458 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:23:03.999915 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-408c4db4-0f7e-4aa0-ad41-2c09d3b6f458 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:23:04.000327 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-408c4db4-0f7e-4aa0-ad41-2c09d3b6f458 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:23:43.172474 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:23:43.173094 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:23:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc/os-volume_attachments/859d92fe-750a-4e98-b4a2-1be720fbbb02 (ip 10.222.0.91) !!! Feb 21 01:24:02.879172 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-c7a300ee-542e-4840-8670-c04ed6be6913 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-19b1f4d1-a0e8-4be1-a2b0-2df514ed7e4a) Feb 21 01:24:02.879772 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c7a300ee-542e-4840-8670-c04ed6be6913 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-19b1f4d1-a0e8-4be1-a2b0-2df514ed7e4a) {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:24:02.881380 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c7a300ee-542e-4840-8670-c04ed6be6913 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "DELETE /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc/os-volume_attachments/859d92fe-750a-4e98-b4a2-1be720fbbb02" status: 400 len: 269 microversion: 2.1 time: 120.001404 Feb 21 01:24:02.881802 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 717/1411] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Feb 21 01:22:02 2022] DELETE /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc/os-volume_attachments/859d92fe-750a-4e98-b4a2-1be720fbbb02 => generated 269 bytes in 120003 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 21 01:24:02.887824 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-092cdb73-dccc-440b-8c68-f5d76cbc6257 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:02.889051 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-092cdb73-dccc-440b-8c68-f5d76cbc6257 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:02.894529 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-092cdb73-dccc-440b-8c68-f5d76cbc6257 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:02.895002 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-092cdb73-dccc-440b-8c68-f5d76cbc6257 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:02.895783 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-092cdb73-dccc-440b-8c68-f5d76cbc6257 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:02.896244 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-092cdb73-dccc-440b-8c68-f5d76cbc6257 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:02.959141 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-092cdb73-dccc-440b-8c68-f5d76cbc6257 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f525569d9ed4d61926ddad83a270032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c96b1f3aaed4700a792cf9d25aaaca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:24:02.967562 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-092cdb73-dccc-440b-8c68-f5d76cbc6257 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 200 len: 1224 microversion: 2.1 time: 0.084761 Feb 21 01:24:02.968163 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 718/1412] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:24:02 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:24:02.972890 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0d73b9ce-c155-4be9-a393-08b4a01120f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:02.981318 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0d73b9ce-c155-4be9-a393-08b4a01120f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:02.987939 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0d73b9ce-c155-4be9-a393-08b4a01120f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:02.988393 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0d73b9ce-c155-4be9-a393-08b4a01120f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:02.989189 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0d73b9ce-c155-4be9-a393-08b4a01120f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:02.989626 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0d73b9ce-c155-4be9-a393-08b4a01120f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:03.021116 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0d73b9ce-c155-4be9-a393-08b4a01120f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051286 Feb 21 01:24:03.021294 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 719/1413] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:02 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:03.028756 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ab846743-b482-4050-9ccf-c83b5b5ab51d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:03.028756 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ab846743-b482-4050-9ccf-c83b5b5ab51d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:03.032661 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ab846743-b482-4050-9ccf-c83b5b5ab51d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:03.033112 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ab846743-b482-4050-9ccf-c83b5b5ab51d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:03.033901 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ab846743-b482-4050-9ccf-c83b5b5ab51d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:03.034331 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ab846743-b482-4050-9ccf-c83b5b5ab51d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:03.039099 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.objects.instance [None req-408c4db4-0f7e-4aa0-ad41-2c09d3b6f458 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lazy-loading 'services' on Instance uuid 9d1f7594-329f-44cb-a627-184aa02bd0fc {{(pid=117138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:24:03.189385 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.wsgi [None req-408c4db4-0f7e-4aa0-ad41-2c09d3b6f458 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6636d219-cbfc-461b-88b7-14346ce630e2) Feb 21 01:24:03.190012 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-408c4db4-0f7e-4aa0-ad41-2c09d3b6f458 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6636d219-cbfc-461b-88b7-14346ce630e2) {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:24:03.190849 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-408c4db4-0f7e-4aa0-ad41-2c09d3b6f458 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "DELETE /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc/os-volume_attachments/859d92fe-750a-4e98-b4a2-1be720fbbb02" status: 400 len: 269 microversion: 2.1 time: 59.202620 Feb 21 01:24:03.191427 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 695/1414] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Feb 21 01:23:03 2022] DELETE /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc/os-volume_attachments/859d92fe-750a-4e98-b4a2-1be720fbbb02 => generated 269 bytes in 59204 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:24:03.236911 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.objects.instance [None req-ab846743-b482-4050-9ccf-c83b5b5ab51d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lazy-loading 'services' on Instance uuid 9d1f7594-329f-44cb-a627-184aa02bd0fc {{(pid=117139) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:24:03.614354 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-ab846743-b482-4050-9ccf-c83b5b5ab51d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a87ce56-74b0-40b9-9fa8-4435f7ade44e) Feb 21 01:24:03.614354 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ab846743-b482-4050-9ccf-c83b5b5ab51d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a87ce56-74b0-40b9-9fa8-4435f7ade44e) {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:24:03.614354 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ab846743-b482-4050-9ccf-c83b5b5ab51d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "DELETE /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc/os-volume_attachments/859d92fe-750a-4e98-b4a2-1be720fbbb02" status: 400 len: 269 microversion: 2.1 time: 0.582448 Feb 21 01:24:03.614354 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 720/1415] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Feb 21 01:24:03 2022] DELETE /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc/os-volume_attachments/859d92fe-750a-4e98-b4a2-1be720fbbb02 => generated 269 bytes in 583 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:24:03.983911 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-01134b2a-3ae3-4017-a4cb-e1dd67f70982 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:03.984527 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-01134b2a-3ae3-4017-a4cb-e1dd67f70982 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [instance: f114c776-ca8f-4972-a0a7-3af4a2740a2e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:03.992226 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-01134b2a-3ae3-4017-a4cb-e1dd67f70982 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:03.992682 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-01134b2a-3ae3-4017-a4cb-e1dd67f70982 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:03.993630 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-01134b2a-3ae3-4017-a4cb-e1dd67f70982 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:03.994346 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-01134b2a-3ae3-4017-a4cb-e1dd67f70982 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:04.006936 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.wsgi [None req-01134b2a-3ae3-4017-a4cb-e1dd67f70982 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] HTTP exception thrown: Instance f114c776-ca8f-4972-a0a7-3af4a2740a2e could not be found. Feb 21 01:24:04.007916 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-01134b2a-3ae3-4017-a4cb-e1dd67f70982 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Returning 404 to user: Instance f114c776-ca8f-4972-a0a7-3af4a2740a2e could not be found. {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:24:04.009923 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-01134b2a-3ae3-4017-a4cb-e1dd67f70982 tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e" status: 404 len: 111 microversion: 2.1 time: 0.028951 Feb 21 01:24:04.010589 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 696/1416] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:24:03 2022] GET /compute/v2.1/servers/f114c776-ca8f-4972-a0a7-3af4a2740a2e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:24:04.032700 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-18418d12-4b20-413c-9b4c-e790dbb7d649 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:04.033641 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-18418d12-4b20-413c-9b4c-e790dbb7d649 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:04.040007 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-18418d12-4b20-413c-9b4c-e790dbb7d649 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:04.040665 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-18418d12-4b20-413c-9b4c-e790dbb7d649 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:04.041706 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-18418d12-4b20-413c-9b4c-e790dbb7d649 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:04.042148 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-18418d12-4b20-413c-9b4c-e790dbb7d649 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:04.072478 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-18418d12-4b20-413c-9b4c-e790dbb7d649 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042816 Feb 21 01:24:04.073535 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 721/1417] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:04 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:05.084426 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7c7b0bc2-20a7-4866-a467-2d82dea295a0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:05.085330 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7c7b0bc2-20a7-4866-a467-2d82dea295a0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:05.092084 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7c7b0bc2-20a7-4866-a467-2d82dea295a0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:05.092522 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7c7b0bc2-20a7-4866-a467-2d82dea295a0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:05.093306 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7c7b0bc2-20a7-4866-a467-2d82dea295a0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:05.093735 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7c7b0bc2-20a7-4866-a467-2d82dea295a0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:05.124775 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7c7b0bc2-20a7-4866-a467-2d82dea295a0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044214 Feb 21 01:24:05.125342 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 697/1418] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:05 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:24:05.690265 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:24:05.690453 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:24:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:24:06.135898 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6d620e2a-84a5-47d0-bd43-4aa14a0e1ee7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:06.136828 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6d620e2a-84a5-47d0-bd43-4aa14a0e1ee7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:06.143222 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6d620e2a-84a5-47d0-bd43-4aa14a0e1ee7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:06.143676 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6d620e2a-84a5-47d0-bd43-4aa14a0e1ee7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:06.144554 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6d620e2a-84a5-47d0-bd43-4aa14a0e1ee7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:06.144982 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6d620e2a-84a5-47d0-bd43-4aa14a0e1ee7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:06.174239 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6d620e2a-84a5-47d0-bd43-4aa14a0e1ee7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042068 Feb 21 01:24:06.174727 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 722/1419] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:06 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:07.186894 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3f5c4264-1a60-45bb-87b3-30d95691c7e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:07.187809 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3f5c4264-1a60-45bb-87b3-30d95691c7e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:07.194027 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3f5c4264-1a60-45bb-87b3-30d95691c7e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:07.194475 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3f5c4264-1a60-45bb-87b3-30d95691c7e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:07.195257 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3f5c4264-1a60-45bb-87b3-30d95691c7e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:07.195694 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3f5c4264-1a60-45bb-87b3-30d95691c7e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:07.225169 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3f5c4264-1a60-45bb-87b3-30d95691c7e9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043226 Feb 21 01:24:07.225725 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 698/1420] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:07 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:08.236961 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d0526069-c797-4a66-a746-caf7d1de4599 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:08.237874 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d0526069-c797-4a66-a746-caf7d1de4599 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:08.244133 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d0526069-c797-4a66-a746-caf7d1de4599 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:08.244580 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d0526069-c797-4a66-a746-caf7d1de4599 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:08.245357 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d0526069-c797-4a66-a746-caf7d1de4599 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:08.245790 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d0526069-c797-4a66-a746-caf7d1de4599 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:08.275782 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d0526069-c797-4a66-a746-caf7d1de4599 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042606 Feb 21 01:24:08.276355 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 723/1421] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:08 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:09.287432 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6586f6ec-a8af-4f49-8201-f95a254f849c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:09.288390 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6586f6ec-a8af-4f49-8201-f95a254f849c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:09.294935 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6586f6ec-a8af-4f49-8201-f95a254f849c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:09.295382 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6586f6ec-a8af-4f49-8201-f95a254f849c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:09.296200 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6586f6ec-a8af-4f49-8201-f95a254f849c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:09.296639 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6586f6ec-a8af-4f49-8201-f95a254f849c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:09.326041 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6586f6ec-a8af-4f49-8201-f95a254f849c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042405 Feb 21 01:24:09.326593 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 699/1422] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:09 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:10.017297 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:24:10.017505 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:24:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:24:10.337491 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-862a3990-57a7-466f-afbe-30d7dc267377 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:10.338322 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-862a3990-57a7-466f-afbe-30d7dc267377 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:10.345149 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-862a3990-57a7-466f-afbe-30d7dc267377 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:10.345590 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-862a3990-57a7-466f-afbe-30d7dc267377 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:10.346357 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-862a3990-57a7-466f-afbe-30d7dc267377 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:10.346783 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-862a3990-57a7-466f-afbe-30d7dc267377 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:10.375931 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-862a3990-57a7-466f-afbe-30d7dc267377 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042369 Feb 21 01:24:10.376470 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 724/1423] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:10 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:11.386540 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7eba203a-1ecd-4373-83c5-d60fd3aff66a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:11.387439 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7eba203a-1ecd-4373-83c5-d60fd3aff66a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:11.393949 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7eba203a-1ecd-4373-83c5-d60fd3aff66a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:11.394388 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7eba203a-1ecd-4373-83c5-d60fd3aff66a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:11.395155 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7eba203a-1ecd-4373-83c5-d60fd3aff66a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:11.395582 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7eba203a-1ecd-4373-83c5-d60fd3aff66a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:11.425588 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7eba203a-1ecd-4373-83c5-d60fd3aff66a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042864 Feb 21 01:24:11.426133 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 700/1424] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:11 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:12.437911 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-50d834d3-5a46-4dac-9ceb-918b8ce56cb7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:12.438819 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-50d834d3-5a46-4dac-9ceb-918b8ce56cb7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:12.445364 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-50d834d3-5a46-4dac-9ceb-918b8ce56cb7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:12.445815 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-50d834d3-5a46-4dac-9ceb-918b8ce56cb7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:12.446604 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-50d834d3-5a46-4dac-9ceb-918b8ce56cb7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:12.447041 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-50d834d3-5a46-4dac-9ceb-918b8ce56cb7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:12.476998 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-50d834d3-5a46-4dac-9ceb-918b8ce56cb7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043031 Feb 21 01:24:12.477545 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 725/1425] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:12 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:13.488398 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4ff5b228-ed2b-4ccc-a8d2-a6780411b46a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:13.489310 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4ff5b228-ed2b-4ccc-a8d2-a6780411b46a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:13.496267 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ff5b228-ed2b-4ccc-a8d2-a6780411b46a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:13.496705 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ff5b228-ed2b-4ccc-a8d2-a6780411b46a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:13.497484 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ff5b228-ed2b-4ccc-a8d2-a6780411b46a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:13.497910 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ff5b228-ed2b-4ccc-a8d2-a6780411b46a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:13.526304 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4ff5b228-ed2b-4ccc-a8d2-a6780411b46a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041739 Feb 21 01:24:13.526842 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 701/1426] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:13 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:14.537952 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-902c18da-e326-4077-a1ca-f524bc5f5d3e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:14.538865 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-902c18da-e326-4077-a1ca-f524bc5f5d3e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:14.545082 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-902c18da-e326-4077-a1ca-f524bc5f5d3e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:14.545533 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-902c18da-e326-4077-a1ca-f524bc5f5d3e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:14.546316 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-902c18da-e326-4077-a1ca-f524bc5f5d3e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:14.546755 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-902c18da-e326-4077-a1ca-f524bc5f5d3e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:14.575537 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-902c18da-e326-4077-a1ca-f524bc5f5d3e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041380 Feb 21 01:24:14.576119 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 726/1427] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:14 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:15.586907 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-060bfbaf-9ed9-4e52-9e05-491cbe81b4f2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:15.587853 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-060bfbaf-9ed9-4e52-9e05-491cbe81b4f2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:15.595065 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-060bfbaf-9ed9-4e52-9e05-491cbe81b4f2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:15.595513 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-060bfbaf-9ed9-4e52-9e05-491cbe81b4f2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:15.596323 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-060bfbaf-9ed9-4e52-9e05-491cbe81b4f2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:15.596759 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-060bfbaf-9ed9-4e52-9e05-491cbe81b4f2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:15.626411 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-060bfbaf-9ed9-4e52-9e05-491cbe81b4f2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043251 Feb 21 01:24:15.626899 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 702/1428] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:15 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:16.637724 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-24cbf0ea-0b9b-4a2c-b695-eb4859345432 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:16.638534 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-24cbf0ea-0b9b-4a2c-b695-eb4859345432 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:16.645245 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-24cbf0ea-0b9b-4a2c-b695-eb4859345432 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:16.645684 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-24cbf0ea-0b9b-4a2c-b695-eb4859345432 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:16.646454 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-24cbf0ea-0b9b-4a2c-b695-eb4859345432 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:16.646885 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-24cbf0ea-0b9b-4a2c-b695-eb4859345432 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:16.675131 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-24cbf0ea-0b9b-4a2c-b695-eb4859345432 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041317 Feb 21 01:24:16.675663 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 727/1429] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:16 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:17.687649 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-eff4277c-c26c-402c-a956-a3b3ff9c6a81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:17.688529 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-eff4277c-c26c-402c-a956-a3b3ff9c6a81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:17.694334 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eff4277c-c26c-402c-a956-a3b3ff9c6a81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:17.694790 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eff4277c-c26c-402c-a956-a3b3ff9c6a81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:17.695565 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eff4277c-c26c-402c-a956-a3b3ff9c6a81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:17.696036 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eff4277c-c26c-402c-a956-a3b3ff9c6a81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:17.724841 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-eff4277c-c26c-402c-a956-a3b3ff9c6a81 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042065 Feb 21 01:24:17.725384 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 703/1430] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:17 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:18.736943 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ec2f43cf-ff96-4dbd-a23c-1068eb17a824 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:18.737844 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ec2f43cf-ff96-4dbd-a23c-1068eb17a824 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:18.743989 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec2f43cf-ff96-4dbd-a23c-1068eb17a824 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:18.744432 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec2f43cf-ff96-4dbd-a23c-1068eb17a824 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:18.745201 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec2f43cf-ff96-4dbd-a23c-1068eb17a824 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:18.745630 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec2f43cf-ff96-4dbd-a23c-1068eb17a824 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:18.775218 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ec2f43cf-ff96-4dbd-a23c-1068eb17a824 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042088 Feb 21 01:24:18.775772 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 728/1431] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:18 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:19.787211 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-003dfc5d-026f-4c35-ad0f-2f377db8f812 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:19.788145 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-003dfc5d-026f-4c35-ad0f-2f377db8f812 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:19.794806 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-003dfc5d-026f-4c35-ad0f-2f377db8f812 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:19.795251 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-003dfc5d-026f-4c35-ad0f-2f377db8f812 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:19.796067 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-003dfc5d-026f-4c35-ad0f-2f377db8f812 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:19.796507 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-003dfc5d-026f-4c35-ad0f-2f377db8f812 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:19.825994 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-003dfc5d-026f-4c35-ad0f-2f377db8f812 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042425 Feb 21 01:24:19.826540 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 704/1432] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:19 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:20.837552 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-38709c6d-c6ff-461a-a9f9-6725ec9aa568 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:20.838484 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-38709c6d-c6ff-461a-a9f9-6725ec9aa568 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:20.844930 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-38709c6d-c6ff-461a-a9f9-6725ec9aa568 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:20.845373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-38709c6d-c6ff-461a-a9f9-6725ec9aa568 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:20.846147 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-38709c6d-c6ff-461a-a9f9-6725ec9aa568 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:20.846579 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-38709c6d-c6ff-461a-a9f9-6725ec9aa568 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:20.876155 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-38709c6d-c6ff-461a-a9f9-6725ec9aa568 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042409 Feb 21 01:24:20.876702 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 729/1433] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:20 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:21.888315 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e2a59133-62cd-4742-8457-cd52706fbd90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:21.889225 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e2a59133-62cd-4742-8457-cd52706fbd90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:21.895631 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e2a59133-62cd-4742-8457-cd52706fbd90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:21.896108 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e2a59133-62cd-4742-8457-cd52706fbd90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:21.896893 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e2a59133-62cd-4742-8457-cd52706fbd90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:21.897335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e2a59133-62cd-4742-8457-cd52706fbd90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:21.927218 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e2a59133-62cd-4742-8457-cd52706fbd90 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043354 Feb 21 01:24:21.927758 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 705/1434] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:21 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:24:22.939210 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-bcdb104c-c89d-4d91-88d0-6130d3fd33c0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:22.940097 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-bcdb104c-c89d-4d91-88d0-6130d3fd33c0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:22.946426 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bcdb104c-c89d-4d91-88d0-6130d3fd33c0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:22.946867 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bcdb104c-c89d-4d91-88d0-6130d3fd33c0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:22.947632 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bcdb104c-c89d-4d91-88d0-6130d3fd33c0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:22.948090 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bcdb104c-c89d-4d91-88d0-6130d3fd33c0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:22.976766 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-bcdb104c-c89d-4d91-88d0-6130d3fd33c0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041426 Feb 21 01:24:22.977327 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 730/1435] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:22 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:23.988934 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4caebbca-d3bf-403d-9b74-b128b899f7df tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:23.989837 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4caebbca-d3bf-403d-9b74-b128b899f7df tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:23.996200 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4caebbca-d3bf-403d-9b74-b128b899f7df tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:23.996921 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4caebbca-d3bf-403d-9b74-b128b899f7df tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:23.997255 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4caebbca-d3bf-403d-9b74-b128b899f7df tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:23.997689 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4caebbca-d3bf-403d-9b74-b128b899f7df tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:24.026115 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4caebbca-d3bf-403d-9b74-b128b899f7df tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040934 Feb 21 01:24:24.026659 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 706/1436] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:23 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:25.044405 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0a74b468-c84a-4e76-8afa-b6ac16e3db89 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:25.045321 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0a74b468-c84a-4e76-8afa-b6ac16e3db89 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:25.051666 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a74b468-c84a-4e76-8afa-b6ac16e3db89 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:25.052150 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a74b468-c84a-4e76-8afa-b6ac16e3db89 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:25.052934 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a74b468-c84a-4e76-8afa-b6ac16e3db89 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:25.053372 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a74b468-c84a-4e76-8afa-b6ac16e3db89 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:25.083736 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0a74b468-c84a-4e76-8afa-b6ac16e3db89 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044280 Feb 21 01:24:25.084318 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 731/1437] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:25 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:26.094682 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ba86e27e-058a-496c-99f6-e07fad2e9dcc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:26.095623 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ba86e27e-058a-496c-99f6-e07fad2e9dcc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:26.101793 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ba86e27e-058a-496c-99f6-e07fad2e9dcc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:26.102306 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ba86e27e-058a-496c-99f6-e07fad2e9dcc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:26.103070 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ba86e27e-058a-496c-99f6-e07fad2e9dcc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:26.103510 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ba86e27e-058a-496c-99f6-e07fad2e9dcc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:26.132698 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ba86e27e-058a-496c-99f6-e07fad2e9dcc tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041809 Feb 21 01:24:26.133235 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 707/1438] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:26 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:27.145170 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f0fc00c1-e2ec-49e0-b158-7c0413a5618a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:27.146071 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f0fc00c1-e2ec-49e0-b158-7c0413a5618a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:27.153048 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f0fc00c1-e2ec-49e0-b158-7c0413a5618a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:27.153735 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f0fc00c1-e2ec-49e0-b158-7c0413a5618a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:27.154516 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f0fc00c1-e2ec-49e0-b158-7c0413a5618a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:27.154946 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f0fc00c1-e2ec-49e0-b158-7c0413a5618a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:27.183408 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f0fc00c1-e2ec-49e0-b158-7c0413a5618a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041994 Feb 21 01:24:27.183974 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 732/1439] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:27 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:24:28.194582 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9c613778-9bf2-44b4-90cb-63321917629a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:28.195415 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9c613778-9bf2-44b4-90cb-63321917629a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:28.202410 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9c613778-9bf2-44b4-90cb-63321917629a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:28.202862 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9c613778-9bf2-44b4-90cb-63321917629a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:28.203651 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9c613778-9bf2-44b4-90cb-63321917629a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:28.204109 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9c613778-9bf2-44b4-90cb-63321917629a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:28.237151 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9c613778-9bf2-44b4-90cb-63321917629a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046453 Feb 21 01:24:28.237702 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 708/1440] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:28 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:29.250311 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-49211876-aa26-4c97-8b06-d954352f88e7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:29.251223 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-49211876-aa26-4c97-8b06-d954352f88e7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:29.257483 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49211876-aa26-4c97-8b06-d954352f88e7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:29.257933 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49211876-aa26-4c97-8b06-d954352f88e7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:29.258710 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49211876-aa26-4c97-8b06-d954352f88e7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:29.259146 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49211876-aa26-4c97-8b06-d954352f88e7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:29.288811 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-49211876-aa26-4c97-8b06-d954352f88e7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043886 Feb 21 01:24:29.289358 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 733/1441] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:29 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:30.300270 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-afb82e89-bdb5-49e7-b256-1fd6235e5957 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:30.301173 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-afb82e89-bdb5-49e7-b256-1fd6235e5957 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:30.307348 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-afb82e89-bdb5-49e7-b256-1fd6235e5957 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:30.307789 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-afb82e89-bdb5-49e7-b256-1fd6235e5957 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:30.308717 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-afb82e89-bdb5-49e7-b256-1fd6235e5957 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:30.309149 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-afb82e89-bdb5-49e7-b256-1fd6235e5957 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:30.337890 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-afb82e89-bdb5-49e7-b256-1fd6235e5957 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041377 Feb 21 01:24:30.338439 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 709/1442] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:30 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:31.349906 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b972700d-0832-4f92-8337-3a6e84985487 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:31.350805 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b972700d-0832-4f92-8337-3a6e84985487 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:31.357101 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b972700d-0832-4f92-8337-3a6e84985487 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:31.357537 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b972700d-0832-4f92-8337-3a6e84985487 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:31.358320 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b972700d-0832-4f92-8337-3a6e84985487 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:31.358744 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b972700d-0832-4f92-8337-3a6e84985487 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:31.388213 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b972700d-0832-4f92-8337-3a6e84985487 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042036 Feb 21 01:24:31.388762 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 734/1443] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:31 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:32.399888 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7d5245ca-202e-44ca-afb8-235e5dde1111 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:32.400791 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7d5245ca-202e-44ca-afb8-235e5dde1111 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:32.407670 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7d5245ca-202e-44ca-afb8-235e5dde1111 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:32.408143 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7d5245ca-202e-44ca-afb8-235e5dde1111 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:32.408923 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7d5245ca-202e-44ca-afb8-235e5dde1111 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:32.409350 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7d5245ca-202e-44ca-afb8-235e5dde1111 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:32.437584 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7d5245ca-202e-44ca-afb8-235e5dde1111 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041454 Feb 21 01:24:32.438137 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 710/1444] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:32 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:33.449011 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d08ed3f7-4d11-47ce-abc1-77233105c03a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:33.449920 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d08ed3f7-4d11-47ce-abc1-77233105c03a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:33.456297 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d08ed3f7-4d11-47ce-abc1-77233105c03a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:33.456751 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d08ed3f7-4d11-47ce-abc1-77233105c03a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:33.457529 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d08ed3f7-4d11-47ce-abc1-77233105c03a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:33.457963 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d08ed3f7-4d11-47ce-abc1-77233105c03a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:33.487447 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d08ed3f7-4d11-47ce-abc1-77233105c03a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042266 Feb 21 01:24:33.488033 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 735/1445] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:33 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:34.499876 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-10867392-5b4c-466c-996c-5020d6990674 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:34.500801 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-10867392-5b4c-466c-996c-5020d6990674 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:34.506901 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-10867392-5b4c-466c-996c-5020d6990674 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:34.507342 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-10867392-5b4c-466c-996c-5020d6990674 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:34.508149 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-10867392-5b4c-466c-996c-5020d6990674 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:34.508569 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-10867392-5b4c-466c-996c-5020d6990674 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:34.538385 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-10867392-5b4c-466c-996c-5020d6990674 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042801 Feb 21 01:24:34.538918 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 711/1446] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:34 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:35.549834 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-72c6728c-5175-42b9-8d61-b1f0ad102bd7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:35.550770 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-72c6728c-5175-42b9-8d61-b1f0ad102bd7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:35.556954 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-72c6728c-5175-42b9-8d61-b1f0ad102bd7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:35.557398 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-72c6728c-5175-42b9-8d61-b1f0ad102bd7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:35.558818 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-72c6728c-5175-42b9-8d61-b1f0ad102bd7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:35.559251 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-72c6728c-5175-42b9-8d61-b1f0ad102bd7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:35.587559 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-72c6728c-5175-42b9-8d61-b1f0ad102bd7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041498 Feb 21 01:24:35.588132 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 736/1447] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:35 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:36.598879 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4607e655-f262-46cf-9b5c-3dc20a5cec4b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:36.599692 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4607e655-f262-46cf-9b5c-3dc20a5cec4b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:36.605854 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4607e655-f262-46cf-9b5c-3dc20a5cec4b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:36.606338 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4607e655-f262-46cf-9b5c-3dc20a5cec4b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:36.607096 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4607e655-f262-46cf-9b5c-3dc20a5cec4b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:36.607520 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4607e655-f262-46cf-9b5c-3dc20a5cec4b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:36.635768 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4607e655-f262-46cf-9b5c-3dc20a5cec4b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040835 Feb 21 01:24:36.636999 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 712/1448] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:36 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:37.647453 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8bdfde26-84b6-4c00-8787-c668511b4bbd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:37.648398 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8bdfde26-84b6-4c00-8787-c668511b4bbd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:37.655368 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8bdfde26-84b6-4c00-8787-c668511b4bbd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:37.655900 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8bdfde26-84b6-4c00-8787-c668511b4bbd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:37.656689 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8bdfde26-84b6-4c00-8787-c668511b4bbd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:37.657126 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8bdfde26-84b6-4c00-8787-c668511b4bbd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:37.685572 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8bdfde26-84b6-4c00-8787-c668511b4bbd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041847 Feb 21 01:24:37.686113 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 737/1449] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:37 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:38.697147 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b6cdf7bd-0b4f-4668-8a9c-75cba2425209 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:38.697969 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b6cdf7bd-0b4f-4668-8a9c-75cba2425209 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:38.704230 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b6cdf7bd-0b4f-4668-8a9c-75cba2425209 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:38.704669 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b6cdf7bd-0b4f-4668-8a9c-75cba2425209 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:38.705451 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b6cdf7bd-0b4f-4668-8a9c-75cba2425209 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:38.705878 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b6cdf7bd-0b4f-4668-8a9c-75cba2425209 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:38.737099 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b6cdf7bd-0b4f-4668-8a9c-75cba2425209 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043772 Feb 21 01:24:38.737658 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 713/1450] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:38 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:39.748903 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-26ef492f-d264-42c4-a76b-1b044d1cc7bf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:39.749801 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-26ef492f-d264-42c4-a76b-1b044d1cc7bf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:39.755987 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-26ef492f-d264-42c4-a76b-1b044d1cc7bf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:39.756433 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-26ef492f-d264-42c4-a76b-1b044d1cc7bf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:39.757195 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-26ef492f-d264-42c4-a76b-1b044d1cc7bf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:39.757619 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-26ef492f-d264-42c4-a76b-1b044d1cc7bf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:39.786401 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-26ef492f-d264-42c4-a76b-1b044d1cc7bf tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041734 Feb 21 01:24:39.786934 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 738/1451] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:39 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:40.797567 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ad308987-4727-4e51-9f9c-8625d3e7d0b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:40.798503 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ad308987-4727-4e51-9f9c-8625d3e7d0b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:40.804678 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ad308987-4727-4e51-9f9c-8625d3e7d0b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:40.805118 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ad308987-4727-4e51-9f9c-8625d3e7d0b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:40.805887 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ad308987-4727-4e51-9f9c-8625d3e7d0b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:40.806313 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ad308987-4727-4e51-9f9c-8625d3e7d0b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:40.834877 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ad308987-4727-4e51-9f9c-8625d3e7d0b1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041293 Feb 21 01:24:40.835434 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 714/1452] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:40 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:41.846464 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5ea1e9bd-bb77-40e0-a9fa-6a8f4506594f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:41.847375 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5ea1e9bd-bb77-40e0-a9fa-6a8f4506594f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:41.853568 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5ea1e9bd-bb77-40e0-a9fa-6a8f4506594f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:41.854013 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5ea1e9bd-bb77-40e0-a9fa-6a8f4506594f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:41.854793 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5ea1e9bd-bb77-40e0-a9fa-6a8f4506594f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:41.855223 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5ea1e9bd-bb77-40e0-a9fa-6a8f4506594f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:41.883992 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5ea1e9bd-bb77-40e0-a9fa-6a8f4506594f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041335 Feb 21 01:24:41.884533 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 739/1453] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:41 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:42.895634 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-15844c0e-49ec-4a88-a51d-48233abc4e9b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:42.896482 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-15844c0e-49ec-4a88-a51d-48233abc4e9b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:42.902589 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-15844c0e-49ec-4a88-a51d-48233abc4e9b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:42.903658 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-15844c0e-49ec-4a88-a51d-48233abc4e9b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:42.904472 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-15844c0e-49ec-4a88-a51d-48233abc4e9b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:42.904898 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-15844c0e-49ec-4a88-a51d-48233abc4e9b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:42.932820 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-15844c0e-49ec-4a88-a51d-48233abc4e9b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041040 Feb 21 01:24:42.933354 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 715/1454] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:42 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:43.944266 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8ff2b5af-ada1-4108-bed7-5bc69a5e3a29 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:43.945130 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8ff2b5af-ada1-4108-bed7-5bc69a5e3a29 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:43.951928 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8ff2b5af-ada1-4108-bed7-5bc69a5e3a29 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:43.952381 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8ff2b5af-ada1-4108-bed7-5bc69a5e3a29 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:43.953163 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8ff2b5af-ada1-4108-bed7-5bc69a5e3a29 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:43.953602 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8ff2b5af-ada1-4108-bed7-5bc69a5e3a29 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:43.983705 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8ff2b5af-ada1-4108-bed7-5bc69a5e3a29 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043396 Feb 21 01:24:43.984276 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 740/1455] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:43 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:44.994638 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9ba05ef0-7ea3-44c4-b9a7-caf296e0fc19 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:44.995547 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9ba05ef0-7ea3-44c4-b9a7-caf296e0fc19 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:45.002362 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9ba05ef0-7ea3-44c4-b9a7-caf296e0fc19 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:45.002756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9ba05ef0-7ea3-44c4-b9a7-caf296e0fc19 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:45.003529 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9ba05ef0-7ea3-44c4-b9a7-caf296e0fc19 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:45.004025 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9ba05ef0-7ea3-44c4-b9a7-caf296e0fc19 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:45.033005 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9ba05ef0-7ea3-44c4-b9a7-caf296e0fc19 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042286 Feb 21 01:24:45.033546 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 716/1456] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:44 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:46.044827 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-308dd7ef-09f2-4bf7-b0e5-a46180f58cdb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:46.045723 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-308dd7ef-09f2-4bf7-b0e5-a46180f58cdb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:46.051905 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-308dd7ef-09f2-4bf7-b0e5-a46180f58cdb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:46.052349 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-308dd7ef-09f2-4bf7-b0e5-a46180f58cdb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:46.053137 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-308dd7ef-09f2-4bf7-b0e5-a46180f58cdb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:46.053576 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-308dd7ef-09f2-4bf7-b0e5-a46180f58cdb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:46.083349 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-308dd7ef-09f2-4bf7-b0e5-a46180f58cdb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042808 Feb 21 01:24:46.083921 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 741/1457] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:46 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:47.095503 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cc79255a-8b10-4a2c-873f-72f23f5e319e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:47.096449 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cc79255a-8b10-4a2c-873f-72f23f5e319e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:47.102631 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc79255a-8b10-4a2c-873f-72f23f5e319e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:47.103079 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc79255a-8b10-4a2c-873f-72f23f5e319e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:47.103886 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc79255a-8b10-4a2c-873f-72f23f5e319e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:47.104327 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc79255a-8b10-4a2c-873f-72f23f5e319e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:47.134639 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cc79255a-8b10-4a2c-873f-72f23f5e319e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042885 Feb 21 01:24:47.135134 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 717/1458] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:47 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:48.146342 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e3fc78c1-2781-4f99-a9b5-ef7b3fe4842d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:48.147255 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e3fc78c1-2781-4f99-a9b5-ef7b3fe4842d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:48.153550 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e3fc78c1-2781-4f99-a9b5-ef7b3fe4842d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:48.153908 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e3fc78c1-2781-4f99-a9b5-ef7b3fe4842d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:48.154678 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e3fc78c1-2781-4f99-a9b5-ef7b3fe4842d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:48.155138 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e3fc78c1-2781-4f99-a9b5-ef7b3fe4842d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:48.183537 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e3fc78c1-2781-4f99-a9b5-ef7b3fe4842d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041059 Feb 21 01:24:48.184775 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 742/1459] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:48 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:49.195562 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7aeec46d-f530-469b-a7e2-389285705a1d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:49.196486 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7aeec46d-f530-469b-a7e2-389285705a1d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:49.202637 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7aeec46d-f530-469b-a7e2-389285705a1d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:49.203075 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7aeec46d-f530-469b-a7e2-389285705a1d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:49.203900 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7aeec46d-f530-469b-a7e2-389285705a1d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:49.204330 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7aeec46d-f530-469b-a7e2-389285705a1d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:49.233806 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7aeec46d-f530-469b-a7e2-389285705a1d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041997 Feb 21 01:24:49.234360 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 718/1460] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:49 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:50.247362 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-54d3140d-0ba3-4d4d-acf0-44d84a5ebda7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:50.248348 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-54d3140d-0ba3-4d4d-acf0-44d84a5ebda7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:50.254286 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-54d3140d-0ba3-4d4d-acf0-44d84a5ebda7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:50.254732 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-54d3140d-0ba3-4d4d-acf0-44d84a5ebda7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:50.255513 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-54d3140d-0ba3-4d4d-acf0-44d84a5ebda7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:50.255972 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-54d3140d-0ba3-4d4d-acf0-44d84a5ebda7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:50.285449 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-54d3140d-0ba3-4d4d-acf0-44d84a5ebda7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042339 Feb 21 01:24:50.286000 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 743/1461] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:50 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:51.297253 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-949f0e50-223d-4917-a665-f3578f11a047 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:51.298146 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-949f0e50-223d-4917-a665-f3578f11a047 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:51.304307 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-949f0e50-223d-4917-a665-f3578f11a047 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:51.304750 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-949f0e50-223d-4917-a665-f3578f11a047 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:51.305517 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-949f0e50-223d-4917-a665-f3578f11a047 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:51.305944 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-949f0e50-223d-4917-a665-f3578f11a047 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:51.334768 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-949f0e50-223d-4917-a665-f3578f11a047 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041782 Feb 21 01:24:51.335316 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 719/1462] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:51 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:52.345264 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-153f5512-e40d-4496-ae5e-50d80ef783d1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:52.346169 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-153f5512-e40d-4496-ae5e-50d80ef783d1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:52.352434 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-153f5512-e40d-4496-ae5e-50d80ef783d1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:52.352880 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-153f5512-e40d-4496-ae5e-50d80ef783d1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:52.353660 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-153f5512-e40d-4496-ae5e-50d80ef783d1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:52.354092 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-153f5512-e40d-4496-ae5e-50d80ef783d1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:52.383004 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-153f5512-e40d-4496-ae5e-50d80ef783d1 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041459 Feb 21 01:24:52.383548 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 744/1463] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:52 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:53.394740 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7d85274a-65e2-483f-8e4e-e674610b6abd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:53.395656 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7d85274a-65e2-483f-8e4e-e674610b6abd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:53.401826 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7d85274a-65e2-483f-8e4e-e674610b6abd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:53.402269 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7d85274a-65e2-483f-8e4e-e674610b6abd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:53.403728 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7d85274a-65e2-483f-8e4e-e674610b6abd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:53.404208 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7d85274a-65e2-483f-8e4e-e674610b6abd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:53.433027 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7d85274a-65e2-483f-8e4e-e674610b6abd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042024 Feb 21 01:24:53.433583 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 720/1464] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:53 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:54.445137 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-600e63d3-e751-4972-8665-c54bb425bb0d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:54.446056 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-600e63d3-e751-4972-8665-c54bb425bb0d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:54.453427 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-600e63d3-e751-4972-8665-c54bb425bb0d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:54.453881 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-600e63d3-e751-4972-8665-c54bb425bb0d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:54.454672 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-600e63d3-e751-4972-8665-c54bb425bb0d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:54.455111 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-600e63d3-e751-4972-8665-c54bb425bb0d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:54.484521 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-600e63d3-e751-4972-8665-c54bb425bb0d tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043177 Feb 21 01:24:54.485066 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 745/1465] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:54 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:55.496001 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f6378952-29ce-4438-a8da-38aab5b84828 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:55.497464 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f6378952-29ce-4438-a8da-38aab5b84828 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:55.503606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f6378952-29ce-4438-a8da-38aab5b84828 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:55.504083 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f6378952-29ce-4438-a8da-38aab5b84828 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:55.504856 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f6378952-29ce-4438-a8da-38aab5b84828 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:55.505283 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f6378952-29ce-4438-a8da-38aab5b84828 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:55.533796 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f6378952-29ce-4438-a8da-38aab5b84828 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041625 Feb 21 01:24:55.534328 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 721/1466] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:55 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:56.546328 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b1917425-6f38-4c33-bb70-a51bad38137b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:56.547240 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b1917425-6f38-4c33-bb70-a51bad38137b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:56.553461 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b1917425-6f38-4c33-bb70-a51bad38137b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:56.553914 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b1917425-6f38-4c33-bb70-a51bad38137b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:56.554697 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b1917425-6f38-4c33-bb70-a51bad38137b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:56.555139 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b1917425-6f38-4c33-bb70-a51bad38137b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:56.584471 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b1917425-6f38-4c33-bb70-a51bad38137b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042663 Feb 21 01:24:56.585010 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 746/1467] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:56 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:57.595884 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d254f87c-80e1-414b-b5a0-4d47f4ba3b74 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:57.596801 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d254f87c-80e1-414b-b5a0-4d47f4ba3b74 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:57.602909 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d254f87c-80e1-414b-b5a0-4d47f4ba3b74 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:57.603359 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d254f87c-80e1-414b-b5a0-4d47f4ba3b74 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:57.604163 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d254f87c-80e1-414b-b5a0-4d47f4ba3b74 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:57.604599 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d254f87c-80e1-414b-b5a0-4d47f4ba3b74 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:57.633623 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d254f87c-80e1-414b-b5a0-4d47f4ba3b74 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041504 Feb 21 01:24:57.634176 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 722/1468] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:57 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:58.645466 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-15c34f60-9448-4219-a012-9128954ba1b4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:58.646392 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-15c34f60-9448-4219-a012-9128954ba1b4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:58.652712 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-15c34f60-9448-4219-a012-9128954ba1b4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:58.653317 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-15c34f60-9448-4219-a012-9128954ba1b4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:58.654110 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-15c34f60-9448-4219-a012-9128954ba1b4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:58.654548 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-15c34f60-9448-4219-a012-9128954ba1b4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:58.683346 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-15c34f60-9448-4219-a012-9128954ba1b4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041618 Feb 21 01:24:58.684829 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 747/1469] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:58 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:59.695129 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-af729c63-ed0f-46a7-adec-eb9e00e85e60 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:59.696071 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-af729c63-ed0f-46a7-adec-eb9e00e85e60 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:24:59.703443 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-af729c63-ed0f-46a7-adec-eb9e00e85e60 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:59.703909 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-af729c63-ed0f-46a7-adec-eb9e00e85e60 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:59.704679 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-af729c63-ed0f-46a7-adec-eb9e00e85e60 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:24:59.705102 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-af729c63-ed0f-46a7-adec-eb9e00e85e60 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:24:59.733160 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-af729c63-ed0f-46a7-adec-eb9e00e85e60 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041777 Feb 21 01:24:59.733695 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 723/1470] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:24:59 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:00.744546 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7b362552-4484-45e0-93a9-e8be00691298 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:00.745589 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7b362552-4484-45e0-93a9-e8be00691298 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:00.752627 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7b362552-4484-45e0-93a9-e8be00691298 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:00.753171 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7b362552-4484-45e0-93a9-e8be00691298 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:00.754026 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7b362552-4484-45e0-93a9-e8be00691298 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:00.754533 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7b362552-4484-45e0-93a9-e8be00691298 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:00.784794 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7b362552-4484-45e0-93a9-e8be00691298 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044038 Feb 21 01:25:00.785337 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 748/1471] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:00 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:01.796728 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-747c4d33-bf70-473e-a934-9ca006a3a837 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:01.797663 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-747c4d33-bf70-473e-a934-9ca006a3a837 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:01.803740 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-747c4d33-bf70-473e-a934-9ca006a3a837 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:01.804265 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-747c4d33-bf70-473e-a934-9ca006a3a837 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:01.805052 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-747c4d33-bf70-473e-a934-9ca006a3a837 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:01.805478 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-747c4d33-bf70-473e-a934-9ca006a3a837 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:01.835378 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-747c4d33-bf70-473e-a934-9ca006a3a837 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042937 Feb 21 01:25:01.835948 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 724/1472] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:01 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:02.846641 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fc0fb3e7-0537-4b5b-b134-00c697e10cb6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:02.847548 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fc0fb3e7-0537-4b5b-b134-00c697e10cb6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:02.853669 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fc0fb3e7-0537-4b5b-b134-00c697e10cb6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:02.854204 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fc0fb3e7-0537-4b5b-b134-00c697e10cb6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:02.854993 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fc0fb3e7-0537-4b5b-b134-00c697e10cb6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:02.856204 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fc0fb3e7-0537-4b5b-b134-00c697e10cb6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:02.886749 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-fc0fb3e7-0537-4b5b-b134-00c697e10cb6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043802 Feb 21 01:25:02.887492 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 749/1473] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:02 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:03.897529 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f3b1a3fa-9736-4886-85bd-56fcfe956487 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:03.898453 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f3b1a3fa-9736-4886-85bd-56fcfe956487 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:03.905258 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f3b1a3fa-9736-4886-85bd-56fcfe956487 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:03.905714 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f3b1a3fa-9736-4886-85bd-56fcfe956487 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:03.906503 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f3b1a3fa-9736-4886-85bd-56fcfe956487 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:03.906942 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f3b1a3fa-9736-4886-85bd-56fcfe956487 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:03.938112 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f3b1a3fa-9736-4886-85bd-56fcfe956487 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044342 Feb 21 01:25:03.938682 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 725/1474] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:03 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:04.950065 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6e0a4a06-9aeb-4c3a-9f59-f388051aea1f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:04.950976 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6e0a4a06-9aeb-4c3a-9f59-f388051aea1f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:04.957417 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6e0a4a06-9aeb-4c3a-9f59-f388051aea1f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:04.957855 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6e0a4a06-9aeb-4c3a-9f59-f388051aea1f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:04.958632 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6e0a4a06-9aeb-4c3a-9f59-f388051aea1f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:04.959112 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6e0a4a06-9aeb-4c3a-9f59-f388051aea1f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:04.989174 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6e0a4a06-9aeb-4c3a-9f59-f388051aea1f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043602 Feb 21 01:25:04.989743 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 750/1475] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:04 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:06.000853 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-88a6af4e-95d0-4216-9453-bb00b1679a1b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:06.001790 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-88a6af4e-95d0-4216-9453-bb00b1679a1b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:06.008197 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-88a6af4e-95d0-4216-9453-bb00b1679a1b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:06.009487 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-88a6af4e-95d0-4216-9453-bb00b1679a1b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:06.009601 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-88a6af4e-95d0-4216-9453-bb00b1679a1b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:06.009969 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-88a6af4e-95d0-4216-9453-bb00b1679a1b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:06.040900 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-88a6af4e-95d0-4216-9453-bb00b1679a1b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043911 Feb 21 01:25:06.041460 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 726/1476] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:05 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:07.053200 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f3f71e52-30d3-4b43-8029-a752a9ace7d9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:07.054094 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f3f71e52-30d3-4b43-8029-a752a9ace7d9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:07.062759 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f3f71e52-30d3-4b43-8029-a752a9ace7d9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:07.063200 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f3f71e52-30d3-4b43-8029-a752a9ace7d9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:07.064016 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f3f71e52-30d3-4b43-8029-a752a9ace7d9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:07.064446 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f3f71e52-30d3-4b43-8029-a752a9ace7d9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:07.093074 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f3f71e52-30d3-4b43-8029-a752a9ace7d9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043609 Feb 21 01:25:07.093629 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 751/1477] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:07 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:08.104655 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d6e5da4a-2f4b-4c49-a8ad-7ef56977cc1f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:08.106205 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d6e5da4a-2f4b-4c49-a8ad-7ef56977cc1f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:08.112576 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d6e5da4a-2f4b-4c49-a8ad-7ef56977cc1f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:08.113023 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d6e5da4a-2f4b-4c49-a8ad-7ef56977cc1f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:08.113798 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d6e5da4a-2f4b-4c49-a8ad-7ef56977cc1f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:08.114229 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d6e5da4a-2f4b-4c49-a8ad-7ef56977cc1f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:08.142620 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d6e5da4a-2f4b-4c49-a8ad-7ef56977cc1f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041749 Feb 21 01:25:08.143161 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 727/1478] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:08 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:09.153406 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-272e79be-0d6d-4f10-8473-59951d638941 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:09.154322 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-272e79be-0d6d-4f10-8473-59951d638941 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:09.160481 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-272e79be-0d6d-4f10-8473-59951d638941 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:09.160931 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-272e79be-0d6d-4f10-8473-59951d638941 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:09.161712 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-272e79be-0d6d-4f10-8473-59951d638941 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:09.162149 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-272e79be-0d6d-4f10-8473-59951d638941 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:09.192288 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-272e79be-0d6d-4f10-8473-59951d638941 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042779 Feb 21 01:25:09.192841 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 752/1479] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:09 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:10.204442 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d6c18be0-f9f0-45ec-a3ab-9b17a529ac1a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:10.205346 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d6c18be0-f9f0-45ec-a3ab-9b17a529ac1a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:10.211575 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d6c18be0-f9f0-45ec-a3ab-9b17a529ac1a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:10.212049 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d6c18be0-f9f0-45ec-a3ab-9b17a529ac1a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:10.212816 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d6c18be0-f9f0-45ec-a3ab-9b17a529ac1a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:10.213241 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d6c18be0-f9f0-45ec-a3ab-9b17a529ac1a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:10.241575 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d6c18be0-f9f0-45ec-a3ab-9b17a529ac1a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040886 Feb 21 01:25:10.242115 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 728/1480] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:10 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:25:11.252940 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-da598ce2-f755-47b7-b48b-f3b5613ef9b2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:11.253875 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-da598ce2-f755-47b7-b48b-f3b5613ef9b2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:11.260077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-da598ce2-f755-47b7-b48b-f3b5613ef9b2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:11.260520 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-da598ce2-f755-47b7-b48b-f3b5613ef9b2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:11.261346 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-da598ce2-f755-47b7-b48b-f3b5613ef9b2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:11.261950 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-da598ce2-f755-47b7-b48b-f3b5613ef9b2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:11.291214 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-da598ce2-f755-47b7-b48b-f3b5613ef9b2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042055 Feb 21 01:25:11.291759 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 753/1481] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:11 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:12.303384 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-51acacc3-4fe8-42e4-8849-3840d0eda746 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:12.304392 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-51acacc3-4fe8-42e4-8849-3840d0eda746 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:12.311878 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51acacc3-4fe8-42e4-8849-3840d0eda746 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:12.312334 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51acacc3-4fe8-42e4-8849-3840d0eda746 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:12.313150 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51acacc3-4fe8-42e4-8849-3840d0eda746 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:12.313587 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51acacc3-4fe8-42e4-8849-3840d0eda746 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:12.343464 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-51acacc3-4fe8-42e4-8849-3840d0eda746 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043912 Feb 21 01:25:12.344058 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 729/1482] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:12 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:13.354650 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1e04a85b-d0a7-46e5-a1e0-3040cd9981c6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:13.355619 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1e04a85b-d0a7-46e5-a1e0-3040cd9981c6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:13.361772 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e04a85b-d0a7-46e5-a1e0-3040cd9981c6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:13.362215 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e04a85b-d0a7-46e5-a1e0-3040cd9981c6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:13.362986 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e04a85b-d0a7-46e5-a1e0-3040cd9981c6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:13.363413 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e04a85b-d0a7-46e5-a1e0-3040cd9981c6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:13.392702 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1e04a85b-d0a7-46e5-a1e0-3040cd9981c6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041869 Feb 21 01:25:13.393238 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 754/1483] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:13 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:25:14.404867 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ec793755-07e5-456d-bd88-71183d86ab2a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:14.405767 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ec793755-07e5-456d-bd88-71183d86ab2a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:14.412175 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec793755-07e5-456d-bd88-71183d86ab2a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:14.412563 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec793755-07e5-456d-bd88-71183d86ab2a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:14.413339 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec793755-07e5-456d-bd88-71183d86ab2a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:14.413769 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec793755-07e5-456d-bd88-71183d86ab2a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:14.443627 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ec793755-07e5-456d-bd88-71183d86ab2a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043341 Feb 21 01:25:14.444211 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 730/1484] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:14 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:15.455671 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-57f7c5d9-a40b-474b-ae09-b238f29691ed tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:15.456609 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-57f7c5d9-a40b-474b-ae09-b238f29691ed tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:15.462859 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57f7c5d9-a40b-474b-ae09-b238f29691ed tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:15.463308 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57f7c5d9-a40b-474b-ae09-b238f29691ed tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:15.464128 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57f7c5d9-a40b-474b-ae09-b238f29691ed tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:15.464890 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57f7c5d9-a40b-474b-ae09-b238f29691ed tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:15.493242 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-57f7c5d9-a40b-474b-ae09-b238f29691ed tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041412 Feb 21 01:25:15.493786 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 755/1485] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:15 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:16.505480 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6866981e-ab75-4d22-a772-83749117ee5a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:16.506395 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6866981e-ab75-4d22-a772-83749117ee5a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:16.514082 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6866981e-ab75-4d22-a772-83749117ee5a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:16.514533 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6866981e-ab75-4d22-a772-83749117ee5a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:16.515317 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6866981e-ab75-4d22-a772-83749117ee5a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:16.515757 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6866981e-ab75-4d22-a772-83749117ee5a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:16.545786 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6866981e-ab75-4d22-a772-83749117ee5a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044197 Feb 21 01:25:16.546335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 731/1486] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:16 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:17.557261 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-86191450-5cae-42b4-8bfb-09d74d9374e6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:17.558165 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-86191450-5cae-42b4-8bfb-09d74d9374e6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:17.564527 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-86191450-5cae-42b4-8bfb-09d74d9374e6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:17.564975 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-86191450-5cae-42b4-8bfb-09d74d9374e6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:17.565753 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-86191450-5cae-42b4-8bfb-09d74d9374e6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:17.566185 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-86191450-5cae-42b4-8bfb-09d74d9374e6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:17.595776 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-86191450-5cae-42b4-8bfb-09d74d9374e6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042300 Feb 21 01:25:17.596340 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 756/1487] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:17 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:18.608067 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1be8306b-943c-40de-b823-544ebafe8bbe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:18.609066 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1be8306b-943c-40de-b823-544ebafe8bbe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:18.614820 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1be8306b-943c-40de-b823-544ebafe8bbe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:18.615269 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1be8306b-943c-40de-b823-544ebafe8bbe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:18.616083 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1be8306b-943c-40de-b823-544ebafe8bbe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:18.616524 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1be8306b-943c-40de-b823-544ebafe8bbe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:18.645457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1be8306b-943c-40de-b823-544ebafe8bbe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042067 Feb 21 01:25:18.646002 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 732/1488] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:18 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:19.656671 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-edac399f-0575-44c1-9856-fd9188374c22 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:19.657585 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-edac399f-0575-44c1-9856-fd9188374c22 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:19.663785 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-edac399f-0575-44c1-9856-fd9188374c22 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:19.664263 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-edac399f-0575-44c1-9856-fd9188374c22 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:19.665043 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-edac399f-0575-44c1-9856-fd9188374c22 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:19.665481 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-edac399f-0575-44c1-9856-fd9188374c22 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:19.695637 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-edac399f-0575-44c1-9856-fd9188374c22 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043203 Feb 21 01:25:19.696239 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 757/1489] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:19 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:20.706647 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7f49a08e-a64c-48a7-b7dd-17eb373adbcb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:20.707578 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7f49a08e-a64c-48a7-b7dd-17eb373adbcb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:20.713768 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7f49a08e-a64c-48a7-b7dd-17eb373adbcb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:20.714218 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7f49a08e-a64c-48a7-b7dd-17eb373adbcb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:20.715016 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7f49a08e-a64c-48a7-b7dd-17eb373adbcb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:20.715528 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7f49a08e-a64c-48a7-b7dd-17eb373adbcb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:20.743537 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7f49a08e-a64c-48a7-b7dd-17eb373adbcb tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040783 Feb 21 01:25:20.744110 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 733/1490] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:20 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:21.755307 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6f8bee31-5701-4766-9793-6b35c44f9713 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:21.756240 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6f8bee31-5701-4766-9793-6b35c44f9713 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:21.763654 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6f8bee31-5701-4766-9793-6b35c44f9713 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:21.764129 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6f8bee31-5701-4766-9793-6b35c44f9713 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:21.764915 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6f8bee31-5701-4766-9793-6b35c44f9713 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:21.765340 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6f8bee31-5701-4766-9793-6b35c44f9713 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:21.794671 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6f8bee31-5701-4766-9793-6b35c44f9713 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043128 Feb 21 01:25:21.795214 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 758/1491] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:21 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:22.806431 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6374eb1d-94bd-4acb-bb00-92c5bb641b25 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:22.807336 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6374eb1d-94bd-4acb-bb00-92c5bb641b25 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:22.814391 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6374eb1d-94bd-4acb-bb00-92c5bb641b25 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:22.814827 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6374eb1d-94bd-4acb-bb00-92c5bb641b25 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:22.815595 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6374eb1d-94bd-4acb-bb00-92c5bb641b25 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:22.816055 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6374eb1d-94bd-4acb-bb00-92c5bb641b25 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:22.845619 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6374eb1d-94bd-4acb-bb00-92c5bb641b25 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043102 Feb 21 01:25:22.846164 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 734/1492] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:22 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:23.857578 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e50f985b-20a8-4740-a805-67255f0197d3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:23.858488 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e50f985b-20a8-4740-a805-67255f0197d3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:23.864701 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e50f985b-20a8-4740-a805-67255f0197d3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:23.865144 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e50f985b-20a8-4740-a805-67255f0197d3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:23.865922 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e50f985b-20a8-4740-a805-67255f0197d3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:23.866351 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e50f985b-20a8-4740-a805-67255f0197d3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:23.895053 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e50f985b-20a8-4740-a805-67255f0197d3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041795 Feb 21 01:25:23.895519 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 759/1493] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:23 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:24.907026 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-917e34d3-7673-4fd2-9684-2de69fb2f5e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:24.907966 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-917e34d3-7673-4fd2-9684-2de69fb2f5e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:24.914488 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-917e34d3-7673-4fd2-9684-2de69fb2f5e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:24.914963 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-917e34d3-7673-4fd2-9684-2de69fb2f5e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:24.915785 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-917e34d3-7673-4fd2-9684-2de69fb2f5e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:24.916261 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-917e34d3-7673-4fd2-9684-2de69fb2f5e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:24.945751 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-917e34d3-7673-4fd2-9684-2de69fb2f5e5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043110 Feb 21 01:25:24.946302 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 735/1494] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:24 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:25.957682 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3ba6629f-09b1-4818-a0ec-2c05fcd86ad4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:25.958624 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3ba6629f-09b1-4818-a0ec-2c05fcd86ad4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:25.965314 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3ba6629f-09b1-4818-a0ec-2c05fcd86ad4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:25.965760 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3ba6629f-09b1-4818-a0ec-2c05fcd86ad4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:25.966542 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3ba6629f-09b1-4818-a0ec-2c05fcd86ad4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:25.966973 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3ba6629f-09b1-4818-a0ec-2c05fcd86ad4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:25.998366 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3ba6629f-09b1-4818-a0ec-2c05fcd86ad4 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044394 Feb 21 01:25:25.998928 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 760/1495] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:25 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:27.009918 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b0e3d7d4-4fe8-4805-af21-a5eb103497b2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:27.010835 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b0e3d7d4-4fe8-4805-af21-a5eb103497b2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:27.017859 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b0e3d7d4-4fe8-4805-af21-a5eb103497b2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:27.018306 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b0e3d7d4-4fe8-4805-af21-a5eb103497b2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:27.019109 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b0e3d7d4-4fe8-4805-af21-a5eb103497b2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:27.019521 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b0e3d7d4-4fe8-4805-af21-a5eb103497b2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:27.048199 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b0e3d7d4-4fe8-4805-af21-a5eb103497b2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042075 Feb 21 01:25:27.048743 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 736/1496] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:27 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:28.060362 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9a3b6bb6-0f17-4534-bbb4-a163db81f63f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:28.061296 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9a3b6bb6-0f17-4534-bbb4-a163db81f63f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:28.067458 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9a3b6bb6-0f17-4534-bbb4-a163db81f63f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:28.067933 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9a3b6bb6-0f17-4534-bbb4-a163db81f63f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:28.068706 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9a3b6bb6-0f17-4534-bbb4-a163db81f63f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:28.069138 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9a3b6bb6-0f17-4534-bbb4-a163db81f63f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:28.096996 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9a3b6bb6-0f17-4534-bbb4-a163db81f63f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041175 Feb 21 01:25:28.097540 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 761/1497] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:28 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:29.108374 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6f43182e-7170-461f-b1f2-52f3fba56028 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:29.109281 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6f43182e-7170-461f-b1f2-52f3fba56028 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:29.115456 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6f43182e-7170-461f-b1f2-52f3fba56028 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:29.115939 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6f43182e-7170-461f-b1f2-52f3fba56028 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:29.116717 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6f43182e-7170-461f-b1f2-52f3fba56028 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:29.117149 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6f43182e-7170-461f-b1f2-52f3fba56028 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:29.146706 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6f43182e-7170-461f-b1f2-52f3fba56028 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042159 Feb 21 01:25:29.147255 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 737/1498] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:29 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:30.158195 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-db0ef44d-ece5-4081-a568-896b38c0f16f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:30.159152 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-db0ef44d-ece5-4081-a568-896b38c0f16f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:30.165385 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db0ef44d-ece5-4081-a568-896b38c0f16f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:30.165830 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db0ef44d-ece5-4081-a568-896b38c0f16f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:30.166609 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db0ef44d-ece5-4081-a568-896b38c0f16f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:30.167043 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db0ef44d-ece5-4081-a568-896b38c0f16f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:30.196577 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-db0ef44d-ece5-4081-a568-896b38c0f16f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042209 Feb 21 01:25:30.197115 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 762/1499] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:30 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:31.208291 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6b237313-bb49-4297-a5fc-7b55d9b49b37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:31.209201 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6b237313-bb49-4297-a5fc-7b55d9b49b37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:31.215392 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b237313-bb49-4297-a5fc-7b55d9b49b37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:31.215860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b237313-bb49-4297-a5fc-7b55d9b49b37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:31.216648 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b237313-bb49-4297-a5fc-7b55d9b49b37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:31.217078 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b237313-bb49-4297-a5fc-7b55d9b49b37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:31.245558 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6b237313-bb49-4297-a5fc-7b55d9b49b37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041115 Feb 21 01:25:31.246706 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 738/1500] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:31 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:32.257506 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-71eb324a-4b1d-43c8-800e-4ba36f4ef096 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:32.258415 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-71eb324a-4b1d-43c8-800e-4ba36f4ef096 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:32.265415 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-71eb324a-4b1d-43c8-800e-4ba36f4ef096 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:32.265863 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-71eb324a-4b1d-43c8-800e-4ba36f4ef096 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:32.266681 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-71eb324a-4b1d-43c8-800e-4ba36f4ef096 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:32.267113 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-71eb324a-4b1d-43c8-800e-4ba36f4ef096 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:32.296181 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-71eb324a-4b1d-43c8-800e-4ba36f4ef096 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042393 Feb 21 01:25:32.296723 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 763/1501] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:32 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:33.307591 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a19f2845-bdff-4300-8863-2dde2055a67c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:33.308529 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a19f2845-bdff-4300-8863-2dde2055a67c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:33.315549 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a19f2845-bdff-4300-8863-2dde2055a67c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:33.316034 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a19f2845-bdff-4300-8863-2dde2055a67c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:33.316825 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a19f2845-bdff-4300-8863-2dde2055a67c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:33.317261 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a19f2845-bdff-4300-8863-2dde2055a67c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:33.352691 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a19f2845-bdff-4300-8863-2dde2055a67c tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048794 Feb 21 01:25:33.353655 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 739/1502] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:33 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:34.364837 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3982b9a1-8cde-42ad-948a-767c546d4be8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:34.365742 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3982b9a1-8cde-42ad-948a-767c546d4be8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:34.372068 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3982b9a1-8cde-42ad-948a-767c546d4be8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:34.372511 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3982b9a1-8cde-42ad-948a-767c546d4be8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:34.373946 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3982b9a1-8cde-42ad-948a-767c546d4be8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:34.374378 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3982b9a1-8cde-42ad-948a-767c546d4be8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:34.402848 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3982b9a1-8cde-42ad-948a-767c546d4be8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041795 Feb 21 01:25:34.403388 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 764/1503] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:34 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:35.413547 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-26a09bc3-654f-45b7-98e9-88ef1ec4f437 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:35.414473 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-26a09bc3-654f-45b7-98e9-88ef1ec4f437 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:35.421421 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-26a09bc3-654f-45b7-98e9-88ef1ec4f437 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:35.421860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-26a09bc3-654f-45b7-98e9-88ef1ec4f437 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:35.422630 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-26a09bc3-654f-45b7-98e9-88ef1ec4f437 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:35.423056 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-26a09bc3-654f-45b7-98e9-88ef1ec4f437 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:35.452225 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-26a09bc3-654f-45b7-98e9-88ef1ec4f437 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042494 Feb 21 01:25:35.452801 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 740/1504] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:35 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:36.463718 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f60d430b-bb7d-473e-9108-a6b4194d3f9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:36.464656 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f60d430b-bb7d-473e-9108-a6b4194d3f9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:36.471103 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f60d430b-bb7d-473e-9108-a6b4194d3f9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:36.471591 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f60d430b-bb7d-473e-9108-a6b4194d3f9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:36.472404 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f60d430b-bb7d-473e-9108-a6b4194d3f9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:36.472835 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f60d430b-bb7d-473e-9108-a6b4194d3f9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:36.503349 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f60d430b-bb7d-473e-9108-a6b4194d3f9f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043382 Feb 21 01:25:36.503927 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 765/1505] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:36 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:37.515518 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-567834f2-414f-42f8-bea9-60d1cdc18e00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:37.516510 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-567834f2-414f-42f8-bea9-60d1cdc18e00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:37.522726 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-567834f2-414f-42f8-bea9-60d1cdc18e00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:37.523187 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-567834f2-414f-42f8-bea9-60d1cdc18e00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:37.523987 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-567834f2-414f-42f8-bea9-60d1cdc18e00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:37.524421 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-567834f2-414f-42f8-bea9-60d1cdc18e00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:37.553019 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-567834f2-414f-42f8-bea9-60d1cdc18e00 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042156 Feb 21 01:25:37.553580 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 741/1506] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:37 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:38.565597 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4b1c8908-dd48-4d0e-b00d-a34a7699475f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:38.566519 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4b1c8908-dd48-4d0e-b00d-a34a7699475f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:38.573515 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4b1c8908-dd48-4d0e-b00d-a34a7699475f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:38.574199 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4b1c8908-dd48-4d0e-b00d-a34a7699475f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:38.575461 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4b1c8908-dd48-4d0e-b00d-a34a7699475f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:38.575930 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4b1c8908-dd48-4d0e-b00d-a34a7699475f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:38.607762 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4b1c8908-dd48-4d0e-b00d-a34a7699475f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046905 Feb 21 01:25:38.609027 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 766/1507] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:38 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:39.620698 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9db190e6-9ea0-49db-bb01-8cc9e3d5f374 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:39.621512 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9db190e6-9ea0-49db-bb01-8cc9e3d5f374 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:39.627789 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9db190e6-9ea0-49db-bb01-8cc9e3d5f374 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:39.628259 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9db190e6-9ea0-49db-bb01-8cc9e3d5f374 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:39.629028 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9db190e6-9ea0-49db-bb01-8cc9e3d5f374 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:39.629454 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9db190e6-9ea0-49db-bb01-8cc9e3d5f374 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:39.659065 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9db190e6-9ea0-49db-bb01-8cc9e3d5f374 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042243 Feb 21 01:25:39.659600 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 742/1508] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:39 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:40.671222 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0b2f6816-988f-4374-97bb-fda9927c4b0e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:40.672040 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0b2f6816-988f-4374-97bb-fda9927c4b0e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:40.678265 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0b2f6816-988f-4374-97bb-fda9927c4b0e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:40.678717 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0b2f6816-988f-4374-97bb-fda9927c4b0e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:40.679493 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0b2f6816-988f-4374-97bb-fda9927c4b0e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:40.679962 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0b2f6816-988f-4374-97bb-fda9927c4b0e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:40.709079 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0b2f6816-988f-4374-97bb-fda9927c4b0e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041900 Feb 21 01:25:40.709618 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 767/1509] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:40 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:41.721726 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b8dcfe9a-5b2b-4e77-b040-cd4b33df8130 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:41.724304 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b8dcfe9a-5b2b-4e77-b040-cd4b33df8130 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:41.733819 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b8dcfe9a-5b2b-4e77-b040-cd4b33df8130 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:41.734277 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b8dcfe9a-5b2b-4e77-b040-cd4b33df8130 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:41.736919 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b8dcfe9a-5b2b-4e77-b040-cd4b33df8130 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:41.737360 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b8dcfe9a-5b2b-4e77-b040-cd4b33df8130 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:41.767256 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b8dcfe9a-5b2b-4e77-b040-cd4b33df8130 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050363 Feb 21 01:25:41.767805 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 743/1510] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:41 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:42.778740 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-acb2d6d7-01b1-4927-b236-ef6aa8a1838b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:42.779689 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-acb2d6d7-01b1-4927-b236-ef6aa8a1838b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:42.786653 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-acb2d6d7-01b1-4927-b236-ef6aa8a1838b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:42.787100 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-acb2d6d7-01b1-4927-b236-ef6aa8a1838b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:42.787914 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-acb2d6d7-01b1-4927-b236-ef6aa8a1838b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:42.788352 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-acb2d6d7-01b1-4927-b236-ef6aa8a1838b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:42.817695 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-acb2d6d7-01b1-4927-b236-ef6aa8a1838b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042737 Feb 21 01:25:42.818242 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 768/1511] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:42 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:43.829711 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f4dbb829-6ee0-4bd2-8187-f4bf127a602a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:43.830642 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f4dbb829-6ee0-4bd2-8187-f4bf127a602a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:43.836845 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f4dbb829-6ee0-4bd2-8187-f4bf127a602a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:43.837299 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f4dbb829-6ee0-4bd2-8187-f4bf127a602a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:43.838068 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f4dbb829-6ee0-4bd2-8187-f4bf127a602a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:43.838496 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f4dbb829-6ee0-4bd2-8187-f4bf127a602a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:43.866434 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f4dbb829-6ee0-4bd2-8187-f4bf127a602a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041187 Feb 21 01:25:43.867010 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 744/1512] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:43 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:44.878891 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ffa1aeb7-95a0-42e6-b210-ce774740ad49 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:44.879855 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ffa1aeb7-95a0-42e6-b210-ce774740ad49 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:44.886115 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ffa1aeb7-95a0-42e6-b210-ce774740ad49 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:44.886563 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ffa1aeb7-95a0-42e6-b210-ce774740ad49 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:44.887598 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ffa1aeb7-95a0-42e6-b210-ce774740ad49 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:44.888077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ffa1aeb7-95a0-42e6-b210-ce774740ad49 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:44.917033 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ffa1aeb7-95a0-42e6-b210-ce774740ad49 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041985 Feb 21 01:25:44.917581 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 769/1513] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:44 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:45.929494 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-09b2589b-7448-467d-935e-bf4c96d39d68 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:45.930394 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-09b2589b-7448-467d-935e-bf4c96d39d68 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:45.937005 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-09b2589b-7448-467d-935e-bf4c96d39d68 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:45.937453 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-09b2589b-7448-467d-935e-bf4c96d39d68 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:45.938237 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-09b2589b-7448-467d-935e-bf4c96d39d68 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:45.938671 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-09b2589b-7448-467d-935e-bf4c96d39d68 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:45.968524 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-09b2589b-7448-467d-935e-bf4c96d39d68 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042984 Feb 21 01:25:45.969095 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 745/1514] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:45 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:46.980101 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6f3f937c-de7d-47d8-b031-7b8c149bc73a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:46.981020 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6f3f937c-de7d-47d8-b031-7b8c149bc73a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:46.987700 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6f3f937c-de7d-47d8-b031-7b8c149bc73a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:46.988183 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6f3f937c-de7d-47d8-b031-7b8c149bc73a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:46.988965 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6f3f937c-de7d-47d8-b031-7b8c149bc73a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:46.989402 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6f3f937c-de7d-47d8-b031-7b8c149bc73a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:47.018578 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6f3f937c-de7d-47d8-b031-7b8c149bc73a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042333 Feb 21 01:25:47.019122 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 770/1515] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:46 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:48.030577 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0c27e622-d077-4035-b05e-af5d1fb8cded tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:48.031576 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0c27e622-d077-4035-b05e-af5d1fb8cded tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:48.037492 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c27e622-d077-4035-b05e-af5d1fb8cded tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:48.037939 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c27e622-d077-4035-b05e-af5d1fb8cded tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:48.038722 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c27e622-d077-4035-b05e-af5d1fb8cded tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:48.039161 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c27e622-d077-4035-b05e-af5d1fb8cded tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:48.068108 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0c27e622-d077-4035-b05e-af5d1fb8cded tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041833 Feb 21 01:25:48.068664 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 746/1516] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:48 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:49.079759 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-10f3c318-4b26-4f42-9383-68763b58ef54 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:49.080684 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-10f3c318-4b26-4f42-9383-68763b58ef54 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:49.086884 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-10f3c318-4b26-4f42-9383-68763b58ef54 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:49.087325 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-10f3c318-4b26-4f42-9383-68763b58ef54 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:49.088134 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-10f3c318-4b26-4f42-9383-68763b58ef54 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:49.088562 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-10f3c318-4b26-4f42-9383-68763b58ef54 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:49.117562 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-10f3c318-4b26-4f42-9383-68763b58ef54 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041759 Feb 21 01:25:49.118096 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 771/1517] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:49 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:50.129431 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-eefe41de-8f34-4ff2-9072-19ff387b8dfe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:50.130345 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-eefe41de-8f34-4ff2-9072-19ff387b8dfe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:50.136577 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eefe41de-8f34-4ff2-9072-19ff387b8dfe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:50.137275 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eefe41de-8f34-4ff2-9072-19ff387b8dfe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:50.138049 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eefe41de-8f34-4ff2-9072-19ff387b8dfe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:50.138480 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eefe41de-8f34-4ff2-9072-19ff387b8dfe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:50.167111 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-eefe41de-8f34-4ff2-9072-19ff387b8dfe tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041456 Feb 21 01:25:50.167647 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 747/1518] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:50 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:50.805368 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:25:50.805866 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:25:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:25:51.178333 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1739b5ce-7ef8-4878-a037-a5ae14f1d088 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:51.179241 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1739b5ce-7ef8-4878-a037-a5ae14f1d088 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:51.185190 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1739b5ce-7ef8-4878-a037-a5ae14f1d088 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:51.186220 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1739b5ce-7ef8-4878-a037-a5ae14f1d088 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:51.187116 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1739b5ce-7ef8-4878-a037-a5ae14f1d088 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:51.187580 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1739b5ce-7ef8-4878-a037-a5ae14f1d088 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:51.216059 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1739b5ce-7ef8-4878-a037-a5ae14f1d088 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041429 Feb 21 01:25:51.216592 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 772/1519] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:51 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:52.227348 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ece15eeb-2aaa-4124-877d-8330b7d07f13 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:52.228285 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ece15eeb-2aaa-4124-877d-8330b7d07f13 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:52.235110 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ece15eeb-2aaa-4124-877d-8330b7d07f13 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:52.235556 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ece15eeb-2aaa-4124-877d-8330b7d07f13 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:52.236366 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ece15eeb-2aaa-4124-877d-8330b7d07f13 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:52.236798 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ece15eeb-2aaa-4124-877d-8330b7d07f13 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:52.265662 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ece15eeb-2aaa-4124-877d-8330b7d07f13 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041978 Feb 21 01:25:52.266218 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 748/1520] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:52 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:53.276968 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d4cb0037-a949-425f-bcb6-ffa8618f75f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:53.277875 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d4cb0037-a949-425f-bcb6-ffa8618f75f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:53.284099 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d4cb0037-a949-425f-bcb6-ffa8618f75f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:53.284541 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d4cb0037-a949-425f-bcb6-ffa8618f75f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:53.285307 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d4cb0037-a949-425f-bcb6-ffa8618f75f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:53.285733 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d4cb0037-a949-425f-bcb6-ffa8618f75f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:53.314131 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d4cb0037-a949-425f-bcb6-ffa8618f75f5 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040942 Feb 21 01:25:53.314657 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 773/1521] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:53 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:54.325517 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5a3fa317-47e9-4a2a-a3bc-e2a2d521c984 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:54.327526 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5a3fa317-47e9-4a2a-a3bc-e2a2d521c984 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:54.333821 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5a3fa317-47e9-4a2a-a3bc-e2a2d521c984 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:54.334270 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5a3fa317-47e9-4a2a-a3bc-e2a2d521c984 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:54.335049 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5a3fa317-47e9-4a2a-a3bc-e2a2d521c984 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:54.335484 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5a3fa317-47e9-4a2a-a3bc-e2a2d521c984 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:54.365294 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5a3fa317-47e9-4a2a-a3bc-e2a2d521c984 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043527 Feb 21 01:25:54.365851 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 749/1522] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:54 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:55.376809 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-65b0c559-a2b9-4150-b635-d2eebfb1619f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:55.377712 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-65b0c559-a2b9-4150-b635-d2eebfb1619f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:55.383878 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-65b0c559-a2b9-4150-b635-d2eebfb1619f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:55.384317 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-65b0c559-a2b9-4150-b635-d2eebfb1619f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:55.385082 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-65b0c559-a2b9-4150-b635-d2eebfb1619f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:55.385509 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-65b0c559-a2b9-4150-b635-d2eebfb1619f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:55.415150 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-65b0c559-a2b9-4150-b635-d2eebfb1619f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042200 Feb 21 01:25:55.415685 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 774/1523] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:55 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:56.426652 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8d29f50a-7ac4-49b8-978b-a455ff64b2f7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:56.427566 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8d29f50a-7ac4-49b8-978b-a455ff64b2f7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:56.433860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8d29f50a-7ac4-49b8-978b-a455ff64b2f7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:56.434312 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8d29f50a-7ac4-49b8-978b-a455ff64b2f7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:56.435091 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8d29f50a-7ac4-49b8-978b-a455ff64b2f7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:56.436221 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8d29f50a-7ac4-49b8-978b-a455ff64b2f7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:56.465696 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8d29f50a-7ac4-49b8-978b-a455ff64b2f7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042876 Feb 21 01:25:56.466228 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 750/1524] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:56 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:57.477254 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-83c0892e-a4b2-482f-8bfa-cc09dbc15ddd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:57.478152 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-83c0892e-a4b2-482f-8bfa-cc09dbc15ddd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:57.484771 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83c0892e-a4b2-482f-8bfa-cc09dbc15ddd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:57.485228 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83c0892e-a4b2-482f-8bfa-cc09dbc15ddd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:57.486043 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83c0892e-a4b2-482f-8bfa-cc09dbc15ddd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:57.486507 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83c0892e-a4b2-482f-8bfa-cc09dbc15ddd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:57.515463 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-83c0892e-a4b2-482f-8bfa-cc09dbc15ddd tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042049 Feb 21 01:25:57.516025 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 775/1525] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:57 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:58.526723 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ff332846-6915-49cc-b485-bef7353a97b7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:58.527858 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ff332846-6915-49cc-b485-bef7353a97b7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:58.534762 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ff332846-6915-49cc-b485-bef7353a97b7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:58.535204 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ff332846-6915-49cc-b485-bef7353a97b7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:58.536028 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ff332846-6915-49cc-b485-bef7353a97b7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:58.536455 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ff332846-6915-49cc-b485-bef7353a97b7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:58.566487 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ff332846-6915-49cc-b485-bef7353a97b7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043672 Feb 21 01:25:58.567871 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 751/1526] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:58 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:25:59.578191 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-87e2c86e-4758-46e7-914f-a3cdd540f3a2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:59.579096 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-87e2c86e-4758-46e7-914f-a3cdd540f3a2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:25:59.585364 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-87e2c86e-4758-46e7-914f-a3cdd540f3a2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:59.585817 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-87e2c86e-4758-46e7-914f-a3cdd540f3a2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:59.586597 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-87e2c86e-4758-46e7-914f-a3cdd540f3a2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:25:59.587035 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-87e2c86e-4758-46e7-914f-a3cdd540f3a2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:25:59.615785 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-87e2c86e-4758-46e7-914f-a3cdd540f3a2 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042008 Feb 21 01:25:59.616354 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 776/1527] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:25:59 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:26:00.627168 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a7a94ea6-aa74-491b-b5f9-abc29d93a543 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:26:00.628038 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a7a94ea6-aa74-491b-b5f9-abc29d93a543 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:26:00.634243 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a7a94ea6-aa74-491b-b5f9-abc29d93a543 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:26:00.634687 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a7a94ea6-aa74-491b-b5f9-abc29d93a543 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:26:00.635464 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a7a94ea6-aa74-491b-b5f9-abc29d93a543 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:26:00.635921 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a7a94ea6-aa74-491b-b5f9-abc29d93a543 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:26:00.665265 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a7a94ea6-aa74-491b-b5f9-abc29d93a543 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041994 Feb 21 01:26:00.665801 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 752/1528] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Feb 21 01:26:00 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:26:01.676608 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a4c6df3b-94bd-482e-9d69-9f7e45decefa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:26:01.677526 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a4c6df3b-94bd-482e-9d69-9f7e45decefa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:26:01.683717 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a4c6df3b-94bd-482e-9d69-9f7e45decefa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:26:01.684203 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a4c6df3b-94bd-482e-9d69-9f7e45decefa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:26:01.684984 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a4c6df3b-94bd-482e-9d69-9f7e45decefa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:26:01.686190 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a4c6df3b-94bd-482e-9d69-9f7e45decefa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:26:01.709995 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-a4c6df3b-94bd-482e-9d69-9f7e45decefa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] HTTP exception thrown: Instance e2aa103a-4f89-45a6-8c62-09282555e3b3 is not ready Feb 21 01:26:01.710577 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a4c6df3b-94bd-482e-9d69-9f7e45decefa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Returning 409 to user: Instance e2aa103a-4f89-45a6-8c62-09282555e3b3 is not ready {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:26:01.711384 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a4c6df3b-94bd-482e-9d69-9f7e45decefa tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "POST /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/action" status: 409 len: 110 microversion: 2.20 time: 0.038620 Feb 21 01:26:01.712077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 777/1529] 10.222.0.91 () {62 vars in 1318 bytes} [Mon Feb 21 01:26:01 2022] POST /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3/action => generated 110 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 380 bytes (1 switches on core 0) Feb 21 01:26:03.145056 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:26:03.146287 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:26:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:26:04.079801 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:26:04.080344 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:26:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:27:03.180489 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:27:03.181162 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:27:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:27:25.698404 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:27:25.698886 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:27:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:27:30.025450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:27:30.026080 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:27:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:28:16.657070 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed8ac0c0-98e9-45ad-84ab-4c64698ee507] AMQP server on 10.222.0.91:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 21 01:28:16.858651 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ad1ace16-cda3-4397-9f85-27c72cb4e14c tempest-TestShelveInstance-2000146732 tempest-TestShelveInstance-2000146732-project] Action: 'create', calling method: .version_select at 0x7f4acf27d550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1157500470"}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:28:16.873886 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-ad1ace16-cda3-4397-9f85-27c72cb4e14c tempest-TestShelveInstance-2000146732 tempest-TestShelveInstance-2000146732-project] Getting quotas for project 8b8129cff1a0403ea1c6790469938a6e. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:28:16.877697 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-ad1ace16-cda3-4397-9f85-27c72cb4e14c tempest-TestShelveInstance-2000146732 tempest-TestShelveInstance-2000146732-project] Getting quotas for user 6f1e29b663e842c4a8046fafcd20f151 and project 8b8129cff1a0403ea1c6790469938a6e. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:28:17.223740 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-ad1ace16-cda3-4397-9f85-27c72cb4e14c tempest-TestShelveInstance-2000146732 tempest-TestShelveInstance-2000146732-project] Getting quotas for project 8b8129cff1a0403ea1c6790469938a6e. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:28:17.227585 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-ad1ace16-cda3-4397-9f85-27c72cb4e14c tempest-TestShelveInstance-2000146732 tempest-TestShelveInstance-2000146732-project] Getting quotas for user 6f1e29b663e842c4a8046fafcd20f151 and project 8b8129cff1a0403ea1c6790469938a6e. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:28:17.240260 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ad1ace16-cda3-4397-9f85-27c72cb4e14c tempest-TestShelveInstance-2000146732 tempest-TestShelveInstance-2000146732-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.584970 Feb 21 01:28:17.240856 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 753/1530] 10.222.0.91 () {60 vars in 1157 bytes} [Mon Feb 21 01:28:16 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:29:10.814445 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:29:10.814985 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:29:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:29:23.153232 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:29:23.153878 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:29:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:29:24.088163 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:29:24.088807 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:29:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:30:03.896802 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4becaf61-de85-4b7e-87ec-a1bdac4af3e3] AMQP server on 10.222.0.91:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 21 01:30:03.900300 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d5d3b688-a03c-4b0f-a798-340613a64847 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:03.900823 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d5d3b688-a03c-4b0f-a798-340613a64847 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:03.907676 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d5d3b688-a03c-4b0f-a798-340613a64847 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:03.909394 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d5d3b688-a03c-4b0f-a798-340613a64847 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:03.910198 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d5d3b688-a03c-4b0f-a798-340613a64847 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:03.910639 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d5d3b688-a03c-4b0f-a798-340613a64847 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:03.934726 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d5d3b688-a03c-4b0f-a798-340613a64847 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Going to try to terminate instance {{(pid=117139) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:30:04.246382 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d5d3b688-a03c-4b0f-a798-340613a64847 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "DELETE /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 204 len: 0 microversion: 2.1 time: 0.351489 Feb 21 01:30:04.246958 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 778/1531] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Feb 21 01:30:03 2022] DELETE /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:30:04.257196 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f25903a6-4c93-4a06-bf72-f7dbcdd68d76 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:04.257843 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f25903a6-4c93-4a06-bf72-f7dbcdd68d76 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:04.265053 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f25903a6-4c93-4a06-bf72-f7dbcdd68d76 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:04.265501 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f25903a6-4c93-4a06-bf72-f7dbcdd68d76 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:04.266288 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f25903a6-4c93-4a06-bf72-f7dbcdd68d76 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:04.266777 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f25903a6-4c93-4a06-bf72-f7dbcdd68d76 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:04.270976 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed8ac0c0-98e9-45ad-84ab-4c64698ee507] Reconnected to AMQP server on 10.222.0.91:5672 via [amqp] client with port 49130. Feb 21 01:30:04.505654 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f25903a6-4c93-4a06-bf72-f7dbcdd68d76 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:04.513742 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f25903a6-4c93-4a06-bf72-f7dbcdd68d76 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.262490 Feb 21 01:30:04.514515 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 754/1532] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:04 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:05.216743 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f456d3c8-5381-46ae-90fb-ae00d56622bb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] Calling method '.version_select at 0x7f4ace892790>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:05.223342 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f456d3c8-5381-46ae-90fb-ae00d56622bb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [a5dd64f2-f84c-40b3-b52f-28664849fe93] AMQP server on 10.222.0.91:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 21 01:30:05.227952 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] [4becaf61-de85-4b7e-87ec-a1bdac4af3e3] Reconnected to AMQP server on 10.222.0.91:5672 via [amqp] client with port 49152. Feb 21 01:30:05.532021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-16028b42-2b51-4993-8822-5a107f42ed0c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:05.533222 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-16028b42-2b51-4993-8822-5a107f42ed0c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:05.539389 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-16028b42-2b51-4993-8822-5a107f42ed0c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:05.539828 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-16028b42-2b51-4993-8822-5a107f42ed0c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:05.540624 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-16028b42-2b51-4993-8822-5a107f42ed0c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:05.541049 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-16028b42-2b51-4993-8822-5a107f42ed0c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:05.672137 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-16028b42-2b51-4993-8822-5a107f42ed0c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:05.680379 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-16028b42-2b51-4993-8822-5a107f42ed0c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152147 Feb 21 01:30:05.680948 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 755/1533] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:05 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:30:06.228025 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [None req-f456d3c8-5381-46ae-90fb-ae00d56622bb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] [a5dd64f2-f84c-40b3-b52f-28664849fe93] Reconnected to AMQP server on 10.222.0.91:5672 via [amqp] client with port 49172. Feb 21 01:30:06.326978 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f456d3c8-5381-46ae-90fb-ae00d56622bb tempest-TestVolumeBootPattern-1305470809 tempest-TestVolumeBootPattern-1305470809-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-74044564" status: 202 len: 0 microversion: 2.1 time: 1.114161 Feb 21 01:30:06.327551 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 779/1534] 10.222.0.91 () {58 vars in 1256 bytes} [Mon Feb 21 01:30:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-74044564 => generated 0 bytes in 1116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:30:06.697894 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ceef569f-59c3-440b-bec8-dfd4df7abaff tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:06.698498 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ceef569f-59c3-440b-bec8-dfd4df7abaff tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:06.705789 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ceef569f-59c3-440b-bec8-dfd4df7abaff tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:06.706231 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ceef569f-59c3-440b-bec8-dfd4df7abaff tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:06.707057 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ceef569f-59c3-440b-bec8-dfd4df7abaff tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:06.707490 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ceef569f-59c3-440b-bec8-dfd4df7abaff tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:06.852463 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ceef569f-59c3-440b-bec8-dfd4df7abaff tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:06.861182 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ceef569f-59c3-440b-bec8-dfd4df7abaff tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.166420 Feb 21 01:30:06.862408 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 756/1535] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:06 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:07.879990 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-70d564b0-21c9-4d63-89ad-ed62819c1917 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:07.880722 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-70d564b0-21c9-4d63-89ad-ed62819c1917 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:07.886629 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-70d564b0-21c9-4d63-89ad-ed62819c1917 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:07.887821 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-70d564b0-21c9-4d63-89ad-ed62819c1917 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:07.891933 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-70d564b0-21c9-4d63-89ad-ed62819c1917 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:07.891933 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-70d564b0-21c9-4d63-89ad-ed62819c1917 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:08.205662 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-70d564b0-21c9-4d63-89ad-ed62819c1917 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:08.213512 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-70d564b0-21c9-4d63-89ad-ed62819c1917 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.338743 Feb 21 01:30:08.214071 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 780/1536] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:07 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:09.234594 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-658318bc-4c0d-40de-9f71-9c0293502eee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:09.235217 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-658318bc-4c0d-40de-9f71-9c0293502eee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:09.242278 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-658318bc-4c0d-40de-9f71-9c0293502eee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:09.242736 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-658318bc-4c0d-40de-9f71-9c0293502eee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:09.244397 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-658318bc-4c0d-40de-9f71-9c0293502eee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:09.244397 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-658318bc-4c0d-40de-9f71-9c0293502eee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:09.408215 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-658318bc-4c0d-40de-9f71-9c0293502eee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:09.417168 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-658318bc-4c0d-40de-9f71-9c0293502eee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.186368 Feb 21 01:30:09.417742 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 757/1537] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:09 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:10.434561 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-10f167b9-a9e3-48ee-b305-03dcd3a12b9c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:10.435102 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-10f167b9-a9e3-48ee-b305-03dcd3a12b9c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:10.441877 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-10f167b9-a9e3-48ee-b305-03dcd3a12b9c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:10.442316 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-10f167b9-a9e3-48ee-b305-03dcd3a12b9c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:10.443114 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-10f167b9-a9e3-48ee-b305-03dcd3a12b9c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:10.443537 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-10f167b9-a9e3-48ee-b305-03dcd3a12b9c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:10.620081 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-10f167b9-a9e3-48ee-b305-03dcd3a12b9c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:10.629587 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-10f167b9-a9e3-48ee-b305-03dcd3a12b9c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.198886 Feb 21 01:30:10.639554 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 781/1538] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:10 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:11.647795 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-459d8ad8-e225-4c25-924b-132ecd6ee0cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:11.648570 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-459d8ad8-e225-4c25-924b-132ecd6ee0cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:11.655102 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-459d8ad8-e225-4c25-924b-132ecd6ee0cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:11.655557 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-459d8ad8-e225-4c25-924b-132ecd6ee0cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:11.656382 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-459d8ad8-e225-4c25-924b-132ecd6ee0cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:11.656820 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-459d8ad8-e225-4c25-924b-132ecd6ee0cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:11.804285 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-459d8ad8-e225-4c25-924b-132ecd6ee0cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:11.813285 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-459d8ad8-e225-4c25-924b-132ecd6ee0cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.169370 Feb 21 01:30:11.815287 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 758/1539] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:11 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:12.832209 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-bd17a77a-988e-40ce-99df-e5ff9b57d68e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:12.832985 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-bd17a77a-988e-40ce-99df-e5ff9b57d68e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:12.839968 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bd17a77a-988e-40ce-99df-e5ff9b57d68e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:12.840948 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bd17a77a-988e-40ce-99df-e5ff9b57d68e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:12.841849 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bd17a77a-988e-40ce-99df-e5ff9b57d68e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:12.842360 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bd17a77a-988e-40ce-99df-e5ff9b57d68e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:13.274961 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-bd17a77a-988e-40ce-99df-e5ff9b57d68e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:13.284289 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-bd17a77a-988e-40ce-99df-e5ff9b57d68e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.457234 Feb 21 01:30:13.284923 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 782/1540] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:12 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:14.301752 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b199ef39-8ff8-4624-a0d5-e939bc32db01 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:14.302990 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b199ef39-8ff8-4624-a0d5-e939bc32db01 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:14.309367 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b199ef39-8ff8-4624-a0d5-e939bc32db01 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:14.309809 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b199ef39-8ff8-4624-a0d5-e939bc32db01 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:14.310584 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b199ef39-8ff8-4624-a0d5-e939bc32db01 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:14.311146 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b199ef39-8ff8-4624-a0d5-e939bc32db01 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:14.459716 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b199ef39-8ff8-4624-a0d5-e939bc32db01 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:14.478220 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b199ef39-8ff8-4624-a0d5-e939bc32db01 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.180776 Feb 21 01:30:14.478802 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 759/1541] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:14 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:15.495660 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ecc7dc34-51ba-4282-87e5-d994ae5617c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:15.496310 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ecc7dc34-51ba-4282-87e5-d994ae5617c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:15.503711 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ecc7dc34-51ba-4282-87e5-d994ae5617c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:15.504195 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ecc7dc34-51ba-4282-87e5-d994ae5617c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:15.505024 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ecc7dc34-51ba-4282-87e5-d994ae5617c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:15.505465 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ecc7dc34-51ba-4282-87e5-d994ae5617c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:15.645825 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ecc7dc34-51ba-4282-87e5-d994ae5617c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:15.653590 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ecc7dc34-51ba-4282-87e5-d994ae5617c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.161594 Feb 21 01:30:15.654274 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 783/1542] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:15 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:16.670477 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1e8e4045-7d80-48d1-a6b3-36bdde972142 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:16.671022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1e8e4045-7d80-48d1-a6b3-36bdde972142 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:16.677439 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1e8e4045-7d80-48d1-a6b3-36bdde972142 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:16.677886 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1e8e4045-7d80-48d1-a6b3-36bdde972142 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:16.678666 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1e8e4045-7d80-48d1-a6b3-36bdde972142 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:16.679098 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1e8e4045-7d80-48d1-a6b3-36bdde972142 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:16.808809 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1e8e4045-7d80-48d1-a6b3-36bdde972142 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:16.816479 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1e8e4045-7d80-48d1-a6b3-36bdde972142 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.149688 Feb 21 01:30:16.817039 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 760/1543] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:16 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:17.833709 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9dcb324b-3402-46ca-8fe9-ab1ff92576cd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:17.834321 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9dcb324b-3402-46ca-8fe9-ab1ff92576cd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:17.840315 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9dcb324b-3402-46ca-8fe9-ab1ff92576cd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:17.840758 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9dcb324b-3402-46ca-8fe9-ab1ff92576cd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:17.841540 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9dcb324b-3402-46ca-8fe9-ab1ff92576cd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:17.841969 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9dcb324b-3402-46ca-8fe9-ab1ff92576cd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:17.974364 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9dcb324b-3402-46ca-8fe9-ab1ff92576cd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:17.982128 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9dcb324b-3402-46ca-8fe9-ab1ff92576cd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.153356 Feb 21 01:30:17.982683 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 784/1544] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:17 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:18.998998 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-dee8b22a-51ca-438c-818d-6551515561ca tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:18.999638 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-dee8b22a-51ca-438c-818d-6551515561ca tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:19.007706 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dee8b22a-51ca-438c-818d-6551515561ca tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:19.008178 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dee8b22a-51ca-438c-818d-6551515561ca tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:19.008958 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dee8b22a-51ca-438c-818d-6551515561ca tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:19.009386 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dee8b22a-51ca-438c-818d-6551515561ca tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:19.147891 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-dee8b22a-51ca-438c-818d-6551515561ca tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:19.155518 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-dee8b22a-51ca-438c-818d-6551515561ca tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.160136 Feb 21 01:30:19.156108 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 761/1545] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:18 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:20.172721 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3a16aed5-e810-4503-a944-5897947bc0c3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:20.173651 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3a16aed5-e810-4503-a944-5897947bc0c3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:20.180026 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3a16aed5-e810-4503-a944-5897947bc0c3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:20.180479 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3a16aed5-e810-4503-a944-5897947bc0c3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:20.181262 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3a16aed5-e810-4503-a944-5897947bc0c3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:20.181705 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3a16aed5-e810-4503-a944-5897947bc0c3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:20.316458 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3a16aed5-e810-4503-a944-5897947bc0c3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:20.324249 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3a16aed5-e810-4503-a944-5897947bc0c3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155182 Feb 21 01:30:20.324813 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 785/1546] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:20 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:21.340856 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-33cf906d-bf51-49b3-a3c2-51f9e7714dab tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:21.341470 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-33cf906d-bf51-49b3-a3c2-51f9e7714dab tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:21.347597 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-33cf906d-bf51-49b3-a3c2-51f9e7714dab tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:21.348074 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-33cf906d-bf51-49b3-a3c2-51f9e7714dab tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:21.348849 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-33cf906d-bf51-49b3-a3c2-51f9e7714dab tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:21.349273 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-33cf906d-bf51-49b3-a3c2-51f9e7714dab tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:21.487000 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-33cf906d-bf51-49b3-a3c2-51f9e7714dab tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:21.494935 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-33cf906d-bf51-49b3-a3c2-51f9e7714dab tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.157907 Feb 21 01:30:21.495493 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 762/1547] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:21 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:22.513569 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0fd0abf1-5fbc-47e5-9fba-bac848db869b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:22.514184 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0fd0abf1-5fbc-47e5-9fba-bac848db869b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:22.520506 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0fd0abf1-5fbc-47e5-9fba-bac848db869b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:22.520943 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0fd0abf1-5fbc-47e5-9fba-bac848db869b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:22.521727 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0fd0abf1-5fbc-47e5-9fba-bac848db869b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:22.522154 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0fd0abf1-5fbc-47e5-9fba-bac848db869b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:22.655387 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0fd0abf1-5fbc-47e5-9fba-bac848db869b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:22.663044 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0fd0abf1-5fbc-47e5-9fba-bac848db869b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.153964 Feb 21 01:30:22.663595 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 786/1548] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:22 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:23.680223 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-dad86888-9529-4a09-a000-c90d946b5e40 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:23.680768 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-dad86888-9529-4a09-a000-c90d946b5e40 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:23.686886 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dad86888-9529-4a09-a000-c90d946b5e40 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:23.687335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dad86888-9529-4a09-a000-c90d946b5e40 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:23.688673 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dad86888-9529-4a09-a000-c90d946b5e40 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:23.689201 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dad86888-9529-4a09-a000-c90d946b5e40 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:23.818667 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-dad86888-9529-4a09-a000-c90d946b5e40 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:23.826493 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-dad86888-9529-4a09-a000-c90d946b5e40 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.149995 Feb 21 01:30:23.827052 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 763/1549] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:23 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:24.845842 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-529f8fae-2b7b-4b39-acec-4a6fb4aabb85 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:24.846456 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-529f8fae-2b7b-4b39-acec-4a6fb4aabb85 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:24.852867 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-529f8fae-2b7b-4b39-acec-4a6fb4aabb85 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:24.853313 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-529f8fae-2b7b-4b39-acec-4a6fb4aabb85 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:24.854095 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-529f8fae-2b7b-4b39-acec-4a6fb4aabb85 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:24.854527 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-529f8fae-2b7b-4b39-acec-4a6fb4aabb85 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:24.987564 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-529f8fae-2b7b-4b39-acec-4a6fb4aabb85 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:24.995498 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-529f8fae-2b7b-4b39-acec-4a6fb4aabb85 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155431 Feb 21 01:30:24.996101 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 787/1550] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:24 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:26.012484 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8ff33323-9dd2-45a4-8437-08753888605b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:26.013098 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8ff33323-9dd2-45a4-8437-08753888605b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:26.019812 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8ff33323-9dd2-45a4-8437-08753888605b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:26.020297 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8ff33323-9dd2-45a4-8437-08753888605b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:26.021078 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8ff33323-9dd2-45a4-8437-08753888605b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:26.021507 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8ff33323-9dd2-45a4-8437-08753888605b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:26.160348 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8ff33323-9dd2-45a4-8437-08753888605b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:26.168125 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8ff33323-9dd2-45a4-8437-08753888605b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.159282 Feb 21 01:30:26.168684 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 764/1551] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:26 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:27.185465 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-843171b5-d2dc-4589-9dca-91484fbbd0a6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:27.186076 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-843171b5-d2dc-4589-9dca-91484fbbd0a6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:27.192617 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-843171b5-d2dc-4589-9dca-91484fbbd0a6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:27.193067 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-843171b5-d2dc-4589-9dca-91484fbbd0a6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:27.193849 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-843171b5-d2dc-4589-9dca-91484fbbd0a6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:27.194285 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-843171b5-d2dc-4589-9dca-91484fbbd0a6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:27.329556 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-843171b5-d2dc-4589-9dca-91484fbbd0a6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:27.337419 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-843171b5-d2dc-4589-9dca-91484fbbd0a6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155615 Feb 21 01:30:27.337972 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 788/1552] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:27 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:28.354522 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-528dee1c-515c-457f-a66e-f2b3ff9ca14d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:28.355133 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-528dee1c-515c-457f-a66e-f2b3ff9ca14d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:28.362458 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-528dee1c-515c-457f-a66e-f2b3ff9ca14d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:28.362903 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-528dee1c-515c-457f-a66e-f2b3ff9ca14d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:28.363683 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-528dee1c-515c-457f-a66e-f2b3ff9ca14d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:28.364190 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-528dee1c-515c-457f-a66e-f2b3ff9ca14d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:28.495478 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-528dee1c-515c-457f-a66e-f2b3ff9ca14d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:28.503995 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-528dee1c-515c-457f-a66e-f2b3ff9ca14d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.153125 Feb 21 01:30:28.504555 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 765/1553] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:28 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:29.520584 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e8fdab65-c601-4fd1-af41-1bc1fc9fca60 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:29.521192 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e8fdab65-c601-4fd1-af41-1bc1fc9fca60 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:29.527443 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e8fdab65-c601-4fd1-af41-1bc1fc9fca60 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:29.527916 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e8fdab65-c601-4fd1-af41-1bc1fc9fca60 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:29.528697 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e8fdab65-c601-4fd1-af41-1bc1fc9fca60 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:29.529128 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e8fdab65-c601-4fd1-af41-1bc1fc9fca60 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:29.664028 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e8fdab65-c601-4fd1-af41-1bc1fc9fca60 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:29.671788 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e8fdab65-c601-4fd1-af41-1bc1fc9fca60 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154843 Feb 21 01:30:29.672925 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 789/1554] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:29 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:30.689865 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6473ec1e-c71a-4fdc-8da0-d932c79cd1ac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:30.690479 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6473ec1e-c71a-4fdc-8da0-d932c79cd1ac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:30.697417 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6473ec1e-c71a-4fdc-8da0-d932c79cd1ac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:30.697960 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6473ec1e-c71a-4fdc-8da0-d932c79cd1ac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:30.698839 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6473ec1e-c71a-4fdc-8da0-d932c79cd1ac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:30.699355 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6473ec1e-c71a-4fdc-8da0-d932c79cd1ac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:30.837831 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6473ec1e-c71a-4fdc-8da0-d932c79cd1ac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:30.847102 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6473ec1e-c71a-4fdc-8da0-d932c79cd1ac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.161740 Feb 21 01:30:30.847695 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 766/1555] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:30 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:31.878497 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-346c6d25-6c1a-45ba-a103-562554a41ef3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:31.878497 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-346c6d25-6c1a-45ba-a103-562554a41ef3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:31.878497 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-346c6d25-6c1a-45ba-a103-562554a41ef3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:31.879130 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-346c6d25-6c1a-45ba-a103-562554a41ef3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:31.879470 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-346c6d25-6c1a-45ba-a103-562554a41ef3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:31.880002 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-346c6d25-6c1a-45ba-a103-562554a41ef3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:32.020437 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-346c6d25-6c1a-45ba-a103-562554a41ef3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:32.028359 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-346c6d25-6c1a-45ba-a103-562554a41ef3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.163607 Feb 21 01:30:32.029265 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 790/1556] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:31 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:33.045831 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0f8f3f58-41a9-4f64-ab3c-09e9a4d50eb2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:33.046491 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0f8f3f58-41a9-4f64-ab3c-09e9a4d50eb2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:33.055203 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0f8f3f58-41a9-4f64-ab3c-09e9a4d50eb2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:33.055639 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0f8f3f58-41a9-4f64-ab3c-09e9a4d50eb2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:33.056470 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0f8f3f58-41a9-4f64-ab3c-09e9a4d50eb2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:33.056888 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0f8f3f58-41a9-4f64-ab3c-09e9a4d50eb2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:33.197970 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0f8f3f58-41a9-4f64-ab3c-09e9a4d50eb2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:33.206484 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0f8f3f58-41a9-4f64-ab3c-09e9a4d50eb2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.164299 Feb 21 01:30:33.207364 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 767/1557] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:33 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:34.223040 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-98138174-303f-46ad-b392-791a57c4f4a3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:34.224316 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-98138174-303f-46ad-b392-791a57c4f4a3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:34.233665 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-98138174-303f-46ad-b392-791a57c4f4a3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:34.234108 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-98138174-303f-46ad-b392-791a57c4f4a3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:34.235464 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-98138174-303f-46ad-b392-791a57c4f4a3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:34.235918 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-98138174-303f-46ad-b392-791a57c4f4a3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:34.380874 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-98138174-303f-46ad-b392-791a57c4f4a3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:34.388901 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-98138174-303f-46ad-b392-791a57c4f4a3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.170294 Feb 21 01:30:34.389509 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 791/1558] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:34 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:35.405646 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-588d94ab-926d-4529-962e-0ff811686657 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:35.406408 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-588d94ab-926d-4529-962e-0ff811686657 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:35.412645 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-588d94ab-926d-4529-962e-0ff811686657 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:35.413094 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-588d94ab-926d-4529-962e-0ff811686657 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:35.413884 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-588d94ab-926d-4529-962e-0ff811686657 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:35.414313 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-588d94ab-926d-4529-962e-0ff811686657 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:35.550964 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-588d94ab-926d-4529-962e-0ff811686657 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:35.558963 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-588d94ab-926d-4529-962e-0ff811686657 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.157314 Feb 21 01:30:35.559529 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 768/1559] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:35 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:36.576154 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1cea8f88-749f-4670-b1bf-9106d2e1fc6a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:36.576692 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1cea8f88-749f-4670-b1bf-9106d2e1fc6a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:36.582757 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1cea8f88-749f-4670-b1bf-9106d2e1fc6a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:36.583196 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1cea8f88-749f-4670-b1bf-9106d2e1fc6a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:36.584062 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1cea8f88-749f-4670-b1bf-9106d2e1fc6a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:36.584488 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1cea8f88-749f-4670-b1bf-9106d2e1fc6a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:36.724150 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1cea8f88-749f-4670-b1bf-9106d2e1fc6a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:36.732737 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1cea8f88-749f-4670-b1bf-9106d2e1fc6a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.160494 Feb 21 01:30:36.733704 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 792/1560] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:36 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:37.750123 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9c854c7e-dc6e-48c5-b7d4-92fece5598f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:37.751093 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9c854c7e-dc6e-48c5-b7d4-92fece5598f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:37.757642 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9c854c7e-dc6e-48c5-b7d4-92fece5598f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:37.758096 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9c854c7e-dc6e-48c5-b7d4-92fece5598f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:37.758876 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9c854c7e-dc6e-48c5-b7d4-92fece5598f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:37.759343 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9c854c7e-dc6e-48c5-b7d4-92fece5598f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:37.908287 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9c854c7e-dc6e-48c5-b7d4-92fece5598f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:37.917156 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9c854c7e-dc6e-48c5-b7d4-92fece5598f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.170734 Feb 21 01:30:37.918958 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 769/1561] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:37 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:38.934525 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-337ec141-c19d-4286-b878-d1008037935c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:38.935134 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-337ec141-c19d-4286-b878-d1008037935c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:38.941992 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-337ec141-c19d-4286-b878-d1008037935c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:38.942440 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-337ec141-c19d-4286-b878-d1008037935c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:38.943220 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-337ec141-c19d-4286-b878-d1008037935c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:38.943652 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-337ec141-c19d-4286-b878-d1008037935c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:39.080117 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-337ec141-c19d-4286-b878-d1008037935c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:39.087675 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-337ec141-c19d-4286-b878-d1008037935c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.156935 Feb 21 01:30:39.088272 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 793/1562] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:38 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:40.104427 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8646b2c6-6995-4ad0-a83b-d10fe1e81962 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:40.104987 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8646b2c6-6995-4ad0-a83b-d10fe1e81962 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:40.111231 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8646b2c6-6995-4ad0-a83b-d10fe1e81962 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:40.111679 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8646b2c6-6995-4ad0-a83b-d10fe1e81962 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:40.112486 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8646b2c6-6995-4ad0-a83b-d10fe1e81962 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:40.112921 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8646b2c6-6995-4ad0-a83b-d10fe1e81962 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:40.248329 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8646b2c6-6995-4ad0-a83b-d10fe1e81962 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:40.257798 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8646b2c6-6995-4ad0-a83b-d10fe1e81962 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.156984 Feb 21 01:30:40.258396 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 770/1563] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:40 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:41.275700 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1b681e37-ebec-4016-aec5-feaa9a7eca23 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:41.276346 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1b681e37-ebec-4016-aec5-feaa9a7eca23 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:41.283387 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1b681e37-ebec-4016-aec5-feaa9a7eca23 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:41.283866 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1b681e37-ebec-4016-aec5-feaa9a7eca23 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:41.284545 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1b681e37-ebec-4016-aec5-feaa9a7eca23 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:41.284969 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1b681e37-ebec-4016-aec5-feaa9a7eca23 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:41.418430 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1b681e37-ebec-4016-aec5-feaa9a7eca23 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:41.426395 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1b681e37-ebec-4016-aec5-feaa9a7eca23 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154305 Feb 21 01:30:41.426980 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 794/1564] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:41 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:42.444241 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7b622b86-0895-4ae5-be71-696f6b0ceb18 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:42.444838 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7b622b86-0895-4ae5-be71-696f6b0ceb18 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:42.450539 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7b622b86-0895-4ae5-be71-696f6b0ceb18 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:42.451176 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7b622b86-0895-4ae5-be71-696f6b0ceb18 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:42.452013 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7b622b86-0895-4ae5-be71-696f6b0ceb18 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:42.452752 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7b622b86-0895-4ae5-be71-696f6b0ceb18 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:42.592664 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7b622b86-0895-4ae5-be71-696f6b0ceb18 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:42.601096 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7b622b86-0895-4ae5-be71-696f6b0ceb18 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.161088 Feb 21 01:30:42.601719 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 771/1565] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:42 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:43.617963 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-be607dc0-f29f-4d42-8a52-0feab3da6ae2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:43.618569 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-be607dc0-f29f-4d42-8a52-0feab3da6ae2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:43.624769 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-be607dc0-f29f-4d42-8a52-0feab3da6ae2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:43.625217 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-be607dc0-f29f-4d42-8a52-0feab3da6ae2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:43.626338 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-be607dc0-f29f-4d42-8a52-0feab3da6ae2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:43.626771 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-be607dc0-f29f-4d42-8a52-0feab3da6ae2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:43.763576 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-be607dc0-f29f-4d42-8a52-0feab3da6ae2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:43.772086 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-be607dc0-f29f-4d42-8a52-0feab3da6ae2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.157725 Feb 21 01:30:43.772644 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 795/1566] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:43 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:44.788849 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-51d743e7-b44d-4cc5-a644-c8f0f1ecad13 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:44.789492 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-51d743e7-b44d-4cc5-a644-c8f0f1ecad13 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:44.795606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51d743e7-b44d-4cc5-a644-c8f0f1ecad13 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:44.796077 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51d743e7-b44d-4cc5-a644-c8f0f1ecad13 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:44.796843 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51d743e7-b44d-4cc5-a644-c8f0f1ecad13 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:44.797268 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51d743e7-b44d-4cc5-a644-c8f0f1ecad13 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:44.929943 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-51d743e7-b44d-4cc5-a644-c8f0f1ecad13 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:44.937538 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-51d743e7-b44d-4cc5-a644-c8f0f1ecad13 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152306 Feb 21 01:30:44.938097 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 772/1567] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:44 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:45.706758 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:30:45.707092 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:30:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:30:45.953851 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2fd6c8ce-28a9-464b-aad4-5011ee09ab08 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:45.954863 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2fd6c8ce-28a9-464b-aad4-5011ee09ab08 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:45.961060 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2fd6c8ce-28a9-464b-aad4-5011ee09ab08 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:45.961509 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2fd6c8ce-28a9-464b-aad4-5011ee09ab08 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:45.962488 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2fd6c8ce-28a9-464b-aad4-5011ee09ab08 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:45.962919 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2fd6c8ce-28a9-464b-aad4-5011ee09ab08 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:46.096895 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2fd6c8ce-28a9-464b-aad4-5011ee09ab08 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:46.104579 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2fd6c8ce-28a9-464b-aad4-5011ee09ab08 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154515 Feb 21 01:30:46.105148 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 796/1568] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:45 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:47.122131 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-365d3afa-4da1-4006-be9a-23f596f0052c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:47.122770 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-365d3afa-4da1-4006-be9a-23f596f0052c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:47.130011 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-365d3afa-4da1-4006-be9a-23f596f0052c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:47.130450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-365d3afa-4da1-4006-be9a-23f596f0052c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:47.131219 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-365d3afa-4da1-4006-be9a-23f596f0052c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:47.131653 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-365d3afa-4da1-4006-be9a-23f596f0052c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:47.264335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-365d3afa-4da1-4006-be9a-23f596f0052c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:47.272469 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-365d3afa-4da1-4006-be9a-23f596f0052c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.153917 Feb 21 01:30:47.273046 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 773/1569] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:47 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:48.289640 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a37be8cf-e135-488d-838e-09d5653cf64e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:48.290238 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a37be8cf-e135-488d-838e-09d5653cf64e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:48.296638 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a37be8cf-e135-488d-838e-09d5653cf64e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:48.297022 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a37be8cf-e135-488d-838e-09d5653cf64e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:48.298414 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a37be8cf-e135-488d-838e-09d5653cf64e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:48.298846 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a37be8cf-e135-488d-838e-09d5653cf64e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:48.431000 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a37be8cf-e135-488d-838e-09d5653cf64e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:48.438989 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a37be8cf-e135-488d-838e-09d5653cf64e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.153005 Feb 21 01:30:48.439619 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 797/1570] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:48 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:49.455777 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1cc5b777-0eac-4cad-95da-6fda77035d3e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:49.456404 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1cc5b777-0eac-4cad-95da-6fda77035d3e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:49.462499 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1cc5b777-0eac-4cad-95da-6fda77035d3e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:49.462944 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1cc5b777-0eac-4cad-95da-6fda77035d3e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:49.463723 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1cc5b777-0eac-4cad-95da-6fda77035d3e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:49.464175 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1cc5b777-0eac-4cad-95da-6fda77035d3e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:49.599950 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1cc5b777-0eac-4cad-95da-6fda77035d3e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:49.608472 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1cc5b777-0eac-4cad-95da-6fda77035d3e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.156452 Feb 21 01:30:49.609453 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 774/1571] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:49 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:50.033648 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:30:50.033848 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:30:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:30:50.628655 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-107f472a-ffb4-428f-a0ba-2589e0086d4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:50.629202 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-107f472a-ffb4-428f-a0ba-2589e0086d4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:50.635372 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-107f472a-ffb4-428f-a0ba-2589e0086d4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:50.635820 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-107f472a-ffb4-428f-a0ba-2589e0086d4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:50.636623 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-107f472a-ffb4-428f-a0ba-2589e0086d4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:50.637055 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-107f472a-ffb4-428f-a0ba-2589e0086d4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:50.775884 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-107f472a-ffb4-428f-a0ba-2589e0086d4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:50.781780 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-107f472a-ffb4-428f-a0ba-2589e0086d4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.157627 Feb 21 01:30:50.782435 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 798/1572] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:50 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:51.798572 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-542567cb-af22-438b-8bc9-2787e9ed2225 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:51.799174 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-542567cb-af22-438b-8bc9-2787e9ed2225 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:51.805420 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-542567cb-af22-438b-8bc9-2787e9ed2225 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:51.805871 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-542567cb-af22-438b-8bc9-2787e9ed2225 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:51.806655 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-542567cb-af22-438b-8bc9-2787e9ed2225 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:51.807206 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-542567cb-af22-438b-8bc9-2787e9ed2225 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:51.937169 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-542567cb-af22-438b-8bc9-2787e9ed2225 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:51.945621 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-542567cb-af22-438b-8bc9-2787e9ed2225 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151203 Feb 21 01:30:51.946171 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 775/1573] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:51 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:52.962227 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9d754843-1135-4c2a-b1c8-2f235c4be942 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:52.962816 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9d754843-1135-4c2a-b1c8-2f235c4be942 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:52.968995 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d754843-1135-4c2a-b1c8-2f235c4be942 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:52.969479 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d754843-1135-4c2a-b1c8-2f235c4be942 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:52.970244 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d754843-1135-4c2a-b1c8-2f235c4be942 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:52.970666 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d754843-1135-4c2a-b1c8-2f235c4be942 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:53.101437 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9d754843-1135-4c2a-b1c8-2f235c4be942 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:53.109134 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9d754843-1135-4c2a-b1c8-2f235c4be942 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.150481 Feb 21 01:30:53.109660 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 799/1574] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:52 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:54.126771 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fe19b628-c30d-487e-bc66-c59149591196 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:54.127382 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fe19b628-c30d-487e-bc66-c59149591196 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:54.133599 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe19b628-c30d-487e-bc66-c59149591196 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:54.134051 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe19b628-c30d-487e-bc66-c59149591196 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:54.134828 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe19b628-c30d-487e-bc66-c59149591196 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:54.135261 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe19b628-c30d-487e-bc66-c59149591196 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:54.268853 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fe19b628-c30d-487e-bc66-c59149591196 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:54.276433 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fe19b628-c30d-487e-bc66-c59149591196 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.153612 Feb 21 01:30:54.276987 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 776/1575] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:54 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:55.293484 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2fb5ea66-a3f6-4567-8f43-5a4d0afe0702 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:55.294178 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2fb5ea66-a3f6-4567-8f43-5a4d0afe0702 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:55.301087 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2fb5ea66-a3f6-4567-8f43-5a4d0afe0702 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:55.301540 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2fb5ea66-a3f6-4567-8f43-5a4d0afe0702 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:55.302322 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2fb5ea66-a3f6-4567-8f43-5a4d0afe0702 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:55.302760 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2fb5ea66-a3f6-4567-8f43-5a4d0afe0702 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:55.438641 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2fb5ea66-a3f6-4567-8f43-5a4d0afe0702 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:55.446341 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2fb5ea66-a3f6-4567-8f43-5a4d0afe0702 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.156573 Feb 21 01:30:55.446897 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 800/1576] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:55 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:56.463957 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a5da73a8-64ee-4158-ad94-4ef9ad457c3c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:56.464569 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a5da73a8-64ee-4158-ad94-4ef9ad457c3c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:56.471263 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a5da73a8-64ee-4158-ad94-4ef9ad457c3c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:56.471742 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a5da73a8-64ee-4158-ad94-4ef9ad457c3c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:56.472552 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a5da73a8-64ee-4158-ad94-4ef9ad457c3c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:56.472984 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a5da73a8-64ee-4158-ad94-4ef9ad457c3c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:56.607105 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a5da73a8-64ee-4158-ad94-4ef9ad457c3c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:56.615995 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a5da73a8-64ee-4158-ad94-4ef9ad457c3c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155681 Feb 21 01:30:56.616620 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 777/1577] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:56 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:57.632628 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-bf2741d2-d071-48d8-a5a3-c34a893edcf4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:57.633211 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-bf2741d2-d071-48d8-a5a3-c34a893edcf4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:57.639285 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bf2741d2-d071-48d8-a5a3-c34a893edcf4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:57.639726 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bf2741d2-d071-48d8-a5a3-c34a893edcf4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:57.640526 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bf2741d2-d071-48d8-a5a3-c34a893edcf4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:57.641611 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bf2741d2-d071-48d8-a5a3-c34a893edcf4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:57.771562 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-bf2741d2-d071-48d8-a5a3-c34a893edcf4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:57.779324 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-bf2741d2-d071-48d8-a5a3-c34a893edcf4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.150327 Feb 21 01:30:57.779906 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 801/1578] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:57 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:58.796322 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-12ffa824-1f1c-4100-86de-f4408bb71983 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:58.797006 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-12ffa824-1f1c-4100-86de-f4408bb71983 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:58.803139 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-12ffa824-1f1c-4100-86de-f4408bb71983 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:58.803589 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-12ffa824-1f1c-4100-86de-f4408bb71983 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:58.804414 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-12ffa824-1f1c-4100-86de-f4408bb71983 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:58.804851 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-12ffa824-1f1c-4100-86de-f4408bb71983 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:58.934015 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-12ffa824-1f1c-4100-86de-f4408bb71983 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:30:58.942342 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-12ffa824-1f1c-4100-86de-f4408bb71983 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.149691 Feb 21 01:30:58.942898 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 778/1579] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:58 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:30:59.959813 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-260a432d-6756-4824-9d23-627e4cfb5865 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:59.960450 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-260a432d-6756-4824-9d23-627e4cfb5865 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:30:59.966683 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-260a432d-6756-4824-9d23-627e4cfb5865 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:59.967126 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-260a432d-6756-4824-9d23-627e4cfb5865 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:59.967936 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-260a432d-6756-4824-9d23-627e4cfb5865 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:59.968430 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-260a432d-6756-4824-9d23-627e4cfb5865 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:00.098911 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-260a432d-6756-4824-9d23-627e4cfb5865 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:00.106588 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-260a432d-6756-4824-9d23-627e4cfb5865 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.150495 Feb 21 01:31:00.107148 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 802/1580] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:30:59 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:01.123498 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8fa501bb-3af1-4303-8645-fb8c7509f4bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:01.124116 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8fa501bb-3af1-4303-8645-fb8c7509f4bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:01.131338 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8fa501bb-3af1-4303-8645-fb8c7509f4bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:01.131787 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8fa501bb-3af1-4303-8645-fb8c7509f4bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:01.132601 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8fa501bb-3af1-4303-8645-fb8c7509f4bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:01.133033 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8fa501bb-3af1-4303-8645-fb8c7509f4bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:01.270901 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8fa501bb-3af1-4303-8645-fb8c7509f4bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:01.276083 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8fa501bb-3af1-4303-8645-fb8c7509f4bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.156287 Feb 21 01:31:01.276751 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 779/1581] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:01 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:02.291513 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-260ae390-a3ba-43e0-8a0d-57a12313f45d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:02.292202 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-260ae390-a3ba-43e0-8a0d-57a12313f45d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:02.298705 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-260ae390-a3ba-43e0-8a0d-57a12313f45d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:02.299151 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-260ae390-a3ba-43e0-8a0d-57a12313f45d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:02.299962 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-260ae390-a3ba-43e0-8a0d-57a12313f45d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:02.300403 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-260ae390-a3ba-43e0-8a0d-57a12313f45d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:02.440766 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-260ae390-a3ba-43e0-8a0d-57a12313f45d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:02.448641 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-260ae390-a3ba-43e0-8a0d-57a12313f45d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.160714 Feb 21 01:31:02.449209 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 803/1582] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:02 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:03.465989 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4afe4211-aff6-4221-ba22-2d693ca3b1d1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:03.466588 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4afe4211-aff6-4221-ba22-2d693ca3b1d1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:03.473665 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4afe4211-aff6-4221-ba22-2d693ca3b1d1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:03.474102 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4afe4211-aff6-4221-ba22-2d693ca3b1d1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:03.474872 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4afe4211-aff6-4221-ba22-2d693ca3b1d1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:03.475298 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4afe4211-aff6-4221-ba22-2d693ca3b1d1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:03.608036 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4afe4211-aff6-4221-ba22-2d693ca3b1d1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:03.616402 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4afe4211-aff6-4221-ba22-2d693ca3b1d1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154138 Feb 21 01:31:03.616956 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 780/1583] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:03 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:04.633372 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-384f52d6-87f3-4d14-80ad-6a926ce76cae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:04.634181 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-384f52d6-87f3-4d14-80ad-6a926ce76cae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:04.640544 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-384f52d6-87f3-4d14-80ad-6a926ce76cae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:04.641062 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-384f52d6-87f3-4d14-80ad-6a926ce76cae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:04.641916 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-384f52d6-87f3-4d14-80ad-6a926ce76cae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:04.642478 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-384f52d6-87f3-4d14-80ad-6a926ce76cae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:04.788655 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-384f52d6-87f3-4d14-80ad-6a926ce76cae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:04.796489 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-384f52d6-87f3-4d14-80ad-6a926ce76cae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.166680 Feb 21 01:31:04.798282 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 804/1584] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:04 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:05.815288 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1a51d49e-b6e6-4e83-b133-fd0013654099 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:05.816092 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1a51d49e-b6e6-4e83-b133-fd0013654099 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:05.824375 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1a51d49e-b6e6-4e83-b133-fd0013654099 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:05.824375 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1a51d49e-b6e6-4e83-b133-fd0013654099 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:05.824375 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1a51d49e-b6e6-4e83-b133-fd0013654099 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:05.824375 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1a51d49e-b6e6-4e83-b133-fd0013654099 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:05.958660 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1a51d49e-b6e6-4e83-b133-fd0013654099 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:05.966579 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1a51d49e-b6e6-4e83-b133-fd0013654099 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155753 Feb 21 01:31:05.967217 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 781/1585] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:05 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:06.983602 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-43fdc4d5-ec03-4756-86b2-5337444833d4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:06.984365 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-43fdc4d5-ec03-4756-86b2-5337444833d4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:06.990590 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-43fdc4d5-ec03-4756-86b2-5337444833d4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:06.992441 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-43fdc4d5-ec03-4756-86b2-5337444833d4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:06.992441 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-43fdc4d5-ec03-4756-86b2-5337444833d4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:06.992441 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-43fdc4d5-ec03-4756-86b2-5337444833d4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:07.126213 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-43fdc4d5-ec03-4756-86b2-5337444833d4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:07.133910 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-43fdc4d5-ec03-4756-86b2-5337444833d4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.153982 Feb 21 01:31:07.134471 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 805/1586] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:06 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:08.150651 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-16b79fa1-de24-4b2e-95e9-bf70de602426 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:08.151184 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-16b79fa1-de24-4b2e-95e9-bf70de602426 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:08.158106 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-16b79fa1-de24-4b2e-95e9-bf70de602426 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:08.158553 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-16b79fa1-de24-4b2e-95e9-bf70de602426 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:08.159323 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-16b79fa1-de24-4b2e-95e9-bf70de602426 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:08.159750 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-16b79fa1-de24-4b2e-95e9-bf70de602426 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:08.290538 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-16b79fa1-de24-4b2e-95e9-bf70de602426 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:08.298457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-16b79fa1-de24-4b2e-95e9-bf70de602426 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151569 Feb 21 01:31:08.299020 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 782/1587] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:08 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:09.315899 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ea4f91b9-689f-4c44-a56b-639ef91d0de7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:09.316519 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ea4f91b9-689f-4c44-a56b-639ef91d0de7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:09.323013 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ea4f91b9-689f-4c44-a56b-639ef91d0de7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:09.323457 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ea4f91b9-689f-4c44-a56b-639ef91d0de7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:09.324270 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ea4f91b9-689f-4c44-a56b-639ef91d0de7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:09.324703 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ea4f91b9-689f-4c44-a56b-639ef91d0de7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:09.460012 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ea4f91b9-689f-4c44-a56b-639ef91d0de7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:09.467651 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ea4f91b9-689f-4c44-a56b-639ef91d0de7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.156231 Feb 21 01:31:09.468250 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 806/1588] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:09 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:10.484912 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f7d39d0c-f430-41c8-b7bf-b20b55c885a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:10.485508 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f7d39d0c-f430-41c8-b7bf-b20b55c885a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:10.491646 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f7d39d0c-f430-41c8-b7bf-b20b55c885a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:10.492105 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f7d39d0c-f430-41c8-b7bf-b20b55c885a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:10.492870 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f7d39d0c-f430-41c8-b7bf-b20b55c885a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:10.493299 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f7d39d0c-f430-41c8-b7bf-b20b55c885a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:10.626687 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f7d39d0c-f430-41c8-b7bf-b20b55c885a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:10.634410 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f7d39d0c-f430-41c8-b7bf-b20b55c885a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.153876 Feb 21 01:31:10.634978 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 783/1589] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:10 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:11.651666 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d95dce1e-5227-4b10-97a1-b089440d30bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:11.652235 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d95dce1e-5227-4b10-97a1-b089440d30bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:11.659091 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d95dce1e-5227-4b10-97a1-b089440d30bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:11.659530 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d95dce1e-5227-4b10-97a1-b089440d30bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:11.660331 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d95dce1e-5227-4b10-97a1-b089440d30bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:11.660759 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d95dce1e-5227-4b10-97a1-b089440d30bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:11.793801 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d95dce1e-5227-4b10-97a1-b089440d30bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:11.802139 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d95dce1e-5227-4b10-97a1-b089440d30bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154231 Feb 21 01:31:11.802769 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 807/1590] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:11 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:12.818644 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-23af3286-14d6-41b1-a2b8-5f87e25c2a39 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:12.819274 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-23af3286-14d6-41b1-a2b8-5f87e25c2a39 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:12.825511 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-23af3286-14d6-41b1-a2b8-5f87e25c2a39 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:12.825947 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-23af3286-14d6-41b1-a2b8-5f87e25c2a39 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:12.826708 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-23af3286-14d6-41b1-a2b8-5f87e25c2a39 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:12.827164 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-23af3286-14d6-41b1-a2b8-5f87e25c2a39 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:12.956386 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-23af3286-14d6-41b1-a2b8-5f87e25c2a39 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:12.964225 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-23af3286-14d6-41b1-a2b8-5f87e25c2a39 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.149132 Feb 21 01:31:12.964755 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 784/1591] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:12 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:13.981515 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a4a8cf7f-9a95-4081-bfc6-498d1e42aaf7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:13.982130 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a4a8cf7f-9a95-4081-bfc6-498d1e42aaf7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:13.988547 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a4a8cf7f-9a95-4081-bfc6-498d1e42aaf7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:13.988994 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a4a8cf7f-9a95-4081-bfc6-498d1e42aaf7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:13.989777 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a4a8cf7f-9a95-4081-bfc6-498d1e42aaf7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:13.990209 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a4a8cf7f-9a95-4081-bfc6-498d1e42aaf7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:14.123162 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a4a8cf7f-9a95-4081-bfc6-498d1e42aaf7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:14.131860 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a4a8cf7f-9a95-4081-bfc6-498d1e42aaf7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154049 Feb 21 01:31:14.132444 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 808/1592] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:13 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:31:15.149582 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-65187257-cf30-46bb-9719-0edabc8b7c96 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:15.150142 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-65187257-cf30-46bb-9719-0edabc8b7c96 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:15.157010 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-65187257-cf30-46bb-9719-0edabc8b7c96 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:15.157457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-65187257-cf30-46bb-9719-0edabc8b7c96 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:15.158245 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-65187257-cf30-46bb-9719-0edabc8b7c96 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:15.158679 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-65187257-cf30-46bb-9719-0edabc8b7c96 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:15.289311 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-65187257-cf30-46bb-9719-0edabc8b7c96 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:15.297580 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-65187257-cf30-46bb-9719-0edabc8b7c96 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151608 Feb 21 01:31:15.298137 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 785/1593] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:15 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:16.314304 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c58b55ba-e861-4914-9728-da0aab0eec6d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:16.314907 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c58b55ba-e861-4914-9728-da0aab0eec6d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:16.321107 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c58b55ba-e861-4914-9728-da0aab0eec6d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:16.321566 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c58b55ba-e861-4914-9728-da0aab0eec6d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:16.322310 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c58b55ba-e861-4914-9728-da0aab0eec6d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:16.322730 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c58b55ba-e861-4914-9728-da0aab0eec6d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:16.454136 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c58b55ba-e861-4914-9728-da0aab0eec6d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:16.461679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c58b55ba-e861-4914-9728-da0aab0eec6d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151475 Feb 21 01:31:16.462234 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 809/1594] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:16 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:17.478209 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7381cd19-955e-4785-9050-23e42a9007aa tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:17.478885 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7381cd19-955e-4785-9050-23e42a9007aa tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:17.485198 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7381cd19-955e-4785-9050-23e42a9007aa tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:17.485644 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7381cd19-955e-4785-9050-23e42a9007aa tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:17.486419 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7381cd19-955e-4785-9050-23e42a9007aa tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:17.486851 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7381cd19-955e-4785-9050-23e42a9007aa tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:17.845234 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7381cd19-955e-4785-9050-23e42a9007aa tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:17.853069 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7381cd19-955e-4785-9050-23e42a9007aa tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.378453 Feb 21 01:31:17.853807 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 786/1595] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:17 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:18.870150 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-588aa32f-f00e-4986-b60d-188c61624d00 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:18.870745 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-588aa32f-f00e-4986-b60d-188c61624d00 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:18.877344 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-588aa32f-f00e-4986-b60d-188c61624d00 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:18.877787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-588aa32f-f00e-4986-b60d-188c61624d00 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:18.878561 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-588aa32f-f00e-4986-b60d-188c61624d00 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:18.878991 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-588aa32f-f00e-4986-b60d-188c61624d00 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:19.018341 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-588aa32f-f00e-4986-b60d-188c61624d00 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:19.026074 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-588aa32f-f00e-4986-b60d-188c61624d00 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.159543 Feb 21 01:31:19.026637 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 810/1596] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:18 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:20.041919 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c1d548fa-9df7-4f4d-b253-bb8dff89019c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:20.042522 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c1d548fa-9df7-4f4d-b253-bb8dff89019c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:20.049456 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c1d548fa-9df7-4f4d-b253-bb8dff89019c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:20.049892 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c1d548fa-9df7-4f4d-b253-bb8dff89019c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:20.050666 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c1d548fa-9df7-4f4d-b253-bb8dff89019c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:20.051089 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c1d548fa-9df7-4f4d-b253-bb8dff89019c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:20.181639 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c1d548fa-9df7-4f4d-b253-bb8dff89019c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:20.189549 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c1d548fa-9df7-4f4d-b253-bb8dff89019c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151115 Feb 21 01:31:20.190119 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 787/1597] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:20 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:21.206180 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-723c2874-1f6f-457d-bb71-8d9ca0003b96 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:21.206797 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-723c2874-1f6f-457d-bb71-8d9ca0003b96 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:21.213029 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-723c2874-1f6f-457d-bb71-8d9ca0003b96 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:21.213479 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-723c2874-1f6f-457d-bb71-8d9ca0003b96 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:21.214253 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-723c2874-1f6f-457d-bb71-8d9ca0003b96 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:21.214685 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-723c2874-1f6f-457d-bb71-8d9ca0003b96 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:21.346313 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-723c2874-1f6f-457d-bb71-8d9ca0003b96 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:21.354038 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-723c2874-1f6f-457d-bb71-8d9ca0003b96 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151419 Feb 21 01:31:21.354604 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 811/1598] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:21 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:22.370785 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-581ff131-5268-4dfa-87bb-76c525f56095 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:22.371332 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-581ff131-5268-4dfa-87bb-76c525f56095 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:22.377769 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-581ff131-5268-4dfa-87bb-76c525f56095 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:22.378206 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-581ff131-5268-4dfa-87bb-76c525f56095 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:22.378967 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-581ff131-5268-4dfa-87bb-76c525f56095 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:22.379390 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-581ff131-5268-4dfa-87bb-76c525f56095 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:22.514334 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-581ff131-5268-4dfa-87bb-76c525f56095 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:22.523062 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-581ff131-5268-4dfa-87bb-76c525f56095 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155942 Feb 21 01:31:22.523622 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 788/1599] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:22 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:23.540692 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3b9b2917-0c99-4372-8c33-a284cf4c94ca tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:23.541403 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3b9b2917-0c99-4372-8c33-a284cf4c94ca tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:23.548656 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b9b2917-0c99-4372-8c33-a284cf4c94ca tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:23.549181 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b9b2917-0c99-4372-8c33-a284cf4c94ca tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:23.549918 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b9b2917-0c99-4372-8c33-a284cf4c94ca tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:23.550304 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b9b2917-0c99-4372-8c33-a284cf4c94ca tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:23.683925 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3b9b2917-0c99-4372-8c33-a284cf4c94ca tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:23.691784 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3b9b2917-0c99-4372-8c33-a284cf4c94ca tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154742 Feb 21 01:31:23.692379 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 812/1600] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:23 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:24.708220 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b62e1a7f-388d-4ff4-badf-e03c67dafd03 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:24.708826 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b62e1a7f-388d-4ff4-badf-e03c67dafd03 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:24.714987 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b62e1a7f-388d-4ff4-badf-e03c67dafd03 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:24.715432 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b62e1a7f-388d-4ff4-badf-e03c67dafd03 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:24.716235 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b62e1a7f-388d-4ff4-badf-e03c67dafd03 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:24.716666 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b62e1a7f-388d-4ff4-badf-e03c67dafd03 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:24.846890 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b62e1a7f-388d-4ff4-badf-e03c67dafd03 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:24.854879 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b62e1a7f-388d-4ff4-badf-e03c67dafd03 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.150265 Feb 21 01:31:24.855451 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 789/1601] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:24 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:25.871460 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-950be39d-3db8-47aa-ab5e-6f3e0a8f0196 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:25.872115 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-950be39d-3db8-47aa-ab5e-6f3e0a8f0196 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:25.878579 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-950be39d-3db8-47aa-ab5e-6f3e0a8f0196 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:25.879026 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-950be39d-3db8-47aa-ab5e-6f3e0a8f0196 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:25.879794 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-950be39d-3db8-47aa-ab5e-6f3e0a8f0196 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:25.880259 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-950be39d-3db8-47aa-ab5e-6f3e0a8f0196 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:26.010268 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-950be39d-3db8-47aa-ab5e-6f3e0a8f0196 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:26.018693 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-950be39d-3db8-47aa-ab5e-6f3e0a8f0196 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.150911 Feb 21 01:31:26.019251 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 813/1602] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:25 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:27.035578 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a10681cd-b1b2-4734-9e60-03fea8f182c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:27.036240 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a10681cd-b1b2-4734-9e60-03fea8f182c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:27.042555 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a10681cd-b1b2-4734-9e60-03fea8f182c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:27.043019 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a10681cd-b1b2-4734-9e60-03fea8f182c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:27.043784 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a10681cd-b1b2-4734-9e60-03fea8f182c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:27.044242 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a10681cd-b1b2-4734-9e60-03fea8f182c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:27.179237 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a10681cd-b1b2-4734-9e60-03fea8f182c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:27.186855 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a10681cd-b1b2-4734-9e60-03fea8f182c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155127 Feb 21 01:31:27.187416 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 790/1603] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:27 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:28.204047 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-074c2f6c-c0fb-41b8-98a2-ea8303cc23ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:28.205152 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-074c2f6c-c0fb-41b8-98a2-ea8303cc23ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:28.211380 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-074c2f6c-c0fb-41b8-98a2-ea8303cc23ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:28.211880 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-074c2f6c-c0fb-41b8-98a2-ea8303cc23ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:28.212659 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-074c2f6c-c0fb-41b8-98a2-ea8303cc23ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:28.213091 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-074c2f6c-c0fb-41b8-98a2-ea8303cc23ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:28.342080 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-074c2f6c-c0fb-41b8-98a2-ea8303cc23ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:28.350477 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-074c2f6c-c0fb-41b8-98a2-ea8303cc23ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.150078 Feb 21 01:31:28.351042 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 814/1604] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:28 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:29.367271 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ee2b9676-753c-41ea-b240-602da57bfdee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:29.367909 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ee2b9676-753c-41ea-b240-602da57bfdee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:29.374427 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee2b9676-753c-41ea-b240-602da57bfdee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:29.374868 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee2b9676-753c-41ea-b240-602da57bfdee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:29.375638 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee2b9676-753c-41ea-b240-602da57bfdee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:29.376591 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee2b9676-753c-41ea-b240-602da57bfdee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:29.507325 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ee2b9676-753c-41ea-b240-602da57bfdee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:29.515128 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ee2b9676-753c-41ea-b240-602da57bfdee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151509 Feb 21 01:31:29.515772 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 791/1605] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:29 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:30.533161 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-730f6f15-64ad-4604-a74f-0698785f91b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:30.533802 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-730f6f15-64ad-4604-a74f-0698785f91b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:30.540144 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-730f6f15-64ad-4604-a74f-0698785f91b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:30.540595 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-730f6f15-64ad-4604-a74f-0698785f91b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:30.541383 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-730f6f15-64ad-4604-a74f-0698785f91b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:30.541820 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-730f6f15-64ad-4604-a74f-0698785f91b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:30.676951 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-730f6f15-64ad-4604-a74f-0698785f91b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:30.684990 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-730f6f15-64ad-4604-a74f-0698785f91b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.156034 Feb 21 01:31:30.685551 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 815/1606] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:30 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:31.701055 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2531af3f-69f1-4021-95af-4cb17eb56b44 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:31.701657 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2531af3f-69f1-4021-95af-4cb17eb56b44 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:31.707738 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2531af3f-69f1-4021-95af-4cb17eb56b44 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:31.708210 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2531af3f-69f1-4021-95af-4cb17eb56b44 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:31.708976 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2531af3f-69f1-4021-95af-4cb17eb56b44 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:31.709401 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2531af3f-69f1-4021-95af-4cb17eb56b44 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:31.845829 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2531af3f-69f1-4021-95af-4cb17eb56b44 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:31.853468 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2531af3f-69f1-4021-95af-4cb17eb56b44 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.156012 Feb 21 01:31:31.854023 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 792/1607] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:31 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:32.870319 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5544cbe3-e89c-4879-ba95-183abfe509e4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:32.870932 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5544cbe3-e89c-4879-ba95-183abfe509e4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:32.877760 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5544cbe3-e89c-4879-ba95-183abfe509e4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:32.878207 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5544cbe3-e89c-4879-ba95-183abfe509e4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:32.878993 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5544cbe3-e89c-4879-ba95-183abfe509e4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:32.879453 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5544cbe3-e89c-4879-ba95-183abfe509e4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:33.029485 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5544cbe3-e89c-4879-ba95-183abfe509e4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:33.037809 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5544cbe3-e89c-4879-ba95-183abfe509e4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.171217 Feb 21 01:31:33.038370 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 816/1608] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:32 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:34.054169 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9265fd13-8588-44bc-93d8-f41e6b5e21f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:34.054801 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9265fd13-8588-44bc-93d8-f41e6b5e21f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:34.061166 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9265fd13-8588-44bc-93d8-f41e6b5e21f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:34.061605 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9265fd13-8588-44bc-93d8-f41e6b5e21f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:34.062369 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9265fd13-8588-44bc-93d8-f41e6b5e21f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:34.062791 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9265fd13-8588-44bc-93d8-f41e6b5e21f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:34.198332 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9265fd13-8588-44bc-93d8-f41e6b5e21f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:34.206976 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9265fd13-8588-44bc-93d8-f41e6b5e21f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.156374 Feb 21 01:31:34.207540 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 793/1609] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:34 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:35.223382 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-40864693-b6d5-403d-a46b-87b21b9c8517 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:35.224022 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-40864693-b6d5-403d-a46b-87b21b9c8517 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:35.230279 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-40864693-b6d5-403d-a46b-87b21b9c8517 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:35.230726 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-40864693-b6d5-403d-a46b-87b21b9c8517 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:35.231502 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-40864693-b6d5-403d-a46b-87b21b9c8517 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:35.231968 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-40864693-b6d5-403d-a46b-87b21b9c8517 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:35.365892 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-40864693-b6d5-403d-a46b-87b21b9c8517 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:35.373783 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-40864693-b6d5-403d-a46b-87b21b9c8517 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.153790 Feb 21 01:31:35.374329 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 817/1610] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:35 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:36.392445 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-20b56995-a921-4e2c-812c-53c4da8c6a68 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:36.393084 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-20b56995-a921-4e2c-812c-53c4da8c6a68 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:36.398966 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-20b56995-a921-4e2c-812c-53c4da8c6a68 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:36.399408 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-20b56995-a921-4e2c-812c-53c4da8c6a68 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:36.400215 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-20b56995-a921-4e2c-812c-53c4da8c6a68 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:36.400645 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-20b56995-a921-4e2c-812c-53c4da8c6a68 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:36.531993 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-20b56995-a921-4e2c-812c-53c4da8c6a68 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:36.539712 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-20b56995-a921-4e2c-812c-53c4da8c6a68 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151643 Feb 21 01:31:36.542284 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 794/1611] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:36 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:37.557034 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f30bf73c-0d4e-456a-a431-60a58239c51c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:37.557636 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f30bf73c-0d4e-456a-a431-60a58239c51c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:37.563844 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f30bf73c-0d4e-456a-a431-60a58239c51c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:37.564280 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f30bf73c-0d4e-456a-a431-60a58239c51c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:37.565042 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f30bf73c-0d4e-456a-a431-60a58239c51c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:37.565465 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f30bf73c-0d4e-456a-a431-60a58239c51c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:37.695091 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f30bf73c-0d4e-456a-a431-60a58239c51c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:37.702801 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f30bf73c-0d4e-456a-a431-60a58239c51c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.149361 Feb 21 01:31:37.703358 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 818/1612] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:37 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:38.720481 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fed158d8-4102-4724-84e6-66d7370a22c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:38.721093 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fed158d8-4102-4724-84e6-66d7370a22c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:38.727317 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fed158d8-4102-4724-84e6-66d7370a22c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:38.727765 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fed158d8-4102-4724-84e6-66d7370a22c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:38.728569 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fed158d8-4102-4724-84e6-66d7370a22c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:38.729008 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fed158d8-4102-4724-84e6-66d7370a22c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:38.864381 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fed158d8-4102-4724-84e6-66d7370a22c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:38.872108 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fed158d8-4102-4724-84e6-66d7370a22c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155926 Feb 21 01:31:38.872673 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 795/1613] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:38 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:39.889441 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b37c0eda-6f48-488c-b33e-8ed8714c7764 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:39.890077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b37c0eda-6f48-488c-b33e-8ed8714c7764 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:39.897141 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b37c0eda-6f48-488c-b33e-8ed8714c7764 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:39.897584 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b37c0eda-6f48-488c-b33e-8ed8714c7764 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:39.898359 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b37c0eda-6f48-488c-b33e-8ed8714c7764 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:39.898786 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b37c0eda-6f48-488c-b33e-8ed8714c7764 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:40.032821 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b37c0eda-6f48-488c-b33e-8ed8714c7764 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:40.040507 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b37c0eda-6f48-488c-b33e-8ed8714c7764 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154776 Feb 21 01:31:40.041066 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 819/1614] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:39 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:41.057185 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-865b2522-0bcf-4d97-9a14-7b8f4f5e71fe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:41.057797 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-865b2522-0bcf-4d97-9a14-7b8f4f5e71fe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:41.065428 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-865b2522-0bcf-4d97-9a14-7b8f4f5e71fe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:41.065881 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-865b2522-0bcf-4d97-9a14-7b8f4f5e71fe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:41.068525 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-865b2522-0bcf-4d97-9a14-7b8f4f5e71fe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:41.071332 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-865b2522-0bcf-4d97-9a14-7b8f4f5e71fe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:41.200815 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-865b2522-0bcf-4d97-9a14-7b8f4f5e71fe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:41.209430 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-865b2522-0bcf-4d97-9a14-7b8f4f5e71fe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155984 Feb 21 01:31:41.209998 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 796/1615] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:41 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:42.226117 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d424893e-d95a-4d81-8e6e-170f00831dee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:42.226713 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d424893e-d95a-4d81-8e6e-170f00831dee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:42.233176 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d424893e-d95a-4d81-8e6e-170f00831dee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:42.233621 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d424893e-d95a-4d81-8e6e-170f00831dee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:42.234410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d424893e-d95a-4d81-8e6e-170f00831dee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:42.234861 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d424893e-d95a-4d81-8e6e-170f00831dee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:42.369104 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d424893e-d95a-4d81-8e6e-170f00831dee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:42.379308 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d424893e-d95a-4d81-8e6e-170f00831dee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.156859 Feb 21 01:31:42.379912 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 820/1616] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:42 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:43.396678 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-aa8c4789-b5b2-49db-9e24-18645b117565 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:43.397278 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-aa8c4789-b5b2-49db-9e24-18645b117565 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:43.403418 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-aa8c4789-b5b2-49db-9e24-18645b117565 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:43.403894 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-aa8c4789-b5b2-49db-9e24-18645b117565 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:43.404667 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-aa8c4789-b5b2-49db-9e24-18645b117565 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:43.405093 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-aa8c4789-b5b2-49db-9e24-18645b117565 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:43.538112 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-aa8c4789-b5b2-49db-9e24-18645b117565 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:43.546197 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-aa8c4789-b5b2-49db-9e24-18645b117565 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.153138 Feb 21 01:31:43.546758 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 797/1617] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:43 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:31:44.562665 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3394ca7d-2a08-4672-b183-882611bae02b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:44.564112 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3394ca7d-2a08-4672-b183-882611bae02b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:44.570085 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3394ca7d-2a08-4672-b183-882611bae02b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:44.570526 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3394ca7d-2a08-4672-b183-882611bae02b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:44.571305 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3394ca7d-2a08-4672-b183-882611bae02b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:44.571732 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3394ca7d-2a08-4672-b183-882611bae02b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:44.701696 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3394ca7d-2a08-4672-b183-882611bae02b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:44.709399 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3394ca7d-2a08-4672-b183-882611bae02b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.150388 Feb 21 01:31:44.709967 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 821/1618] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:44 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:45.726019 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d6f6b784-3e4e-4c38-a7bf-ef92d4f392fe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:45.726635 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d6f6b784-3e4e-4c38-a7bf-ef92d4f392fe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:45.732850 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d6f6b784-3e4e-4c38-a7bf-ef92d4f392fe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:45.733294 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d6f6b784-3e4e-4c38-a7bf-ef92d4f392fe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:45.734066 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d6f6b784-3e4e-4c38-a7bf-ef92d4f392fe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:45.734499 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d6f6b784-3e4e-4c38-a7bf-ef92d4f392fe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:45.870952 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d6f6b784-3e4e-4c38-a7bf-ef92d4f392fe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:45.879250 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d6f6b784-3e4e-4c38-a7bf-ef92d4f392fe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.156832 Feb 21 01:31:45.879816 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 798/1619] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:45 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:46.895931 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-976e35dd-4826-49ce-8667-25ea5460d865 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:46.896479 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-976e35dd-4826-49ce-8667-25ea5460d865 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:46.902728 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-976e35dd-4826-49ce-8667-25ea5460d865 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:46.903173 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-976e35dd-4826-49ce-8667-25ea5460d865 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:46.903981 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-976e35dd-4826-49ce-8667-25ea5460d865 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:46.904417 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-976e35dd-4826-49ce-8667-25ea5460d865 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:47.040438 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-976e35dd-4826-49ce-8667-25ea5460d865 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:47.048162 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-976e35dd-4826-49ce-8667-25ea5460d865 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155925 Feb 21 01:31:47.048714 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 822/1620] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:46 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:48.065351 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-46b2c9dd-0433-4e54-a7b4-3fc12a146d2b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:48.065962 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-46b2c9dd-0433-4e54-a7b4-3fc12a146d2b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:48.072342 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-46b2c9dd-0433-4e54-a7b4-3fc12a146d2b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:48.072785 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-46b2c9dd-0433-4e54-a7b4-3fc12a146d2b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:48.073553 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-46b2c9dd-0433-4e54-a7b4-3fc12a146d2b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:48.073974 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-46b2c9dd-0433-4e54-a7b4-3fc12a146d2b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:48.208521 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-46b2c9dd-0433-4e54-a7b4-3fc12a146d2b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:48.216109 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-46b2c9dd-0433-4e54-a7b4-3fc12a146d2b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154447 Feb 21 01:31:48.216669 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 799/1621] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:48 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:49.233439 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4dee5301-200d-47e5-99fb-c272ba200e0f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:49.234080 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4dee5301-200d-47e5-99fb-c272ba200e0f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:49.240597 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4dee5301-200d-47e5-99fb-c272ba200e0f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:49.241044 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4dee5301-200d-47e5-99fb-c272ba200e0f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:49.241817 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4dee5301-200d-47e5-99fb-c272ba200e0f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:49.242246 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4dee5301-200d-47e5-99fb-c272ba200e0f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:49.379978 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4dee5301-200d-47e5-99fb-c272ba200e0f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:49.387698 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4dee5301-200d-47e5-99fb-c272ba200e0f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.157904 Feb 21 01:31:49.388284 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 823/1622] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:49 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:50.404577 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6abe755a-1a78-4b80-bc3b-85a91c135858 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:50.405200 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6abe755a-1a78-4b80-bc3b-85a91c135858 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:50.412100 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6abe755a-1a78-4b80-bc3b-85a91c135858 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:50.412544 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6abe755a-1a78-4b80-bc3b-85a91c135858 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:50.413323 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6abe755a-1a78-4b80-bc3b-85a91c135858 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:50.413748 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6abe755a-1a78-4b80-bc3b-85a91c135858 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:50.545545 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6abe755a-1a78-4b80-bc3b-85a91c135858 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:50.553845 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6abe755a-1a78-4b80-bc3b-85a91c135858 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152923 Feb 21 01:31:50.554409 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 800/1623] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:50 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:51.570518 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-abd62567-0d35-458d-bf5e-0ef137f72b1c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:51.571067 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-abd62567-0d35-458d-bf5e-0ef137f72b1c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:51.577273 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-abd62567-0d35-458d-bf5e-0ef137f72b1c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:51.577707 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-abd62567-0d35-458d-bf5e-0ef137f72b1c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:51.578470 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-abd62567-0d35-458d-bf5e-0ef137f72b1c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:51.578894 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-abd62567-0d35-458d-bf5e-0ef137f72b1c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:51.711579 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-abd62567-0d35-458d-bf5e-0ef137f72b1c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:51.719182 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-abd62567-0d35-458d-bf5e-0ef137f72b1c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152393 Feb 21 01:31:51.719730 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 824/1624] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:51 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:52.734836 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f71fe88a-6d85-4ad8-8986-1c478be4d37c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:52.735441 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f71fe88a-6d85-4ad8-8986-1c478be4d37c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:52.741948 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f71fe88a-6d85-4ad8-8986-1c478be4d37c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:52.742386 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f71fe88a-6d85-4ad8-8986-1c478be4d37c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:52.743152 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f71fe88a-6d85-4ad8-8986-1c478be4d37c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:52.743577 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f71fe88a-6d85-4ad8-8986-1c478be4d37c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:52.874488 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f71fe88a-6d85-4ad8-8986-1c478be4d37c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:52.882577 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f71fe88a-6d85-4ad8-8986-1c478be4d37c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151398 Feb 21 01:31:52.883145 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 801/1625] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:52 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:53.898633 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-12e39b49-7c7b-43f5-a0db-266c02688505 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:53.899282 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-12e39b49-7c7b-43f5-a0db-266c02688505 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:53.905673 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-12e39b49-7c7b-43f5-a0db-266c02688505 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:53.906121 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-12e39b49-7c7b-43f5-a0db-266c02688505 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:53.906898 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-12e39b49-7c7b-43f5-a0db-266c02688505 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:53.907332 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-12e39b49-7c7b-43f5-a0db-266c02688505 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:54.038169 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-12e39b49-7c7b-43f5-a0db-266c02688505 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:54.045868 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-12e39b49-7c7b-43f5-a0db-266c02688505 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.150907 Feb 21 01:31:54.046430 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 825/1626] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:53 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:55.062422 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-82563726-f6cd-4283-89f3-bc69a060eb10 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:55.063053 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-82563726-f6cd-4283-89f3-bc69a060eb10 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:55.069338 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-82563726-f6cd-4283-89f3-bc69a060eb10 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:55.069790 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-82563726-f6cd-4283-89f3-bc69a060eb10 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:55.070566 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-82563726-f6cd-4283-89f3-bc69a060eb10 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:55.071024 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-82563726-f6cd-4283-89f3-bc69a060eb10 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:55.202283 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-82563726-f6cd-4283-89f3-bc69a060eb10 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:55.210203 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-82563726-f6cd-4283-89f3-bc69a060eb10 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151436 Feb 21 01:31:55.211061 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 802/1627] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:55 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:56.227015 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8568db57-ae1c-4586-a39a-4b72b1fc515e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:56.227694 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8568db57-ae1c-4586-a39a-4b72b1fc515e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:56.234195 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8568db57-ae1c-4586-a39a-4b72b1fc515e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:56.234659 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8568db57-ae1c-4586-a39a-4b72b1fc515e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:56.235485 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8568db57-ae1c-4586-a39a-4b72b1fc515e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:56.244746 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8568db57-ae1c-4586-a39a-4b72b1fc515e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:56.370091 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8568db57-ae1c-4586-a39a-4b72b1fc515e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:56.378917 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8568db57-ae1c-4586-a39a-4b72b1fc515e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154963 Feb 21 01:31:56.379475 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 826/1628] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:56 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:57.395975 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fb088e06-829f-4161-8a5c-d77014848a71 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:57.396583 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fb088e06-829f-4161-8a5c-d77014848a71 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:57.402687 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fb088e06-829f-4161-8a5c-d77014848a71 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:57.403127 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fb088e06-829f-4161-8a5c-d77014848a71 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:57.404045 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fb088e06-829f-4161-8a5c-d77014848a71 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:57.404481 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fb088e06-829f-4161-8a5c-d77014848a71 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:57.538681 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fb088e06-829f-4161-8a5c-d77014848a71 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:57.546361 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fb088e06-829f-4161-8a5c-d77014848a71 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154753 Feb 21 01:31:57.546929 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 803/1629] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:57 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:58.563343 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d531d812-38fb-43c2-b6fe-6ccbbd2966c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:58.563975 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d531d812-38fb-43c2-b6fe-6ccbbd2966c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:58.570999 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d531d812-38fb-43c2-b6fe-6ccbbd2966c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:58.571385 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d531d812-38fb-43c2-b6fe-6ccbbd2966c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:58.572184 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d531d812-38fb-43c2-b6fe-6ccbbd2966c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:58.572609 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d531d812-38fb-43c2-b6fe-6ccbbd2966c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:58.704068 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d531d812-38fb-43c2-b6fe-6ccbbd2966c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:58.711585 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d531d812-38fb-43c2-b6fe-6ccbbd2966c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151801 Feb 21 01:31:58.712175 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 827/1630] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:58 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:31:59.728115 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-afe6d864-791b-4fa6-acfa-f7edabcfdfb1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:31:59.728720 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-afe6d864-791b-4fa6-acfa-f7edabcfdfb1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:31:59.734838 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-afe6d864-791b-4fa6-acfa-f7edabcfdfb1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:59.735277 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-afe6d864-791b-4fa6-acfa-f7edabcfdfb1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:59.736084 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-afe6d864-791b-4fa6-acfa-f7edabcfdfb1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:59.736510 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-afe6d864-791b-4fa6-acfa-f7edabcfdfb1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:59.869001 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-afe6d864-791b-4fa6-acfa-f7edabcfdfb1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:31:59.876925 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-afe6d864-791b-4fa6-acfa-f7edabcfdfb1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152469 Feb 21 01:31:59.877486 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 804/1631] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:31:59 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:00.892968 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0ad99672-396e-41bf-aa1e-1c06c8b6442e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:00.893685 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0ad99672-396e-41bf-aa1e-1c06c8b6442e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:00.899996 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0ad99672-396e-41bf-aa1e-1c06c8b6442e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:00.900445 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0ad99672-396e-41bf-aa1e-1c06c8b6442e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:00.901227 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0ad99672-396e-41bf-aa1e-1c06c8b6442e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:00.901663 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0ad99672-396e-41bf-aa1e-1c06c8b6442e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:01.030205 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0ad99672-396e-41bf-aa1e-1c06c8b6442e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:01.038351 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0ad99672-396e-41bf-aa1e-1c06c8b6442e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.149146 Feb 21 01:32:01.038903 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 828/1632] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:00 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:01.643877 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d4278293-a014-4dba-a347-d375d47f91d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:01.644537 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d4278293-a014-4dba-a347-d375d47f91d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:01.650474 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d4278293-a014-4dba-a347-d375d47f91d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:01.650917 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d4278293-a014-4dba-a347-d375d47f91d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:01.651695 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d4278293-a014-4dba-a347-d375d47f91d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:01.652146 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d4278293-a014-4dba-a347-d375d47f91d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:01.678788 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d4278293-a014-4dba-a347-d375d47f91d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Going to try to terminate instance {{(pid=117138) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:32:01.684810 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.compute.api [None req-d4278293-a014-4dba-a347-d375d47f91d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Working on deleting snapshot b4d5b892-40ee-4214-96d7-48e5c9c5ab24 from shelved instance... Feb 21 01:32:02.054593 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4050f7b1-a497-4381-b7ad-02def71bc9cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:02.055197 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4050f7b1-a497-4381-b7ad-02def71bc9cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:02.061259 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4050f7b1-a497-4381-b7ad-02def71bc9cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:02.061703 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4050f7b1-a497-4381-b7ad-02def71bc9cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:02.062471 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4050f7b1-a497-4381-b7ad-02def71bc9cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:02.062898 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4050f7b1-a497-4381-b7ad-02def71bc9cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:02.206444 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4050f7b1-a497-4381-b7ad-02def71bc9cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:02.214150 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4050f7b1-a497-4381-b7ad-02def71bc9cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.163081 Feb 21 01:32:02.214710 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 829/1633] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:02 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:03.066463 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d4278293-a014-4dba-a347-d375d47f91d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Doing local delete in cell 43422379-6863-4985-aea0-21540c83a2e0(cell1) {{(pid=117138) _delete /opt/stack/nova/nova/compute/api.py:2439}} Feb 21 01:32:03.067265 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d4278293-a014-4dba-a347-d375d47f91d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:03.067699 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d4278293-a014-4dba-a347-d375d47f91d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:03.068148 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.compute.api [None req-d4278293-a014-4dba-a347-d375d47f91d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Feb 21 01:32:03.074833 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.network.neutron [None req-d4278293-a014-4dba-a347-d375d47f91d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] deallocate_for_instance() {{(pid=117138) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1790}} Feb 21 01:32:03.230722 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4bf8bf22-04cb-4a2f-aa08-5e0f3263f598 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:03.231437 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4bf8bf22-04cb-4a2f-aa08-5e0f3263f598 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:03.237869 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4bf8bf22-04cb-4a2f-aa08-5e0f3263f598 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:03.238313 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4bf8bf22-04cb-4a2f-aa08-5e0f3263f598 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:03.239100 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4bf8bf22-04cb-4a2f-aa08-5e0f3263f598 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:03.239529 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4bf8bf22-04cb-4a2f-aa08-5e0f3263f598 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:03.372444 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4bf8bf22-04cb-4a2f-aa08-5e0f3263f598 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:03.381745 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4bf8bf22-04cb-4a2f-aa08-5e0f3263f598 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154817 Feb 21 01:32:03.382734 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 830/1634] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:03 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:04.063317 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.network.neutron [None req-d4278293-a014-4dba-a347-d375d47f91d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Updating instance_info_cache with network_info: [] {{(pid=117138) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 21 01:32:04.164652 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-80916f09-5709-4e35-b598-203c82866f67 req-1c19ef4e-c2dc-4d7b-9e15-0b6cb5a4d4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2aa103a-4f89-45a6-8c62-09282555e3b3", "name": "network-vif-deleted", "tag": "17542d9a-ec16-46b0-907e-71f3f5221834"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:04.166413 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:32:04.166413 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:32:04.173576 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-80916f09-5709-4e35-b598-203c82866f67 req-1c19ef4e-c2dc-4d7b-9e15-0b6cb5a4d4d0 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:04.174184 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-80916f09-5709-4e35-b598-203c82866f67 req-1c19ef4e-c2dc-4d7b-9e15-0b6cb5a4d4d0 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:04.185221 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.compute.server_external_events [req-80916f09-5709-4e35-b598-203c82866f67 req-1c19ef4e-c2dc-4d7b-9e15-0b6cb5a4d4d0 service nova] Unable to find a host for instance e2aa103a-4f89-45a6-8c62-09282555e3b3. Dropping event network-vif-deleted {{(pid=117139) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 21 01:32:04.186077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-80916f09-5709-4e35-b598-203c82866f67 req-1c19ef4e-c2dc-4d7b-9e15-0b6cb5a4d4d0 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.189788 Feb 21 01:32:04.186645 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 831/1635] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 191 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 21 01:32:04.577330 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e0ab2c50-b9f3-4eff-9f6d-b458a2d1ceec tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:04.578659 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e0ab2c50-b9f3-4eff-9f6d-b458a2d1ceec tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:04.586500 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e0ab2c50-b9f3-4eff-9f6d-b458a2d1ceec tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:04.587231 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e0ab2c50-b9f3-4eff-9f6d-b458a2d1ceec tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:04.588053 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e0ab2c50-b9f3-4eff-9f6d-b458a2d1ceec tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:04.588795 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e0ab2c50-b9f3-4eff-9f6d-b458a2d1ceec tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:04.730672 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e0ab2c50-b9f3-4eff-9f6d-b458a2d1ceec tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:04.739724 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e0ab2c50-b9f3-4eff-9f6d-b458a2d1ceec tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.344034 Feb 21 01:32:04.741060 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 832/1636] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:04 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:04.779665 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.scheduler.client.report [None req-d4278293-a014-4dba-a347-d375d47f91d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Deleted allocations for instance e2aa103a-4f89-45a6-8c62-09282555e3b3 Feb 21 01:32:05.062928 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d4278293-a014-4dba-a347-d375d47f91d6 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "DELETE /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 204 len: 0 microversion: 2.20 time: 3.423144 Feb 21 01:32:05.063551 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 805/1637] 10.222.0.91 () {60 vars in 1279 bytes} [Mon Feb 21 01:32:01 2022] DELETE /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 0 bytes in 3424 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 21 01:32:05.072435 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-855e01ea-4f9c-4f24-8465-ef00992ad81b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:05.073054 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-855e01ea-4f9c-4f24-8465-ef00992ad81b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:05.078946 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-855e01ea-4f9c-4f24-8465-ef00992ad81b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:05.079393 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-855e01ea-4f9c-4f24-8465-ef00992ad81b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:05.080895 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-855e01ea-4f9c-4f24-8465-ef00992ad81b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:05.081644 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-855e01ea-4f9c-4f24-8465-ef00992ad81b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:05.094885 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-855e01ea-4f9c-4f24-8465-ef00992ad81b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] HTTP exception thrown: Instance e2aa103a-4f89-45a6-8c62-09282555e3b3 could not be found. Feb 21 01:32:05.095470 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-855e01ea-4f9c-4f24-8465-ef00992ad81b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Returning 404 to user: Instance e2aa103a-4f89-45a6-8c62-09282555e3b3 could not be found. {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:32:05.096611 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-855e01ea-4f9c-4f24-8465-ef00992ad81b tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 404 len: 111 microversion: 2.20 time: 0.027803 Feb 21 01:32:05.097251 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 833/1638] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:05 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 21 01:32:05.105884 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-884f243f-e394-43a6-9477-19c058669629 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '.version_select at 0x7f4ace656430>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:05.191104 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-884f243f-e394-43a6-9477-19c058669629 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-386680109" status: 204 len: 0 microversion: 2.20 time: 0.089105 Feb 21 01:32:05.194665 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 806/1639] 10.222.0.91 () {60 vars in 1258 bytes} [Mon Feb 21 01:32:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-386680109 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 21 01:32:05.758449 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4f10ae93-404b-4ea0-b6fe-ebc1ee6bfcf0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:05.758997 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4f10ae93-404b-4ea0-b6fe-ebc1ee6bfcf0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:05.764772 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f10ae93-404b-4ea0-b6fe-ebc1ee6bfcf0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:05.765223 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f10ae93-404b-4ea0-b6fe-ebc1ee6bfcf0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:05.765997 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f10ae93-404b-4ea0-b6fe-ebc1ee6bfcf0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:05.766429 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f10ae93-404b-4ea0-b6fe-ebc1ee6bfcf0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:05.991457 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4f10ae93-404b-4ea0-b6fe-ebc1ee6bfcf0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:05.999628 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4f10ae93-404b-4ea0-b6fe-ebc1ee6bfcf0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.245213 Feb 21 01:32:06.000420 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 834/1640] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:05 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:06.126045 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9bc4a7eb-ca08-4a61-8732-23deaeefc07f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Action: 'create', calling method: .version_select at 0x7f4ace665820>, body: {"keypair": {"name": "tempest-keypair-1902937667"}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:06.141061 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-9bc4a7eb-ca08-4a61-8732-23deaeefc07f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Getting quotas for project 8ef8a0b8828d4a38a7f8a9465fa9fbaf. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:32:06.146002 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-9bc4a7eb-ca08-4a61-8732-23deaeefc07f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Getting quotas for user 5adf4837cc254e1a951dda183d795606 and project 8ef8a0b8828d4a38a7f8a9465fa9fbaf. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:32:06.440335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-9bc4a7eb-ca08-4a61-8732-23deaeefc07f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Getting quotas for project 8ef8a0b8828d4a38a7f8a9465fa9fbaf. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:32:06.444037 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-9bc4a7eb-ca08-4a61-8732-23deaeefc07f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Getting quotas for user 5adf4837cc254e1a951dda183d795606 and project 8ef8a0b8828d4a38a7f8a9465fa9fbaf. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:32:06.456860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9bc4a7eb-ca08-4a61-8732-23deaeefc07f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.334850 Feb 21 01:32:06.457468 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 807/1641] 10.222.0.91 () {62 vars in 1198 bytes} [Mon Feb 21 01:32:06 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 336 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 21 01:32:07.018624 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c55796d8-f1c3-48b8-b210-2e9ea9580fa4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:07.019227 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c55796d8-f1c3-48b8-b210-2e9ea9580fa4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:07.025649 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c55796d8-f1c3-48b8-b210-2e9ea9580fa4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:07.026093 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c55796d8-f1c3-48b8-b210-2e9ea9580fa4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:07.032779 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c55796d8-f1c3-48b8-b210-2e9ea9580fa4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:07.032779 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c55796d8-f1c3-48b8-b210-2e9ea9580fa4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:07.161845 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c55796d8-f1c3-48b8-b210-2e9ea9580fa4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:07.169594 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c55796d8-f1c3-48b8-b210-2e9ea9580fa4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155231 Feb 21 01:32:07.170148 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 835/1642] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:07 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:08.185912 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ecaae47b-91d0-402e-b447-bcf6a84895c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:08.189788 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ecaae47b-91d0-402e-b447-bcf6a84895c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:08.192878 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ecaae47b-91d0-402e-b447-bcf6a84895c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:08.193328 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ecaae47b-91d0-402e-b447-bcf6a84895c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:08.194104 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ecaae47b-91d0-402e-b447-bcf6a84895c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:08.194538 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ecaae47b-91d0-402e-b447-bcf6a84895c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:08.408096 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ecaae47b-91d0-402e-b447-bcf6a84895c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:08.416650 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ecaae47b-91d0-402e-b447-bcf6a84895c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.234948 Feb 21 01:32:08.417224 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 808/1643] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:08 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:08.558258 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-93a0ecf2-f284-406a-84ba-ed3c73eb2988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1125181266", "imageRef": "9b96cc67-20b9-414f-8afb-039ff7953adc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f0d0617-4e78-4e05-abc5-75ee47858c30"}], "security_groups": [{"name": "tempest-securitygroup--466766949"}], "key_name": "tempest-keypair-1902937667", "user_data": "}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:08.665397 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.network.neutron [None req-93a0ecf2-f284-406a-84ba-ed3c73eb2988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] validate_networks() for [('5f0d0617-4e78-4e05-abc5-75ee47858c30', None, None, None, None, None)] {{(pid=117139) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:32:09.084937 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-93a0ecf2-f284-406a-84ba-ed3c73eb2988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Flavor limits 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:32:09.085354 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-93a0ecf2-f284-406a-84ba-ed3c73eb2988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Image limits 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:32:09.085816 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-93a0ecf2-f284-406a-84ba-ed3c73eb2988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Flavor pref 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:32:09.086217 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-93a0ecf2-f284-406a-84ba-ed3c73eb2988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Image pref 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:32:09.086619 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-93a0ecf2-f284-406a-84ba-ed3c73eb2988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:32:09.095281 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-93a0ecf2-f284-406a-84ba-ed3c73eb2988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:09.095723 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-93a0ecf2-f284-406a-84ba-ed3c73eb2988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:09.096584 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-93a0ecf2-f284-406a-84ba-ed3c73eb2988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:09.097010 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-93a0ecf2-f284-406a-84ba-ed3c73eb2988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:09.113384 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.quota [None req-93a0ecf2-f284-406a-84ba-ed3c73eb2988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Getting quotas for project 8ef8a0b8828d4a38a7f8a9465fa9fbaf. Resources: {'ram', 'cores', 'instances'} {{(pid=117139) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:32:09.117194 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.quota [None req-93a0ecf2-f284-406a-84ba-ed3c73eb2988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Getting quotas for user 5adf4837cc254e1a951dda183d795606 and project 8ef8a0b8828d4a38a7f8a9465fa9fbaf. Resources: {'ram', 'cores', 'instances'} {{(pid=117139) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:32:09.128484 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-93a0ecf2-f284-406a-84ba-ed3c73eb2988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Going to run 1 instances... {{(pid=117139) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:32:09.130756 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-93a0ecf2-f284-406a-84ba-ed3c73eb2988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b96cc67-20b9-414f-8afb-039ff7953adc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117139) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:32:09.249250 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-93a0ecf2-f284-406a-84ba-ed3c73eb2988 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.695049 Feb 21 01:32:09.249928 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 836/1644] 10.222.0.91 () {62 vars in 1187 bytes} [Mon Feb 21 01:32:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 21 01:32:09.260333 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7ef63249-3579-4d0b-8c1c-74020455f028 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:09.260929 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7ef63249-3579-4d0b-8c1c-74020455f028 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:09.314939 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7ef63249-3579-4d0b-8c1c-74020455f028 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:09.322578 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7ef63249-3579-4d0b-8c1c-74020455f028 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:09.324107 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7ef63249-3579-4d0b-8c1c-74020455f028 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:09.325190 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7ef63249-3579-4d0b-8c1c-74020455f028 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899" status: 200 len: 1282 microversion: 2.20 time: 0.068534 Feb 21 01:32:09.325737 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 809/1645] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:09 2022] GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899 => generated 1282 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:32:09.433173 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-675c062f-3d3d-42bc-9a9d-b72496d1e53d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:09.433782 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-675c062f-3d3d-42bc-9a9d-b72496d1e53d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:09.440717 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-675c062f-3d3d-42bc-9a9d-b72496d1e53d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:09.441320 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-675c062f-3d3d-42bc-9a9d-b72496d1e53d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:09.442098 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-675c062f-3d3d-42bc-9a9d-b72496d1e53d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:09.442525 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-675c062f-3d3d-42bc-9a9d-b72496d1e53d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:09.576955 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-675c062f-3d3d-42bc-9a9d-b72496d1e53d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:09.586018 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-675c062f-3d3d-42bc-9a9d-b72496d1e53d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.156364 Feb 21 01:32:09.590141 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 837/1646] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:09 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:10.344640 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-011fea5d-39c4-4235-a9b9-c257da591670 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:10.345249 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-011fea5d-39c4-4235-a9b9-c257da591670 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:10.353300 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-011fea5d-39c4-4235-a9b9-c257da591670 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:10.353743 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-011fea5d-39c4-4235-a9b9-c257da591670 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:10.354576 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-011fea5d-39c4-4235-a9b9-c257da591670 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:10.355021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-011fea5d-39c4-4235-a9b9-c257da591670 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:10.416064 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-011fea5d-39c4-4235-a9b9-c257da591670 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:10.423952 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-011fea5d-39c4-4235-a9b9-c257da591670 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:10.425453 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-011fea5d-39c4-4235-a9b9-c257da591670 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:10.426545 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-011fea5d-39c4-4235-a9b9-c257da591670 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899" status: 200 len: 1286 microversion: 2.20 time: 0.085608 Feb 21 01:32:10.427107 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 810/1647] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:10 2022] GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:32:10.602873 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-646f6929-1ff1-4083-8a62-371bebb544b2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:10.603477 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-646f6929-1ff1-4083-8a62-371bebb544b2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:10.609936 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-646f6929-1ff1-4083-8a62-371bebb544b2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:10.610388 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-646f6929-1ff1-4083-8a62-371bebb544b2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:10.611158 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-646f6929-1ff1-4083-8a62-371bebb544b2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:10.611618 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-646f6929-1ff1-4083-8a62-371bebb544b2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:10.748345 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-646f6929-1ff1-4083-8a62-371bebb544b2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:10.756865 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-646f6929-1ff1-4083-8a62-371bebb544b2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.157646 Feb 21 01:32:10.757421 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 838/1648] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:10 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:11.444766 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c0fb05e1-8378-4ea0-804b-bfc93aaafd37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:11.445335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c0fb05e1-8378-4ea0-804b-bfc93aaafd37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:11.451451 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c0fb05e1-8378-4ea0-804b-bfc93aaafd37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:11.457400 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c0fb05e1-8378-4ea0-804b-bfc93aaafd37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:11.457400 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c0fb05e1-8378-4ea0-804b-bfc93aaafd37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:11.457400 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c0fb05e1-8378-4ea0-804b-bfc93aaafd37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:11.530061 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c0fb05e1-8378-4ea0-804b-bfc93aaafd37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:11.538585 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c0fb05e1-8378-4ea0-804b-bfc93aaafd37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:11.542599 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c0fb05e1-8378-4ea0-804b-bfc93aaafd37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:11.542599 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c0fb05e1-8378-4ea0-804b-bfc93aaafd37 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899" status: 200 len: 1352 microversion: 2.20 time: 0.100698 Feb 21 01:32:11.542599 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 811/1649] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:11 2022] GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899 => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:32:11.774179 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-52f7bdbf-df46-4f66-af13-d906b8fceba7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:11.774785 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-52f7bdbf-df46-4f66-af13-d906b8fceba7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:11.781317 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-52f7bdbf-df46-4f66-af13-d906b8fceba7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:11.781767 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-52f7bdbf-df46-4f66-af13-d906b8fceba7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:11.782548 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-52f7bdbf-df46-4f66-af13-d906b8fceba7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:11.782981 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-52f7bdbf-df46-4f66-af13-d906b8fceba7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:11.918115 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-52f7bdbf-df46-4f66-af13-d906b8fceba7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:11.926836 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-52f7bdbf-df46-4f66-af13-d906b8fceba7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.156305 Feb 21 01:32:11.927410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 839/1650] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:11 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:12.561453 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-432becb2-e9c3-49ff-bb14-e9bede87d967 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:12.562102 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-432becb2-e9c3-49ff-bb14-e9bede87d967 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:12.570635 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-432becb2-e9c3-49ff-bb14-e9bede87d967 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:12.571204 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-432becb2-e9c3-49ff-bb14-e9bede87d967 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:12.572400 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-432becb2-e9c3-49ff-bb14-e9bede87d967 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:12.573283 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-432becb2-e9c3-49ff-bb14-e9bede87d967 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:12.802028 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-432becb2-e9c3-49ff-bb14-e9bede87d967 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:12.811773 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-432becb2-e9c3-49ff-bb14-e9bede87d967 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:12.813408 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-432becb2-e9c3-49ff-bb14-e9bede87d967 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:12.814544 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-432becb2-e9c3-49ff-bb14-e9bede87d967 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899" status: 200 len: 1407 microversion: 2.20 time: 0.256954 Feb 21 01:32:12.815809 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 812/1651] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:12 2022] GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:32:12.943678 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c5370faa-4df9-4a64-b779-e892db413aac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:12.944307 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c5370faa-4df9-4a64-b779-e892db413aac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:12.950553 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c5370faa-4df9-4a64-b779-e892db413aac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:12.951973 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c5370faa-4df9-4a64-b779-e892db413aac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:12.951973 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c5370faa-4df9-4a64-b779-e892db413aac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:12.952204 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c5370faa-4df9-4a64-b779-e892db413aac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:12.969970 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-1f45790d-4dd6-4826-81db-ced1721ca23c req-e161c046-65fd-48f1-bcb3-a0dec7f35438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8a1c406-f790-40a9-80d8-975e707b8899", "tag": "83a888b1-da52-44e7-9486-c1020c3facd8"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:12.971658 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:32:12.971658 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:32:12.979790 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-1f45790d-4dd6-4826-81db-ced1721ca23c req-e161c046-65fd-48f1-bcb3-a0dec7f35438 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:12.980274 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-1f45790d-4dd6-4826-81db-ced1721ca23c req-e161c046-65fd-48f1-bcb3-a0dec7f35438 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:13.001131 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-1f45790d-4dd6-4826-81db-ced1721ca23c req-e161c046-65fd-48f1-bcb3-a0dec7f35438 service nova] Creating event network-changed:83a888b1-da52-44e7-9486-c1020c3facd8 for instance d8a1c406-f790-40a9-80d8-975e707b8899 on hv-cinder-81322 Feb 21 01:32:13.008271 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-1f45790d-4dd6-4826-81db-ced1721ca23c req-e161c046-65fd-48f1-bcb3-a0dec7f35438 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043370 Feb 21 01:32:13.009092 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 813/1652] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:32:13.121345 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c5370faa-4df9-4a64-b779-e892db413aac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:13.130485 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c5370faa-4df9-4a64-b779-e892db413aac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.191237 Feb 21 01:32:13.131056 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 840/1653] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:12 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:13.834921 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-10a57e8f-c2fe-4b02-bbcd-47128a12ccf3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:13.835618 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-10a57e8f-c2fe-4b02-bbcd-47128a12ccf3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:13.841828 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-10a57e8f-c2fe-4b02-bbcd-47128a12ccf3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:13.842275 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-10a57e8f-c2fe-4b02-bbcd-47128a12ccf3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:13.843052 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-10a57e8f-c2fe-4b02-bbcd-47128a12ccf3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:13.843481 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-10a57e8f-c2fe-4b02-bbcd-47128a12ccf3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:14.009450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-10a57e8f-c2fe-4b02-bbcd-47128a12ccf3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:14.017133 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-10a57e8f-c2fe-4b02-bbcd-47128a12ccf3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:14.019267 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-10a57e8f-c2fe-4b02-bbcd-47128a12ccf3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:14.020395 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-10a57e8f-c2fe-4b02-bbcd-47128a12ccf3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899" status: 200 len: 1407 microversion: 2.20 time: 0.190667 Feb 21 01:32:14.020952 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 814/1654] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:13 2022] GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:32:14.147745 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-843e3e4c-da0d-4d9e-b24d-a3a2844e63a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:14.148379 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-843e3e4c-da0d-4d9e-b24d-a3a2844e63a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:14.154745 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-843e3e4c-da0d-4d9e-b24d-a3a2844e63a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:14.155185 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-843e3e4c-da0d-4d9e-b24d-a3a2844e63a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:14.155987 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-843e3e4c-da0d-4d9e-b24d-a3a2844e63a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:14.156418 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-843e3e4c-da0d-4d9e-b24d-a3a2844e63a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:14.285602 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-843e3e4c-da0d-4d9e-b24d-a3a2844e63a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:14.293325 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-843e3e4c-da0d-4d9e-b24d-a3a2844e63a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.149229 Feb 21 01:32:14.293880 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 841/1655] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:14 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:15.043302 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cba12b71-cee0-4587-a07f-c200e95b3f5f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:15.043948 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cba12b71-cee0-4587-a07f-c200e95b3f5f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:15.050337 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cba12b71-cee0-4587-a07f-c200e95b3f5f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:15.050785 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cba12b71-cee0-4587-a07f-c200e95b3f5f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:15.051564 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cba12b71-cee0-4587-a07f-c200e95b3f5f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:15.052041 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cba12b71-cee0-4587-a07f-c200e95b3f5f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:15.180931 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cba12b71-cee0-4587-a07f-c200e95b3f5f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:15.188711 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cba12b71-cee0-4587-a07f-c200e95b3f5f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:15.190255 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cba12b71-cee0-4587-a07f-c200e95b3f5f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:15.191357 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cba12b71-cee0-4587-a07f-c200e95b3f5f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899" status: 200 len: 1407 microversion: 2.20 time: 0.151856 Feb 21 01:32:15.191937 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 815/1656] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:15 2022] GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:32:15.310920 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-94979d04-b6d0-4d73-b5ca-1c34c2f1f445 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:15.311558 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-94979d04-b6d0-4d73-b5ca-1c34c2f1f445 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:15.318490 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-94979d04-b6d0-4d73-b5ca-1c34c2f1f445 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:15.318939 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-94979d04-b6d0-4d73-b5ca-1c34c2f1f445 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:15.319725 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-94979d04-b6d0-4d73-b5ca-1c34c2f1f445 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:15.320207 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-94979d04-b6d0-4d73-b5ca-1c34c2f1f445 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:15.457766 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-94979d04-b6d0-4d73-b5ca-1c34c2f1f445 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:15.465483 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-94979d04-b6d0-4d73-b5ca-1c34c2f1f445 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.158263 Feb 21 01:32:15.466041 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 842/1657] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:15 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:16.209539 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-01a82ecd-970e-492a-a295-1b42e486009f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:16.210344 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-01a82ecd-970e-492a-a295-1b42e486009f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:16.216534 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-01a82ecd-970e-492a-a295-1b42e486009f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:16.216980 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-01a82ecd-970e-492a-a295-1b42e486009f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:16.217753 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-01a82ecd-970e-492a-a295-1b42e486009f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:16.218188 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-01a82ecd-970e-492a-a295-1b42e486009f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:16.352076 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-01a82ecd-970e-492a-a295-1b42e486009f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:16.359916 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-01a82ecd-970e-492a-a295-1b42e486009f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:16.361447 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-01a82ecd-970e-492a-a295-1b42e486009f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:16.363161 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-01a82ecd-970e-492a-a295-1b42e486009f tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899" status: 200 len: 1407 microversion: 2.20 time: 0.158130 Feb 21 01:32:16.363722 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 816/1658] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:16 2022] GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:32:16.482766 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b1185e0d-08f5-431c-bdb3-d4d518da282e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:16.483440 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b1185e0d-08f5-431c-bdb3-d4d518da282e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:16.490559 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b1185e0d-08f5-431c-bdb3-d4d518da282e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:16.491198 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b1185e0d-08f5-431c-bdb3-d4d518da282e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:16.492303 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b1185e0d-08f5-431c-bdb3-d4d518da282e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:16.492927 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b1185e0d-08f5-431c-bdb3-d4d518da282e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:16.632609 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b1185e0d-08f5-431c-bdb3-d4d518da282e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:16.640798 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b1185e0d-08f5-431c-bdb3-d4d518da282e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.162225 Feb 21 01:32:16.641359 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 843/1659] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:16 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:17.381193 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5935a7a5-17f6-41d8-8f9d-49ce1834d568 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:17.381737 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5935a7a5-17f6-41d8-8f9d-49ce1834d568 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:17.387936 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5935a7a5-17f6-41d8-8f9d-49ce1834d568 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:17.388377 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5935a7a5-17f6-41d8-8f9d-49ce1834d568 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:17.389185 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5935a7a5-17f6-41d8-8f9d-49ce1834d568 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:17.389606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5935a7a5-17f6-41d8-8f9d-49ce1834d568 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:17.522355 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5935a7a5-17f6-41d8-8f9d-49ce1834d568 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:17.530056 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5935a7a5-17f6-41d8-8f9d-49ce1834d568 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:17.531575 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5935a7a5-17f6-41d8-8f9d-49ce1834d568 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:17.532692 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5935a7a5-17f6-41d8-8f9d-49ce1834d568 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899" status: 200 len: 1407 microversion: 2.20 time: 0.155914 Feb 21 01:32:17.534119 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 817/1660] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:17 2022] GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:32:17.658264 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1efca922-651d-412f-894b-cff237238333 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:17.659433 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1efca922-651d-412f-894b-cff237238333 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:17.665665 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1efca922-651d-412f-894b-cff237238333 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:17.666102 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1efca922-651d-412f-894b-cff237238333 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:17.666873 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1efca922-651d-412f-894b-cff237238333 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:17.667298 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1efca922-651d-412f-894b-cff237238333 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:17.796963 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1efca922-651d-412f-894b-cff237238333 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:17.805287 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1efca922-651d-412f-894b-cff237238333 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.150761 Feb 21 01:32:17.805842 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 844/1661] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:17 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:18.555334 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-aaf51116-bd73-4b8b-9736-b520dd77c7ec tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:18.555950 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-aaf51116-bd73-4b8b-9736-b520dd77c7ec tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:18.562220 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-aaf51116-bd73-4b8b-9736-b520dd77c7ec tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:18.562657 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-aaf51116-bd73-4b8b-9736-b520dd77c7ec tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:18.563416 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-aaf51116-bd73-4b8b-9736-b520dd77c7ec tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:18.563855 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-aaf51116-bd73-4b8b-9736-b520dd77c7ec tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:18.714850 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-aaf51116-bd73-4b8b-9736-b520dd77c7ec tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:18.722666 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-aaf51116-bd73-4b8b-9736-b520dd77c7ec tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:18.724171 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-aaf51116-bd73-4b8b-9736-b520dd77c7ec tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:18.725327 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-aaf51116-bd73-4b8b-9736-b520dd77c7ec tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899" status: 200 len: 1407 microversion: 2.20 time: 0.173642 Feb 21 01:32:18.725809 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 818/1662] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:18 2022] GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:32:18.822381 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-59221bad-db9a-48d0-9fc5-fca19379b1b0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:18.823118 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-59221bad-db9a-48d0-9fc5-fca19379b1b0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:18.829351 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-59221bad-db9a-48d0-9fc5-fca19379b1b0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:18.829797 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-59221bad-db9a-48d0-9fc5-fca19379b1b0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:18.830896 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-59221bad-db9a-48d0-9fc5-fca19379b1b0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:18.831347 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-59221bad-db9a-48d0-9fc5-fca19379b1b0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:18.897594 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-37e3842a-2cf4-4287-80f9-547ed282db9e req-295fc268-b987-4d9a-9bae-98134c59e92b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8a1c406-f790-40a9-80d8-975e707b8899", "name": "network-vif-plugged", "status": "completed", "tag": "83a888b1-da52-44e7-9486-c1020c3facd8"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:18.899261 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:32:18.899261 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:32:18.906308 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-37e3842a-2cf4-4287-80f9-547ed282db9e req-295fc268-b987-4d9a-9bae-98134c59e92b service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:18.906898 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-37e3842a-2cf4-4287-80f9-547ed282db9e req-295fc268-b987-4d9a-9bae-98134c59e92b service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:18.917718 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-37e3842a-2cf4-4287-80f9-547ed282db9e req-295fc268-b987-4d9a-9bae-98134c59e92b service nova] Creating event network-vif-plugged:83a888b1-da52-44e7-9486-c1020c3facd8 for instance d8a1c406-f790-40a9-80d8-975e707b8899 on hv-cinder-81322 Feb 21 01:32:18.923415 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-37e3842a-2cf4-4287-80f9-547ed282db9e req-295fc268-b987-4d9a-9bae-98134c59e92b service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090593 Feb 21 01:32:18.924680 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 819/1663] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:32:18.980248 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-59221bad-db9a-48d0-9fc5-fca19379b1b0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:18.993366 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-59221bad-db9a-48d0-9fc5-fca19379b1b0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.171452 Feb 21 01:32:18.993366 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 845/1664] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:18 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:19.747654 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b4efdbf7-0ece-4747-a399-ab13a1cb26f0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:19.748458 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b4efdbf7-0ece-4747-a399-ab13a1cb26f0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:19.755584 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b4efdbf7-0ece-4747-a399-ab13a1cb26f0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:19.756151 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b4efdbf7-0ece-4747-a399-ab13a1cb26f0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:19.756940 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b4efdbf7-0ece-4747-a399-ab13a1cb26f0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:19.757516 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b4efdbf7-0ece-4747-a399-ab13a1cb26f0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:19.893897 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b4efdbf7-0ece-4747-a399-ab13a1cb26f0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:19.901522 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b4efdbf7-0ece-4747-a399-ab13a1cb26f0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:19.902987 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b4efdbf7-0ece-4747-a399-ab13a1cb26f0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:19.904130 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b4efdbf7-0ece-4747-a399-ab13a1cb26f0 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899" status: 200 len: 1407 microversion: 2.20 time: 0.161319 Feb 21 01:32:19.904678 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 820/1665] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:19 2022] GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:32:20.007766 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b1e22fa6-82c5-4794-82ce-3faad1c6d9d9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:20.008397 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b1e22fa6-82c5-4794-82ce-3faad1c6d9d9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:20.014656 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b1e22fa6-82c5-4794-82ce-3faad1c6d9d9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:20.015109 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b1e22fa6-82c5-4794-82ce-3faad1c6d9d9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:20.015916 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b1e22fa6-82c5-4794-82ce-3faad1c6d9d9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:20.016352 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b1e22fa6-82c5-4794-82ce-3faad1c6d9d9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:20.145380 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b1e22fa6-82c5-4794-82ce-3faad1c6d9d9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:20.152948 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b1e22fa6-82c5-4794-82ce-3faad1c6d9d9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.148829 Feb 21 01:32:20.153533 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 846/1666] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:20 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:20.921909 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3cc9f01f-334f-4fba-9d71-9187fe5fbcc8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:20.922510 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3cc9f01f-334f-4fba-9d71-9187fe5fbcc8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:20.928756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3cc9f01f-334f-4fba-9d71-9187fe5fbcc8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:20.929192 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3cc9f01f-334f-4fba-9d71-9187fe5fbcc8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:20.929985 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3cc9f01f-334f-4fba-9d71-9187fe5fbcc8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:20.930413 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3cc9f01f-334f-4fba-9d71-9187fe5fbcc8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:21.069556 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3cc9f01f-334f-4fba-9d71-9187fe5fbcc8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:21.077196 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3cc9f01f-334f-4fba-9d71-9187fe5fbcc8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:21.078662 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3cc9f01f-334f-4fba-9d71-9187fe5fbcc8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:21.079812 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3cc9f01f-334f-4fba-9d71-9187fe5fbcc8 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899" status: 200 len: 1600 microversion: 2.20 time: 0.161587 Feb 21 01:32:21.081110 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 821/1667] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:20 2022] GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:32:21.098032 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9668a230-abc5-4859-8bfe-25741bdb01ca tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:21.098542 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9668a230-abc5-4859-8bfe-25741bdb01ca tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:21.104743 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9668a230-abc5-4859-8bfe-25741bdb01ca tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:21.105189 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9668a230-abc5-4859-8bfe-25741bdb01ca tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:21.105971 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9668a230-abc5-4859-8bfe-25741bdb01ca tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:21.106408 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9668a230-abc5-4859-8bfe-25741bdb01ca tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:21.169706 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-710859dc-53a4-470a-ad66-f5a8c8e232b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:21.170312 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-710859dc-53a4-470a-ad66-f5a8c8e232b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:21.176033 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-710859dc-53a4-470a-ad66-f5a8c8e232b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:21.176489 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-710859dc-53a4-470a-ad66-f5a8c8e232b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:21.177278 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-710859dc-53a4-470a-ad66-f5a8c8e232b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:21.177712 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-710859dc-53a4-470a-ad66-f5a8c8e232b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:21.186139 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9668a230-abc5-4859-8bfe-25741bdb01ca tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092309 Feb 21 01:32:21.186721 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 847/1668] 10.222.0.91 () {60 vars in 1315 bytes} [Mon Feb 21 01:32:21 2022] GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:32:21.308771 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-710859dc-53a4-470a-ad66-f5a8c8e232b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:21.317063 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-710859dc-53a4-470a-ad66-f5a8c8e232b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.150968 Feb 21 01:32:21.317631 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 822/1669] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:21 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:22.333829 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e69a0389-125f-42a8-9640-2382522f9870 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:22.334444 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e69a0389-125f-42a8-9640-2382522f9870 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:22.340134 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e69a0389-125f-42a8-9640-2382522f9870 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:22.340580 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e69a0389-125f-42a8-9640-2382522f9870 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:22.341348 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e69a0389-125f-42a8-9640-2382522f9870 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:22.341774 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e69a0389-125f-42a8-9640-2382522f9870 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:22.562078 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-125a966a-7889-4e2a-b8d3-3c1d6fcda957 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:22.562603 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-125a966a-7889-4e2a-b8d3-3c1d6fcda957 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:22.566577 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e69a0389-125f-42a8-9640-2382522f9870 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:22.569190 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-125a966a-7889-4e2a-b8d3-3c1d6fcda957 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:22.569646 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-125a966a-7889-4e2a-b8d3-3c1d6fcda957 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:22.570473 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-125a966a-7889-4e2a-b8d3-3c1d6fcda957 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:22.570908 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-125a966a-7889-4e2a-b8d3-3c1d6fcda957 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:22.575225 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e69a0389-125f-42a8-9640-2382522f9870 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.245677 Feb 21 01:32:22.575939 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 848/1670] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:22 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:22.596854 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-125a966a-7889-4e2a-b8d3-3c1d6fcda957 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899/ips" status: 200 len: 113 microversion: 2.20 time: 0.037897 Feb 21 01:32:22.597969 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 823/1671] 10.222.0.91 () {60 vars in 1288 bytes} [Mon Feb 21 01:32:22 2022] GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899/ips => generated 113 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:32:22.647905 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-0b36e452-69b3-4342-8c26-92a417a2a6d8 req-46a44a6d-009d-467e-b012-0d780d52d5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8a1c406-f790-40a9-80d8-975e707b8899", "tag": "83a888b1-da52-44e7-9486-c1020c3facd8"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:22.649383 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:32:22.649383 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:32:22.656154 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-0b36e452-69b3-4342-8c26-92a417a2a6d8 req-46a44a6d-009d-467e-b012-0d780d52d5c4 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:22.656603 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-0b36e452-69b3-4342-8c26-92a417a2a6d8 req-46a44a6d-009d-467e-b012-0d780d52d5c4 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:22.668094 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-0b36e452-69b3-4342-8c26-92a417a2a6d8 req-46a44a6d-009d-467e-b012-0d780d52d5c4 service nova] Creating event network-changed:83a888b1-da52-44e7-9486-c1020c3facd8 for instance d8a1c406-f790-40a9-80d8-975e707b8899 on hv-cinder-81322 Feb 21 01:32:22.673190 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-0b36e452-69b3-4342-8c26-92a417a2a6d8 req-46a44a6d-009d-467e-b012-0d780d52d5c4 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096061 Feb 21 01:32:22.673814 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 849/1672] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:32:23.592548 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-bf696012-2868-43d3-9cd4-9942e99b75f4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:23.593261 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-bf696012-2868-43d3-9cd4-9942e99b75f4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:23.600566 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bf696012-2868-43d3-9cd4-9942e99b75f4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:23.601094 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bf696012-2868-43d3-9cd4-9942e99b75f4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:23.601954 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bf696012-2868-43d3-9cd4-9942e99b75f4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:23.602480 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bf696012-2868-43d3-9cd4-9942e99b75f4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:23.738085 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bf696012-2868-43d3-9cd4-9942e99b75f4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:23.746017 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-bf696012-2868-43d3-9cd4-9942e99b75f4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.157290 Feb 21 01:32:23.748772 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 824/1673] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:23 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:24.765032 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3b7a10aa-76b6-4d10-97c4-c8047d4958cb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:24.765713 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3b7a10aa-76b6-4d10-97c4-c8047d4958cb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:24.772903 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b7a10aa-76b6-4d10-97c4-c8047d4958cb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:24.773348 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b7a10aa-76b6-4d10-97c4-c8047d4958cb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:24.774124 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b7a10aa-76b6-4d10-97c4-c8047d4958cb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:24.774560 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b7a10aa-76b6-4d10-97c4-c8047d4958cb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:24.911526 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3b7a10aa-76b6-4d10-97c4-c8047d4958cb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:24.919234 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3b7a10aa-76b6-4d10-97c4-c8047d4958cb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.158716 Feb 21 01:32:24.919798 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 850/1674] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:24 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:25.936284 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-20b9f779-207a-4131-9ed9-f96ebb2f3b17 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:25.936824 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-20b9f779-207a-4131-9ed9-f96ebb2f3b17 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:25.943368 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-20b9f779-207a-4131-9ed9-f96ebb2f3b17 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:25.943818 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-20b9f779-207a-4131-9ed9-f96ebb2f3b17 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:25.944629 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-20b9f779-207a-4131-9ed9-f96ebb2f3b17 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:25.945066 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-20b9f779-207a-4131-9ed9-f96ebb2f3b17 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:26.078097 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-20b9f779-207a-4131-9ed9-f96ebb2f3b17 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:26.086241 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-20b9f779-207a-4131-9ed9-f96ebb2f3b17 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.153718 Feb 21 01:32:26.086801 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 825/1675] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:25 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:27.102399 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8f6d53fc-593b-4287-aa14-b6ef4fdd57ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:27.103006 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8f6d53fc-593b-4287-aa14-b6ef4fdd57ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:27.109189 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8f6d53fc-593b-4287-aa14-b6ef4fdd57ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:27.109631 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8f6d53fc-593b-4287-aa14-b6ef4fdd57ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:27.110398 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8f6d53fc-593b-4287-aa14-b6ef4fdd57ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:27.110819 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8f6d53fc-593b-4287-aa14-b6ef4fdd57ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:27.241125 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8f6d53fc-593b-4287-aa14-b6ef4fdd57ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:27.249102 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8f6d53fc-593b-4287-aa14-b6ef4fdd57ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.150345 Feb 21 01:32:27.249670 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 851/1676] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:27 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:28.266293 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0065919f-a42d-47d9-9f97-c48cfe51ae2e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:28.266904 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0065919f-a42d-47d9-9f97-c48cfe51ae2e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:28.274300 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0065919f-a42d-47d9-9f97-c48cfe51ae2e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:28.274749 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0065919f-a42d-47d9-9f97-c48cfe51ae2e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:28.275525 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0065919f-a42d-47d9-9f97-c48cfe51ae2e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:28.276015 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0065919f-a42d-47d9-9f97-c48cfe51ae2e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:28.410230 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0065919f-a42d-47d9-9f97-c48cfe51ae2e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:28.418074 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0065919f-a42d-47d9-9f97-c48cfe51ae2e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155482 Feb 21 01:32:28.418633 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 826/1677] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:28 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:29.435960 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8fc453c1-0aaf-4427-934f-68dd23b872a5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:29.436579 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8fc453c1-0aaf-4427-934f-68dd23b872a5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:29.443498 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8fc453c1-0aaf-4427-934f-68dd23b872a5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:29.443979 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8fc453c1-0aaf-4427-934f-68dd23b872a5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:29.444776 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8fc453c1-0aaf-4427-934f-68dd23b872a5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:29.445220 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8fc453c1-0aaf-4427-934f-68dd23b872a5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:29.585100 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8fc453c1-0aaf-4427-934f-68dd23b872a5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:29.592732 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8fc453c1-0aaf-4427-934f-68dd23b872a5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.160520 Feb 21 01:32:29.593289 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 852/1678] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:29 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:30.610210 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8b262f3b-0143-4f7e-b3ff-59c47e15e246 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:30.610842 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8b262f3b-0143-4f7e-b3ff-59c47e15e246 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:30.617170 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8b262f3b-0143-4f7e-b3ff-59c47e15e246 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:30.617628 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8b262f3b-0143-4f7e-b3ff-59c47e15e246 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:30.618436 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8b262f3b-0143-4f7e-b3ff-59c47e15e246 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:30.618875 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8b262f3b-0143-4f7e-b3ff-59c47e15e246 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:30.758143 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8b262f3b-0143-4f7e-b3ff-59c47e15e246 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:30.765801 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8b262f3b-0143-4f7e-b3ff-59c47e15e246 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.159176 Feb 21 01:32:30.766353 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 827/1679] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:30 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:31.782056 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c5004ed6-ac67-4380-b31f-9e43610339be tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:31.783165 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c5004ed6-ac67-4380-b31f-9e43610339be tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:31.789314 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c5004ed6-ac67-4380-b31f-9e43610339be tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:31.789757 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c5004ed6-ac67-4380-b31f-9e43610339be tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:31.790526 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c5004ed6-ac67-4380-b31f-9e43610339be tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:31.790959 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c5004ed6-ac67-4380-b31f-9e43610339be tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:31.925509 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c5004ed6-ac67-4380-b31f-9e43610339be tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:31.933253 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c5004ed6-ac67-4380-b31f-9e43610339be tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154676 Feb 21 01:32:31.933749 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 853/1680] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:31 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:32.949562 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ec983cb8-5180-4306-8630-7f777d34f3ec tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:32.950183 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ec983cb8-5180-4306-8630-7f777d34f3ec tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:32.956965 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec983cb8-5180-4306-8630-7f777d34f3ec tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:32.957416 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec983cb8-5180-4306-8630-7f777d34f3ec tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:32.958200 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec983cb8-5180-4306-8630-7f777d34f3ec tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:32.958636 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec983cb8-5180-4306-8630-7f777d34f3ec tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:33.089902 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ec983cb8-5180-4306-8630-7f777d34f3ec tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:33.097677 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ec983cb8-5180-4306-8630-7f777d34f3ec tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151743 Feb 21 01:32:33.098250 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 828/1681] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:32 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:34.114482 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-110e0143-dd16-428f-b650-4dc66851dc4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:34.115103 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-110e0143-dd16-428f-b650-4dc66851dc4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:34.121594 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-110e0143-dd16-428f-b650-4dc66851dc4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:34.122042 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-110e0143-dd16-428f-b650-4dc66851dc4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:34.122820 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-110e0143-dd16-428f-b650-4dc66851dc4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:34.123257 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-110e0143-dd16-428f-b650-4dc66851dc4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:34.260462 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-110e0143-dd16-428f-b650-4dc66851dc4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:34.268872 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-110e0143-dd16-428f-b650-4dc66851dc4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.158324 Feb 21 01:32:34.269420 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 854/1682] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:34 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:35.286294 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0f45f1be-fd28-4f28-a58e-79b04f4fa550 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:35.286899 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0f45f1be-fd28-4f28-a58e-79b04f4fa550 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:35.293273 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0f45f1be-fd28-4f28-a58e-79b04f4fa550 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:35.293710 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0f45f1be-fd28-4f28-a58e-79b04f4fa550 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:35.294468 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0f45f1be-fd28-4f28-a58e-79b04f4fa550 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:35.294894 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0f45f1be-fd28-4f28-a58e-79b04f4fa550 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:35.427860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0f45f1be-fd28-4f28-a58e-79b04f4fa550 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:35.435567 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0f45f1be-fd28-4f28-a58e-79b04f4fa550 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.153729 Feb 21 01:32:35.436165 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 829/1683] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:35 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:36.452764 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1e8d9e15-25c9-4e52-9c07-9ec43256cb1b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:36.453406 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1e8d9e15-25c9-4e52-9c07-9ec43256cb1b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:36.460348 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e8d9e15-25c9-4e52-9c07-9ec43256cb1b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:36.460801 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e8d9e15-25c9-4e52-9c07-9ec43256cb1b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:36.461575 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e8d9e15-25c9-4e52-9c07-9ec43256cb1b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:36.462012 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e8d9e15-25c9-4e52-9c07-9ec43256cb1b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:36.590340 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1e8d9e15-25c9-4e52-9c07-9ec43256cb1b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:36.598172 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1e8d9e15-25c9-4e52-9c07-9ec43256cb1b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.149079 Feb 21 01:32:36.598737 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 855/1684] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:36 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:37.614701 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0c4b0dad-8a2a-4c3e-95b0-8d6c960f3a47 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:37.615235 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0c4b0dad-8a2a-4c3e-95b0-8d6c960f3a47 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:37.621756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c4b0dad-8a2a-4c3e-95b0-8d6c960f3a47 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:37.622207 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c4b0dad-8a2a-4c3e-95b0-8d6c960f3a47 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:37.622981 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c4b0dad-8a2a-4c3e-95b0-8d6c960f3a47 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:37.623412 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c4b0dad-8a2a-4c3e-95b0-8d6c960f3a47 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:37.758856 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0c4b0dad-8a2a-4c3e-95b0-8d6c960f3a47 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:37.766491 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0c4b0dad-8a2a-4c3e-95b0-8d6c960f3a47 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155511 Feb 21 01:32:37.767717 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 830/1685] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:37 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:38.784524 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-bc705dc8-0950-460e-a0ce-529f228cdead tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:38.785131 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-bc705dc8-0950-460e-a0ce-529f228cdead tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:38.791299 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bc705dc8-0950-460e-a0ce-529f228cdead tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:38.791738 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bc705dc8-0950-460e-a0ce-529f228cdead tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:38.792531 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bc705dc8-0950-460e-a0ce-529f228cdead tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:38.792956 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bc705dc8-0950-460e-a0ce-529f228cdead tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:38.924805 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-bc705dc8-0950-460e-a0ce-529f228cdead tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:38.932893 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-bc705dc8-0950-460e-a0ce-529f228cdead tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152674 Feb 21 01:32:38.933451 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 856/1686] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:38 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:39.949733 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-dcdb22bc-43c2-4eb5-88b5-59757e5a3e64 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:39.950337 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-dcdb22bc-43c2-4eb5-88b5-59757e5a3e64 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:39.956855 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dcdb22bc-43c2-4eb5-88b5-59757e5a3e64 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:39.957303 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dcdb22bc-43c2-4eb5-88b5-59757e5a3e64 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:39.958075 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dcdb22bc-43c2-4eb5-88b5-59757e5a3e64 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:39.958520 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dcdb22bc-43c2-4eb5-88b5-59757e5a3e64 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:40.088192 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-dcdb22bc-43c2-4eb5-88b5-59757e5a3e64 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:40.096597 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-dcdb22bc-43c2-4eb5-88b5-59757e5a3e64 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.150525 Feb 21 01:32:40.097214 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 831/1687] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:39 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:41.112873 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-36e0d0f6-ca01-477c-b876-8c758b35e039 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:41.113481 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-36e0d0f6-ca01-477c-b876-8c758b35e039 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:41.119672 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-36e0d0f6-ca01-477c-b876-8c758b35e039 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:41.120148 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-36e0d0f6-ca01-477c-b876-8c758b35e039 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:41.121171 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-36e0d0f6-ca01-477c-b876-8c758b35e039 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:41.121596 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-36e0d0f6-ca01-477c-b876-8c758b35e039 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:41.262229 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-36e0d0f6-ca01-477c-b876-8c758b35e039 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:41.269837 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-36e0d0f6-ca01-477c-b876-8c758b35e039 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.160722 Feb 21 01:32:41.270388 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 857/1688] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:41 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:42.287379 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a43eb592-0502-4ca1-a4c4-558bae72719c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:42.288025 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a43eb592-0502-4ca1-a4c4-558bae72719c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:42.294360 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a43eb592-0502-4ca1-a4c4-558bae72719c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:42.294812 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a43eb592-0502-4ca1-a4c4-558bae72719c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:42.295587 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a43eb592-0502-4ca1-a4c4-558bae72719c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:42.296055 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a43eb592-0502-4ca1-a4c4-558bae72719c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:42.437898 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a43eb592-0502-4ca1-a4c4-558bae72719c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:42.445957 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a43eb592-0502-4ca1-a4c4-558bae72719c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.162291 Feb 21 01:32:42.446709 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 832/1689] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:42 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:43.462374 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-672c41e0-51ba-45a9-8210-7e1f2f11c06d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:43.463058 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-672c41e0-51ba-45a9-8210-7e1f2f11c06d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:43.469115 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-672c41e0-51ba-45a9-8210-7e1f2f11c06d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:43.469656 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-672c41e0-51ba-45a9-8210-7e1f2f11c06d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:43.470565 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-672c41e0-51ba-45a9-8210-7e1f2f11c06d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:43.471069 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-672c41e0-51ba-45a9-8210-7e1f2f11c06d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:43.608428 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-672c41e0-51ba-45a9-8210-7e1f2f11c06d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:43.617045 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-672c41e0-51ba-45a9-8210-7e1f2f11c06d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.158593 Feb 21 01:32:43.617603 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 858/1690] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:43 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:44.634888 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2d5dd8cc-925c-48f0-bde5-4c7ec2b8b713 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:44.635495 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2d5dd8cc-925c-48f0-bde5-4c7ec2b8b713 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:44.643646 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2d5dd8cc-925c-48f0-bde5-4c7ec2b8b713 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:44.644124 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2d5dd8cc-925c-48f0-bde5-4c7ec2b8b713 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:44.644920 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2d5dd8cc-925c-48f0-bde5-4c7ec2b8b713 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:44.645352 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2d5dd8cc-925c-48f0-bde5-4c7ec2b8b713 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:44.800666 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2d5dd8cc-925c-48f0-bde5-4c7ec2b8b713 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:44.808368 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2d5dd8cc-925c-48f0-bde5-4c7ec2b8b713 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.177731 Feb 21 01:32:44.808929 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 833/1691] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:44 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:45.825725 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-afc40a20-61fc-4460-a1bb-45fcac35c667 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:45.826387 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-afc40a20-61fc-4460-a1bb-45fcac35c667 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:45.833280 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-afc40a20-61fc-4460-a1bb-45fcac35c667 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:45.833725 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-afc40a20-61fc-4460-a1bb-45fcac35c667 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:45.834496 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-afc40a20-61fc-4460-a1bb-45fcac35c667 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:45.834922 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-afc40a20-61fc-4460-a1bb-45fcac35c667 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:45.973323 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-afc40a20-61fc-4460-a1bb-45fcac35c667 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:45.980991 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-afc40a20-61fc-4460-a1bb-45fcac35c667 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.159036 Feb 21 01:32:45.981548 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 859/1692] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:45 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:46.998219 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-62446071-f630-4b50-b553-ab3139f27c8f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:46.998839 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-62446071-f630-4b50-b553-ab3139f27c8f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:47.005071 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-62446071-f630-4b50-b553-ab3139f27c8f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:47.005519 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-62446071-f630-4b50-b553-ab3139f27c8f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:47.006295 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-62446071-f630-4b50-b553-ab3139f27c8f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:47.006728 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-62446071-f630-4b50-b553-ab3139f27c8f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:47.138179 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-62446071-f630-4b50-b553-ab3139f27c8f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:47.146449 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-62446071-f630-4b50-b553-ab3139f27c8f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152184 Feb 21 01:32:47.147011 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 834/1693] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:46 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:48.165228 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8d8a4041-6ff8-4a3c-a7fd-fd790843e4a6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:48.165923 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8d8a4041-6ff8-4a3c-a7fd-fd790843e4a6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:48.174216 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8d8a4041-6ff8-4a3c-a7fd-fd790843e4a6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:48.174654 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8d8a4041-6ff8-4a3c-a7fd-fd790843e4a6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:48.175500 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8d8a4041-6ff8-4a3c-a7fd-fd790843e4a6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:48.175953 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8d8a4041-6ff8-4a3c-a7fd-fd790843e4a6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:48.306261 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8d8a4041-6ff8-4a3c-a7fd-fd790843e4a6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:48.314048 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8d8a4041-6ff8-4a3c-a7fd-fd790843e4a6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154444 Feb 21 01:32:48.315027 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 860/1694] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:48 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:49.331335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3fdde45d-63e5-4d9a-995d-78a3f69e0e57 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:49.331979 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3fdde45d-63e5-4d9a-995d-78a3f69e0e57 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:49.338202 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3fdde45d-63e5-4d9a-995d-78a3f69e0e57 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:49.338654 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3fdde45d-63e5-4d9a-995d-78a3f69e0e57 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:49.339433 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3fdde45d-63e5-4d9a-995d-78a3f69e0e57 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:49.339896 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3fdde45d-63e5-4d9a-995d-78a3f69e0e57 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:49.475068 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3fdde45d-63e5-4d9a-995d-78a3f69e0e57 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:49.482658 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3fdde45d-63e5-4d9a-995d-78a3f69e0e57 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155971 Feb 21 01:32:49.483214 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 835/1695] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:49 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:50.500292 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a27f484d-75e0-4b90-9d6d-a95d12bf051b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:50.500897 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a27f484d-75e0-4b90-9d6d-a95d12bf051b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:50.507121 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a27f484d-75e0-4b90-9d6d-a95d12bf051b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:50.507570 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a27f484d-75e0-4b90-9d6d-a95d12bf051b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:50.508370 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a27f484d-75e0-4b90-9d6d-a95d12bf051b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:50.508797 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a27f484d-75e0-4b90-9d6d-a95d12bf051b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:50.637897 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a27f484d-75e0-4b90-9d6d-a95d12bf051b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:50.645490 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a27f484d-75e0-4b90-9d6d-a95d12bf051b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.148938 Feb 21 01:32:50.646040 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 861/1696] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:50 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:51.662662 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9331da2f-f8d3-4c7f-a265-988bb57beeae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:51.663223 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9331da2f-f8d3-4c7f-a265-988bb57beeae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:51.669465 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9331da2f-f8d3-4c7f-a265-988bb57beeae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:51.669916 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9331da2f-f8d3-4c7f-a265-988bb57beeae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:51.670700 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9331da2f-f8d3-4c7f-a265-988bb57beeae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:51.671152 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9331da2f-f8d3-4c7f-a265-988bb57beeae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:51.802923 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9331da2f-f8d3-4c7f-a265-988bb57beeae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:51.810640 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9331da2f-f8d3-4c7f-a265-988bb57beeae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151812 Feb 21 01:32:51.811208 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 836/1697] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:51 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:52.828785 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d3caa797-0dd5-4504-8dd3-f9d5e3ef19ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:52.829499 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d3caa797-0dd5-4504-8dd3-f9d5e3ef19ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:52.835921 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d3caa797-0dd5-4504-8dd3-f9d5e3ef19ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:52.836383 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d3caa797-0dd5-4504-8dd3-f9d5e3ef19ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:52.837219 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d3caa797-0dd5-4504-8dd3-f9d5e3ef19ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:52.837678 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d3caa797-0dd5-4504-8dd3-f9d5e3ef19ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:52.977938 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d3caa797-0dd5-4504-8dd3-f9d5e3ef19ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:52.986942 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d3caa797-0dd5-4504-8dd3-f9d5e3ef19ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.160721 Feb 21 01:32:52.987521 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 862/1698] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:52 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:54.004764 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1356658b-5bd1-4e90-8098-09d2ebb27c4c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:54.005473 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1356658b-5bd1-4e90-8098-09d2ebb27c4c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:54.011962 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1356658b-5bd1-4e90-8098-09d2ebb27c4c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:54.012397 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1356658b-5bd1-4e90-8098-09d2ebb27c4c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:54.013179 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1356658b-5bd1-4e90-8098-09d2ebb27c4c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:54.013606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1356658b-5bd1-4e90-8098-09d2ebb27c4c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:54.151859 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1356658b-5bd1-4e90-8098-09d2ebb27c4c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:54.160203 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1356658b-5bd1-4e90-8098-09d2ebb27c4c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.159908 Feb 21 01:32:54.160773 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 837/1699] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:53 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:55.178429 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-cd9eb43b-74c7-4de1-bb21-4e895b9491fa tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:55.179048 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-cd9eb43b-74c7-4de1-bb21-4e895b9491fa tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:55.185621 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cd9eb43b-74c7-4de1-bb21-4e895b9491fa tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:55.185960 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cd9eb43b-74c7-4de1-bb21-4e895b9491fa tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:55.186747 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cd9eb43b-74c7-4de1-bb21-4e895b9491fa tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:55.187182 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cd9eb43b-74c7-4de1-bb21-4e895b9491fa tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:55.328166 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-cd9eb43b-74c7-4de1-bb21-4e895b9491fa tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:55.336569 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-cd9eb43b-74c7-4de1-bb21-4e895b9491fa tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.163230 Feb 21 01:32:55.337140 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 863/1700] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:55 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:56.352951 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e53ef96a-f3d5-458b-a10d-22f5c36a3062 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:56.353665 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e53ef96a-f3d5-458b-a10d-22f5c36a3062 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:56.360057 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e53ef96a-f3d5-458b-a10d-22f5c36a3062 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:56.360510 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e53ef96a-f3d5-458b-a10d-22f5c36a3062 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:56.362153 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e53ef96a-f3d5-458b-a10d-22f5c36a3062 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:56.362591 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e53ef96a-f3d5-458b-a10d-22f5c36a3062 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:56.493581 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e53ef96a-f3d5-458b-a10d-22f5c36a3062 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:56.501709 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e53ef96a-f3d5-458b-a10d-22f5c36a3062 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152192 Feb 21 01:32:56.502131 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 838/1701] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:56 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:57.518724 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0608c3f1-4da5-4cac-ac10-006f4dba3f2c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:57.519247 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0608c3f1-4da5-4cac-ac10-006f4dba3f2c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:57.525614 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0608c3f1-4da5-4cac-ac10-006f4dba3f2c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:57.526058 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0608c3f1-4da5-4cac-ac10-006f4dba3f2c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:57.526829 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0608c3f1-4da5-4cac-ac10-006f4dba3f2c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:57.527255 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0608c3f1-4da5-4cac-ac10-006f4dba3f2c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:57.659188 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0608c3f1-4da5-4cac-ac10-006f4dba3f2c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:57.666807 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0608c3f1-4da5-4cac-ac10-006f4dba3f2c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152434 Feb 21 01:32:57.667363 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 864/1702] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:57 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:58.684123 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fc85db2c-fd5d-411d-995f-2873307ae744 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:58.684687 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fc85db2c-fd5d-411d-995f-2873307ae744 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:58.690919 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fc85db2c-fd5d-411d-995f-2873307ae744 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:58.691367 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fc85db2c-fd5d-411d-995f-2873307ae744 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:58.692186 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fc85db2c-fd5d-411d-995f-2873307ae744 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:58.692625 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fc85db2c-fd5d-411d-995f-2873307ae744 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:58.826655 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fc85db2c-fd5d-411d-995f-2873307ae744 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:58.834918 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fc85db2c-fd5d-411d-995f-2873307ae744 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154513 Feb 21 01:32:58.835490 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 839/1703] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:58 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:59.851926 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-70e5261c-e11f-46bb-a51d-55dc8a41aeed tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:59.852540 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-70e5261c-e11f-46bb-a51d-55dc8a41aeed tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:59.858910 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-70e5261c-e11f-46bb-a51d-55dc8a41aeed tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:59.859356 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-70e5261c-e11f-46bb-a51d-55dc8a41aeed tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:59.860162 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-70e5261c-e11f-46bb-a51d-55dc8a41aeed tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:59.861371 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-70e5261c-e11f-46bb-a51d-55dc8a41aeed tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:59.991214 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-70e5261c-e11f-46bb-a51d-55dc8a41aeed tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:59.999174 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-70e5261c-e11f-46bb-a51d-55dc8a41aeed tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151060 Feb 21 01:32:59.999737 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 865/1704] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:59 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:01.015744 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ec754d3e-9440-48c2-87d5-813f34425251 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:01.016372 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ec754d3e-9440-48c2-87d5-813f34425251 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:01.022683 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec754d3e-9440-48c2-87d5-813f34425251 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:01.023122 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec754d3e-9440-48c2-87d5-813f34425251 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:01.023905 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec754d3e-9440-48c2-87d5-813f34425251 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:01.024359 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ec754d3e-9440-48c2-87d5-813f34425251 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:01.156527 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ec754d3e-9440-48c2-87d5-813f34425251 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:01.164984 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ec754d3e-9440-48c2-87d5-813f34425251 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152813 Feb 21 01:33:01.165555 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 840/1705] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:01 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:02.182386 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1a6e79ea-55e3-43da-9e63-7c766d18d8c9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:02.182995 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1a6e79ea-55e3-43da-9e63-7c766d18d8c9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:02.189945 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1a6e79ea-55e3-43da-9e63-7c766d18d8c9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:02.190391 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1a6e79ea-55e3-43da-9e63-7c766d18d8c9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:02.191172 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1a6e79ea-55e3-43da-9e63-7c766d18d8c9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:02.191600 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1a6e79ea-55e3-43da-9e63-7c766d18d8c9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:02.325003 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1a6e79ea-55e3-43da-9e63-7c766d18d8c9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:02.333157 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1a6e79ea-55e3-43da-9e63-7c766d18d8c9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154342 Feb 21 01:33:02.333837 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 866/1706] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:02 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:03.350709 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6661f04c-3790-459a-b92e-456d93c2d7a5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:03.351296 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6661f04c-3790-459a-b92e-456d93c2d7a5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:03.357589 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6661f04c-3790-459a-b92e-456d93c2d7a5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:03.358037 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6661f04c-3790-459a-b92e-456d93c2d7a5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:03.358815 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6661f04c-3790-459a-b92e-456d93c2d7a5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:03.359244 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6661f04c-3790-459a-b92e-456d93c2d7a5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:03.498187 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6661f04c-3790-459a-b92e-456d93c2d7a5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:03.506487 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6661f04c-3790-459a-b92e-456d93c2d7a5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.159449 Feb 21 01:33:03.507086 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 841/1707] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:03 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:04.523298 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-be365850-1186-42ec-9358-cd6aaf211de0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:04.523922 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-be365850-1186-42ec-9358-cd6aaf211de0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:04.530092 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-be365850-1186-42ec-9358-cd6aaf211de0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:04.530529 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-be365850-1186-42ec-9358-cd6aaf211de0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:04.531288 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-be365850-1186-42ec-9358-cd6aaf211de0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:04.531797 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-be365850-1186-42ec-9358-cd6aaf211de0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:04.664229 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-be365850-1186-42ec-9358-cd6aaf211de0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:04.671927 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-be365850-1186-42ec-9358-cd6aaf211de0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152198 Feb 21 01:33:04.672504 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 867/1708] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:04 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:05.688758 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5ca4c738-37eb-4053-b73f-be1dbc43aa07 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:05.689359 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5ca4c738-37eb-4053-b73f-be1dbc43aa07 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:05.695158 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5ca4c738-37eb-4053-b73f-be1dbc43aa07 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:05.695597 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5ca4c738-37eb-4053-b73f-be1dbc43aa07 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:05.696460 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5ca4c738-37eb-4053-b73f-be1dbc43aa07 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:05.696886 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5ca4c738-37eb-4053-b73f-be1dbc43aa07 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:05.831724 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5ca4c738-37eb-4053-b73f-be1dbc43aa07 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:05.839454 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5ca4c738-37eb-4053-b73f-be1dbc43aa07 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154524 Feb 21 01:33:05.840058 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 842/1709] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:05 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:06.857120 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9c3429e4-5f39-4104-afaf-98488774efde tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:06.857814 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9c3429e4-5f39-4104-afaf-98488774efde tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:06.864984 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9c3429e4-5f39-4104-afaf-98488774efde tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:06.865473 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9c3429e4-5f39-4104-afaf-98488774efde tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:06.866261 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9c3429e4-5f39-4104-afaf-98488774efde tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:06.866695 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9c3429e4-5f39-4104-afaf-98488774efde tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:07.001471 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9c3429e4-5f39-4104-afaf-98488774efde tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:07.009150 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9c3429e4-5f39-4104-afaf-98488774efde tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.156041 Feb 21 01:33:07.009714 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 868/1710] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:06 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:08.025591 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9f2709f3-81f9-4d21-a4ed-08a311b99b83 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:08.026230 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9f2709f3-81f9-4d21-a4ed-08a311b99b83 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:08.032798 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9f2709f3-81f9-4d21-a4ed-08a311b99b83 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:08.033257 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9f2709f3-81f9-4d21-a4ed-08a311b99b83 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:08.034051 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9f2709f3-81f9-4d21-a4ed-08a311b99b83 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:08.034491 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9f2709f3-81f9-4d21-a4ed-08a311b99b83 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:08.173039 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9f2709f3-81f9-4d21-a4ed-08a311b99b83 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:08.180858 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9f2709f3-81f9-4d21-a4ed-08a311b99b83 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.158931 Feb 21 01:33:08.181416 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 843/1711] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:08 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:09.198101 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fc0b90d3-65fd-4aa8-9648-731e9c689835 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:09.198716 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fc0b90d3-65fd-4aa8-9648-731e9c689835 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:09.205156 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fc0b90d3-65fd-4aa8-9648-731e9c689835 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:09.205606 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fc0b90d3-65fd-4aa8-9648-731e9c689835 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:09.206395 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fc0b90d3-65fd-4aa8-9648-731e9c689835 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:09.206829 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fc0b90d3-65fd-4aa8-9648-731e9c689835 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:09.342593 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fc0b90d3-65fd-4aa8-9648-731e9c689835 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:09.351068 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-fc0b90d3-65fd-4aa8-9648-731e9c689835 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.156501 Feb 21 01:33:09.351628 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 869/1712] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:09 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:10.368247 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9b62da46-f381-45e3-962c-64772263aa7b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:10.368861 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9b62da46-f381-45e3-962c-64772263aa7b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:10.375385 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9b62da46-f381-45e3-962c-64772263aa7b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:10.375865 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9b62da46-f381-45e3-962c-64772263aa7b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:10.376644 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9b62da46-f381-45e3-962c-64772263aa7b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:10.377078 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9b62da46-f381-45e3-962c-64772263aa7b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:10.511956 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9b62da46-f381-45e3-962c-64772263aa7b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:10.520102 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9b62da46-f381-45e3-962c-64772263aa7b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155442 Feb 21 01:33:10.520667 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 844/1713] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:10 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:11.537916 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-bb3b1a72-e26c-4392-87ea-693f35eb4bf7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:11.538442 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-bb3b1a72-e26c-4392-87ea-693f35eb4bf7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:11.544695 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bb3b1a72-e26c-4392-87ea-693f35eb4bf7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:11.545144 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bb3b1a72-e26c-4392-87ea-693f35eb4bf7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:11.545918 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bb3b1a72-e26c-4392-87ea-693f35eb4bf7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:11.546355 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bb3b1a72-e26c-4392-87ea-693f35eb4bf7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:11.675442 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-bb3b1a72-e26c-4392-87ea-693f35eb4bf7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:11.683277 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-bb3b1a72-e26c-4392-87ea-693f35eb4bf7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.149161 Feb 21 01:33:11.683867 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 870/1714] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:11 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:12.699970 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9b458754-f004-4d82-90d5-4ec99845a685 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:12.700514 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9b458754-f004-4d82-90d5-4ec99845a685 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:12.706978 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9b458754-f004-4d82-90d5-4ec99845a685 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:12.707455 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9b458754-f004-4d82-90d5-4ec99845a685 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:12.708256 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9b458754-f004-4d82-90d5-4ec99845a685 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:12.708694 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9b458754-f004-4d82-90d5-4ec99845a685 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:12.839016 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9b458754-f004-4d82-90d5-4ec99845a685 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:12.846721 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9b458754-f004-4d82-90d5-4ec99845a685 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.150449 Feb 21 01:33:12.851620 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 845/1715] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:12 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:13.863029 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e617e47e-a217-48d2-8165-e6054e5ee37b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:13.863624 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e617e47e-a217-48d2-8165-e6054e5ee37b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:13.870208 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e617e47e-a217-48d2-8165-e6054e5ee37b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:13.870653 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e617e47e-a217-48d2-8165-e6054e5ee37b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:13.871426 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e617e47e-a217-48d2-8165-e6054e5ee37b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:13.871874 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e617e47e-a217-48d2-8165-e6054e5ee37b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:14.008127 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e617e47e-a217-48d2-8165-e6054e5ee37b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:14.015717 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e617e47e-a217-48d2-8165-e6054e5ee37b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.157153 Feb 21 01:33:14.016304 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 871/1716] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:13 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:15.033012 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b919baef-e635-4390-a9ac-44cdfcfcd6f1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:15.033621 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b919baef-e635-4390-a9ac-44cdfcfcd6f1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:15.040129 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b919baef-e635-4390-a9ac-44cdfcfcd6f1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:15.040577 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b919baef-e635-4390-a9ac-44cdfcfcd6f1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:15.041355 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b919baef-e635-4390-a9ac-44cdfcfcd6f1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:15.041785 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b919baef-e635-4390-a9ac-44cdfcfcd6f1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:15.171054 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b919baef-e635-4390-a9ac-44cdfcfcd6f1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:15.179175 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b919baef-e635-4390-a9ac-44cdfcfcd6f1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.149840 Feb 21 01:33:15.179748 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 846/1717] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:15 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:16.196193 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e1276474-5c2d-4830-ae4e-0b38dbcc7011 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:16.196799 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e1276474-5c2d-4830-ae4e-0b38dbcc7011 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:16.202894 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e1276474-5c2d-4830-ae4e-0b38dbcc7011 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:16.203329 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e1276474-5c2d-4830-ae4e-0b38dbcc7011 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:16.204133 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e1276474-5c2d-4830-ae4e-0b38dbcc7011 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:16.204578 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e1276474-5c2d-4830-ae4e-0b38dbcc7011 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:16.336541 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e1276474-5c2d-4830-ae4e-0b38dbcc7011 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:16.344442 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e1276474-5c2d-4830-ae4e-0b38dbcc7011 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152105 Feb 21 01:33:16.345005 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 872/1718] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:16 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:17.361920 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-853fd2b8-1dbc-4112-b7b9-8cafdff36e12 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:17.362577 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-853fd2b8-1dbc-4112-b7b9-8cafdff36e12 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:17.368756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-853fd2b8-1dbc-4112-b7b9-8cafdff36e12 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:17.369459 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-853fd2b8-1dbc-4112-b7b9-8cafdff36e12 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:17.370221 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-853fd2b8-1dbc-4112-b7b9-8cafdff36e12 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:17.370646 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-853fd2b8-1dbc-4112-b7b9-8cafdff36e12 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:17.505275 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-853fd2b8-1dbc-4112-b7b9-8cafdff36e12 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:17.513010 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-853fd2b8-1dbc-4112-b7b9-8cafdff36e12 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155297 Feb 21 01:33:17.513580 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 847/1719] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:17 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:18.529682 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b8b16939-0417-4d00-9c86-71e15590a66e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:18.530288 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b8b16939-0417-4d00-9c86-71e15590a66e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:18.536617 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b8b16939-0417-4d00-9c86-71e15590a66e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:18.537066 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b8b16939-0417-4d00-9c86-71e15590a66e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:18.537852 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b8b16939-0417-4d00-9c86-71e15590a66e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:18.538270 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b8b16939-0417-4d00-9c86-71e15590a66e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:18.677513 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b8b16939-0417-4d00-9c86-71e15590a66e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:18.685816 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b8b16939-0417-4d00-9c86-71e15590a66e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.159783 Feb 21 01:33:18.686384 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 873/1720] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:18 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:19.703798 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-96bf1469-a5f1-4022-bc9b-0ebe5f6ac67c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:19.704376 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-96bf1469-a5f1-4022-bc9b-0ebe5f6ac67c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:19.711860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-96bf1469-a5f1-4022-bc9b-0ebe5f6ac67c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:19.712325 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-96bf1469-a5f1-4022-bc9b-0ebe5f6ac67c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:19.713099 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-96bf1469-a5f1-4022-bc9b-0ebe5f6ac67c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:19.713531 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-96bf1469-a5f1-4022-bc9b-0ebe5f6ac67c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:19.844803 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-96bf1469-a5f1-4022-bc9b-0ebe5f6ac67c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:19.853140 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-96bf1469-a5f1-4022-bc9b-0ebe5f6ac67c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152878 Feb 21 01:33:19.853727 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 848/1721] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:19 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:20.870190 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-db444100-bacb-4ab1-a3f2-0745c5585884 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:20.870807 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-db444100-bacb-4ab1-a3f2-0745c5585884 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:20.877175 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db444100-bacb-4ab1-a3f2-0745c5585884 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:20.877624 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db444100-bacb-4ab1-a3f2-0745c5585884 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:20.878398 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db444100-bacb-4ab1-a3f2-0745c5585884 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:20.878833 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db444100-bacb-4ab1-a3f2-0745c5585884 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:21.014591 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-db444100-bacb-4ab1-a3f2-0745c5585884 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:21.023487 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-db444100-bacb-4ab1-a3f2-0745c5585884 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.157237 Feb 21 01:33:21.024175 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 874/1722] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:20 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:22.041155 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-64d268f8-83f4-48e2-9df5-b2dda00d6081 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:22.041766 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-64d268f8-83f4-48e2-9df5-b2dda00d6081 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:22.047911 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-64d268f8-83f4-48e2-9df5-b2dda00d6081 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:22.048893 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-64d268f8-83f4-48e2-9df5-b2dda00d6081 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:22.049826 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-64d268f8-83f4-48e2-9df5-b2dda00d6081 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:22.050254 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-64d268f8-83f4-48e2-9df5-b2dda00d6081 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:22.181861 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-64d268f8-83f4-48e2-9df5-b2dda00d6081 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:22.189733 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-64d268f8-83f4-48e2-9df5-b2dda00d6081 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152187 Feb 21 01:33:22.190297 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 849/1723] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:22 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:23.207734 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c2d4418d-d874-4ba9-81b9-fe8fa12a52bf tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:23.208317 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c2d4418d-d874-4ba9-81b9-fe8fa12a52bf tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:23.214518 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c2d4418d-d874-4ba9-81b9-fe8fa12a52bf tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:23.214958 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c2d4418d-d874-4ba9-81b9-fe8fa12a52bf tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:23.215760 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c2d4418d-d874-4ba9-81b9-fe8fa12a52bf tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:23.216212 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c2d4418d-d874-4ba9-81b9-fe8fa12a52bf tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:23.347720 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c2d4418d-d874-4ba9-81b9-fe8fa12a52bf tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:23.355389 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c2d4418d-d874-4ba9-81b9-fe8fa12a52bf tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151919 Feb 21 01:33:23.355960 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 875/1724] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:23 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:24.372182 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-056c2852-a8a1-4dd4-a058-ca0d96e85a19 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:24.372796 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-056c2852-a8a1-4dd4-a058-ca0d96e85a19 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:24.379489 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-056c2852-a8a1-4dd4-a058-ca0d96e85a19 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:24.379959 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-056c2852-a8a1-4dd4-a058-ca0d96e85a19 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:24.380732 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-056c2852-a8a1-4dd4-a058-ca0d96e85a19 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:24.381157 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-056c2852-a8a1-4dd4-a058-ca0d96e85a19 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:24.509230 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-056c2852-a8a1-4dd4-a058-ca0d96e85a19 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:24.518166 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-056c2852-a8a1-4dd4-a058-ca0d96e85a19 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.149849 Feb 21 01:33:24.518736 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 850/1725] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:24 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:25.535065 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e2114097-29f2-4a56-a4c0-bc06cbf29e4b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:25.535684 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e2114097-29f2-4a56-a4c0-bc06cbf29e4b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:25.542008 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e2114097-29f2-4a56-a4c0-bc06cbf29e4b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:25.542459 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e2114097-29f2-4a56-a4c0-bc06cbf29e4b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:25.543236 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e2114097-29f2-4a56-a4c0-bc06cbf29e4b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:25.543668 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e2114097-29f2-4a56-a4c0-bc06cbf29e4b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:25.679800 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e2114097-29f2-4a56-a4c0-bc06cbf29e4b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:25.687436 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e2114097-29f2-4a56-a4c0-bc06cbf29e4b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.156200 Feb 21 01:33:25.688018 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 876/1726] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:25 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:26.705739 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-97431cbe-9092-4536-b12d-4ea03176a858 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:26.706352 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-97431cbe-9092-4536-b12d-4ea03176a858 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:26.713129 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-97431cbe-9092-4536-b12d-4ea03176a858 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:26.713580 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-97431cbe-9092-4536-b12d-4ea03176a858 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:26.714474 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-97431cbe-9092-4536-b12d-4ea03176a858 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:26.714907 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-97431cbe-9092-4536-b12d-4ea03176a858 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:26.848445 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-97431cbe-9092-4536-b12d-4ea03176a858 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:26.856174 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-97431cbe-9092-4536-b12d-4ea03176a858 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155127 Feb 21 01:33:26.856744 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 851/1727] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:26 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:27.874401 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9447c170-67eb-47a3-87ff-ee4dbdca28b1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:27.875018 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9447c170-67eb-47a3-87ff-ee4dbdca28b1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:27.882253 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9447c170-67eb-47a3-87ff-ee4dbdca28b1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:27.882706 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9447c170-67eb-47a3-87ff-ee4dbdca28b1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:27.883486 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9447c170-67eb-47a3-87ff-ee4dbdca28b1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:27.883953 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9447c170-67eb-47a3-87ff-ee4dbdca28b1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:28.014443 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9447c170-67eb-47a3-87ff-ee4dbdca28b1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:28.022815 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9447c170-67eb-47a3-87ff-ee4dbdca28b1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152107 Feb 21 01:33:28.023380 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 877/1728] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:27 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:29.039495 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-313293c1-df13-459a-8e2d-322967aaf06a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:29.040253 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-313293c1-df13-459a-8e2d-322967aaf06a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:29.046490 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-313293c1-df13-459a-8e2d-322967aaf06a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:29.046942 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-313293c1-df13-459a-8e2d-322967aaf06a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:29.048352 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-313293c1-df13-459a-8e2d-322967aaf06a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:29.049189 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-313293c1-df13-459a-8e2d-322967aaf06a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:29.179726 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-313293c1-df13-459a-8e2d-322967aaf06a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:29.187435 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-313293c1-df13-459a-8e2d-322967aaf06a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151679 Feb 21 01:33:29.188030 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 852/1729] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:29 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:30.204883 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b6cd2772-b6b2-4cf3-abd9-a3a435dba2b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:30.205420 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b6cd2772-b6b2-4cf3-abd9-a3a435dba2b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:30.211710 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b6cd2772-b6b2-4cf3-abd9-a3a435dba2b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:30.212173 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b6cd2772-b6b2-4cf3-abd9-a3a435dba2b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:30.212941 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b6cd2772-b6b2-4cf3-abd9-a3a435dba2b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:30.213367 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b6cd2772-b6b2-4cf3-abd9-a3a435dba2b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:30.346118 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b6cd2772-b6b2-4cf3-abd9-a3a435dba2b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:30.353713 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b6cd2772-b6b2-4cf3-abd9-a3a435dba2b3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152859 Feb 21 01:33:30.354271 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 878/1730] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:30 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:31.370837 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8b262318-f8be-48b0-a366-a2e8958bd705 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:31.371445 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8b262318-f8be-48b0-a366-a2e8958bd705 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:31.378324 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8b262318-f8be-48b0-a366-a2e8958bd705 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:31.378757 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8b262318-f8be-48b0-a366-a2e8958bd705 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:31.379520 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8b262318-f8be-48b0-a366-a2e8958bd705 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:31.379973 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8b262318-f8be-48b0-a366-a2e8958bd705 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:31.517726 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8b262318-f8be-48b0-a366-a2e8958bd705 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:31.525590 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8b262318-f8be-48b0-a366-a2e8958bd705 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.158641 Feb 21 01:33:31.526153 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 853/1731] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:31 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:32.542400 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f37929ae-b7b7-42d0-8be8-ff57131aec8b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:32.543007 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f37929ae-b7b7-42d0-8be8-ff57131aec8b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:32.550164 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f37929ae-b7b7-42d0-8be8-ff57131aec8b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:32.550609 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f37929ae-b7b7-42d0-8be8-ff57131aec8b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:32.551394 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f37929ae-b7b7-42d0-8be8-ff57131aec8b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:32.551823 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f37929ae-b7b7-42d0-8be8-ff57131aec8b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:32.689339 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f37929ae-b7b7-42d0-8be8-ff57131aec8b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:32.697029 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f37929ae-b7b7-42d0-8be8-ff57131aec8b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.158608 Feb 21 01:33:32.697590 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 879/1732] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:32 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:33.713192 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c1f9702b-4bd3-4db2-ac78-2efb697dde36 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:33.713786 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c1f9702b-4bd3-4db2-ac78-2efb697dde36 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:33.719892 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c1f9702b-4bd3-4db2-ac78-2efb697dde36 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:33.720338 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c1f9702b-4bd3-4db2-ac78-2efb697dde36 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:33.725739 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c1f9702b-4bd3-4db2-ac78-2efb697dde36 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:33.725739 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c1f9702b-4bd3-4db2-ac78-2efb697dde36 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:33.856735 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c1f9702b-4bd3-4db2-ac78-2efb697dde36 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:33.865183 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c1f9702b-4bd3-4db2-ac78-2efb697dde36 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155533 Feb 21 01:33:33.865710 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 854/1733] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:33 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:34.882181 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3e7ae4a7-1c71-4281-a397-fdd4b9be4e55 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:34.882817 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3e7ae4a7-1c71-4281-a397-fdd4b9be4e55 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:34.889091 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3e7ae4a7-1c71-4281-a397-fdd4b9be4e55 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:34.889533 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3e7ae4a7-1c71-4281-a397-fdd4b9be4e55 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:34.890315 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3e7ae4a7-1c71-4281-a397-fdd4b9be4e55 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:34.890742 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3e7ae4a7-1c71-4281-a397-fdd4b9be4e55 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:35.030516 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3e7ae4a7-1c71-4281-a397-fdd4b9be4e55 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:35.038575 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3e7ae4a7-1c71-4281-a397-fdd4b9be4e55 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.160071 Feb 21 01:33:35.039141 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 880/1734] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:34 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:36.055626 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-67da9712-c4d0-4a8a-aad0-f0bec9d95b47 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:36.056260 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-67da9712-c4d0-4a8a-aad0-f0bec9d95b47 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:36.062004 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-67da9712-c4d0-4a8a-aad0-f0bec9d95b47 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:36.062450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-67da9712-c4d0-4a8a-aad0-f0bec9d95b47 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:36.063968 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-67da9712-c4d0-4a8a-aad0-f0bec9d95b47 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:36.064407 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-67da9712-c4d0-4a8a-aad0-f0bec9d95b47 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:36.197650 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-67da9712-c4d0-4a8a-aad0-f0bec9d95b47 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:36.205647 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-67da9712-c4d0-4a8a-aad0-f0bec9d95b47 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.153885 Feb 21 01:33:36.206783 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 855/1735] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:36 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:33:37.223693 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c589fd26-3026-4ffe-ba3e-83741c729864 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:37.224494 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c589fd26-3026-4ffe-ba3e-83741c729864 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:37.230427 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c589fd26-3026-4ffe-ba3e-83741c729864 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:37.230872 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c589fd26-3026-4ffe-ba3e-83741c729864 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:37.231662 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c589fd26-3026-4ffe-ba3e-83741c729864 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:37.232111 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c589fd26-3026-4ffe-ba3e-83741c729864 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:37.369730 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c589fd26-3026-4ffe-ba3e-83741c729864 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:37.377578 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c589fd26-3026-4ffe-ba3e-83741c729864 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.158042 Feb 21 01:33:37.378132 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 881/1736] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:37 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:38.394770 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0d262c9c-f4bd-429b-849e-27576553b65b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:38.395388 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0d262c9c-f4bd-429b-849e-27576553b65b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:38.401623 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0d262c9c-f4bd-429b-849e-27576553b65b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:38.402075 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0d262c9c-f4bd-429b-849e-27576553b65b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:38.402849 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0d262c9c-f4bd-429b-849e-27576553b65b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:38.403279 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0d262c9c-f4bd-429b-849e-27576553b65b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:38.531941 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0d262c9c-f4bd-429b-849e-27576553b65b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:38.539488 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0d262c9c-f4bd-429b-849e-27576553b65b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.149099 Feb 21 01:33:38.540080 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 856/1737] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:38 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:39.556274 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-abbc7a36-ccad-4697-bab8-8f8028983bb8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:39.556809 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-abbc7a36-ccad-4697-bab8-8f8028983bb8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:39.563691 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-abbc7a36-ccad-4697-bab8-8f8028983bb8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:39.564167 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-abbc7a36-ccad-4697-bab8-8f8028983bb8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:39.564946 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-abbc7a36-ccad-4697-bab8-8f8028983bb8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:39.565379 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-abbc7a36-ccad-4697-bab8-8f8028983bb8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:39.694402 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-abbc7a36-ccad-4697-bab8-8f8028983bb8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:39.702023 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-abbc7a36-ccad-4697-bab8-8f8028983bb8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.149614 Feb 21 01:33:39.702579 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 882/1738] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:39 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:40.718557 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7c73256f-cf59-4096-b738-beaafd80d78c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:40.719696 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7c73256f-cf59-4096-b738-beaafd80d78c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:40.725882 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7c73256f-cf59-4096-b738-beaafd80d78c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:40.726385 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7c73256f-cf59-4096-b738-beaafd80d78c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:40.727159 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7c73256f-cf59-4096-b738-beaafd80d78c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:40.727589 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7c73256f-cf59-4096-b738-beaafd80d78c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:40.860382 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7c73256f-cf59-4096-b738-beaafd80d78c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:40.868600 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7c73256f-cf59-4096-b738-beaafd80d78c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.153665 Feb 21 01:33:40.869161 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 857/1739] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:40 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:41.885568 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e10deeb2-37d1-4070-a326-790e755688db tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:41.886229 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e10deeb2-37d1-4070-a326-790e755688db tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:41.893031 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e10deeb2-37d1-4070-a326-790e755688db tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:41.893475 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e10deeb2-37d1-4070-a326-790e755688db tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:41.894251 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e10deeb2-37d1-4070-a326-790e755688db tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:41.894686 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e10deeb2-37d1-4070-a326-790e755688db tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:42.030213 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e10deeb2-37d1-4070-a326-790e755688db tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:42.038596 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e10deeb2-37d1-4070-a326-790e755688db tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.156697 Feb 21 01:33:42.039154 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 883/1740] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:41 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:43.054301 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0cc86052-3a0f-4e33-964c-c6c8952f42a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:43.054916 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0cc86052-3a0f-4e33-964c-c6c8952f42a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:43.061160 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0cc86052-3a0f-4e33-964c-c6c8952f42a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:43.061608 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0cc86052-3a0f-4e33-964c-c6c8952f42a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:43.062400 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0cc86052-3a0f-4e33-964c-c6c8952f42a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:43.063316 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0cc86052-3a0f-4e33-964c-c6c8952f42a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:43.192601 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0cc86052-3a0f-4e33-964c-c6c8952f42a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:43.200598 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0cc86052-3a0f-4e33-964c-c6c8952f42a7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.149967 Feb 21 01:33:43.201165 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 858/1741] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:43 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:44.218406 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-36efe78b-dfa7-4469-a4ee-f89b35c1e516 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:44.219034 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-36efe78b-dfa7-4469-a4ee-f89b35c1e516 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:44.226031 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-36efe78b-dfa7-4469-a4ee-f89b35c1e516 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:44.226477 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-36efe78b-dfa7-4469-a4ee-f89b35c1e516 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:44.227245 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-36efe78b-dfa7-4469-a4ee-f89b35c1e516 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:44.227667 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-36efe78b-dfa7-4469-a4ee-f89b35c1e516 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:44.374222 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-36efe78b-dfa7-4469-a4ee-f89b35c1e516 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:44.382443 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-36efe78b-dfa7-4469-a4ee-f89b35c1e516 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.167709 Feb 21 01:33:44.383013 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 884/1742] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:44 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:45.399921 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c755e47b-dfb4-42d3-b97a-56db71cd47f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:45.400568 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c755e47b-dfb4-42d3-b97a-56db71cd47f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:45.407088 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c755e47b-dfb4-42d3-b97a-56db71cd47f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:45.407611 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c755e47b-dfb4-42d3-b97a-56db71cd47f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:45.408666 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c755e47b-dfb4-42d3-b97a-56db71cd47f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:45.409280 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c755e47b-dfb4-42d3-b97a-56db71cd47f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:45.543475 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c755e47b-dfb4-42d3-b97a-56db71cd47f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:45.552114 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c755e47b-dfb4-42d3-b97a-56db71cd47f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155833 Feb 21 01:33:45.552687 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 859/1743] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:45 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:46.569591 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ad4d7772-0f9a-49e3-8ea0-4d2866fcbc2c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:46.570400 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ad4d7772-0f9a-49e3-8ea0-4d2866fcbc2c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:46.576889 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad4d7772-0f9a-49e3-8ea0-4d2866fcbc2c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:46.577378 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad4d7772-0f9a-49e3-8ea0-4d2866fcbc2c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:46.578031 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad4d7772-0f9a-49e3-8ea0-4d2866fcbc2c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:46.578453 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad4d7772-0f9a-49e3-8ea0-4d2866fcbc2c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:46.721903 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ad4d7772-0f9a-49e3-8ea0-4d2866fcbc2c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:46.729990 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ad4d7772-0f9a-49e3-8ea0-4d2866fcbc2c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.164115 Feb 21 01:33:46.730552 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 885/1744] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:46 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:47.747293 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4cf88372-8720-4efc-97d2-5b9f0bc9d280 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:47.747899 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4cf88372-8720-4efc-97d2-5b9f0bc9d280 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:47.754582 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4cf88372-8720-4efc-97d2-5b9f0bc9d280 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:47.755021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4cf88372-8720-4efc-97d2-5b9f0bc9d280 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:47.755790 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4cf88372-8720-4efc-97d2-5b9f0bc9d280 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:47.756240 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4cf88372-8720-4efc-97d2-5b9f0bc9d280 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:47.886595 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4cf88372-8720-4efc-97d2-5b9f0bc9d280 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:47.894893 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4cf88372-8720-4efc-97d2-5b9f0bc9d280 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151219 Feb 21 01:33:47.895455 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 860/1745] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:47 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:48.913005 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3a43c575-a8e2-44fa-b13b-7d71a304d6b6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:48.913552 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3a43c575-a8e2-44fa-b13b-7d71a304d6b6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:48.919851 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3a43c575-a8e2-44fa-b13b-7d71a304d6b6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:48.920312 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3a43c575-a8e2-44fa-b13b-7d71a304d6b6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:48.921093 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3a43c575-a8e2-44fa-b13b-7d71a304d6b6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:48.921528 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3a43c575-a8e2-44fa-b13b-7d71a304d6b6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:49.058273 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3a43c575-a8e2-44fa-b13b-7d71a304d6b6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:49.066378 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3a43c575-a8e2-44fa-b13b-7d71a304d6b6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.157962 Feb 21 01:33:49.066939 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 886/1746] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:48 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:50.083073 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-091321ed-6336-498c-9de0-efc09233f050 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:50.083683 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-091321ed-6336-498c-9de0-efc09233f050 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:50.089936 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-091321ed-6336-498c-9de0-efc09233f050 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:50.090380 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-091321ed-6336-498c-9de0-efc09233f050 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:50.091171 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-091321ed-6336-498c-9de0-efc09233f050 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:50.091596 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-091321ed-6336-498c-9de0-efc09233f050 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:50.223260 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-091321ed-6336-498c-9de0-efc09233f050 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:50.230886 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-091321ed-6336-498c-9de0-efc09233f050 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152275 Feb 21 01:33:50.231459 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 861/1747] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:50 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:51.247856 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2d2fd20f-62d1-4dde-b083-169ef3ff7c3f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:51.248454 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2d2fd20f-62d1-4dde-b083-169ef3ff7c3f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:51.255560 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2d2fd20f-62d1-4dde-b083-169ef3ff7c3f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:51.256042 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2d2fd20f-62d1-4dde-b083-169ef3ff7c3f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:51.256823 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2d2fd20f-62d1-4dde-b083-169ef3ff7c3f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:51.257258 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2d2fd20f-62d1-4dde-b083-169ef3ff7c3f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:51.389865 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2d2fd20f-62d1-4dde-b083-169ef3ff7c3f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:51.398395 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2d2fd20f-62d1-4dde-b083-169ef3ff7c3f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154230 Feb 21 01:33:51.398967 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 887/1748] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:51 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:52.414941 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b51fa66f-f195-4c32-9b46-b2849e3c0fee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:52.415607 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b51fa66f-f195-4c32-9b46-b2849e3c0fee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:52.421803 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b51fa66f-f195-4c32-9b46-b2849e3c0fee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:52.422246 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b51fa66f-f195-4c32-9b46-b2849e3c0fee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:52.423016 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b51fa66f-f195-4c32-9b46-b2849e3c0fee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:52.423446 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b51fa66f-f195-4c32-9b46-b2849e3c0fee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:52.554062 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b51fa66f-f195-4c32-9b46-b2849e3c0fee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:52.561720 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b51fa66f-f195-4c32-9b46-b2849e3c0fee tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.150478 Feb 21 01:33:52.562287 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 862/1749] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:52 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:53.578391 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-44096f03-9dcc-44bf-9c48-7ef2b30a3153 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:53.579001 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-44096f03-9dcc-44bf-9c48-7ef2b30a3153 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:53.585483 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-44096f03-9dcc-44bf-9c48-7ef2b30a3153 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:53.585935 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-44096f03-9dcc-44bf-9c48-7ef2b30a3153 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:53.586715 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-44096f03-9dcc-44bf-9c48-7ef2b30a3153 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:53.587150 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-44096f03-9dcc-44bf-9c48-7ef2b30a3153 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:53.721593 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-44096f03-9dcc-44bf-9c48-7ef2b30a3153 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:53.729332 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-44096f03-9dcc-44bf-9c48-7ef2b30a3153 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154678 Feb 21 01:33:53.729886 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 888/1750] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:53 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:54.746466 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2b09b107-5783-430f-8f77-52e69681f3bd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:54.747074 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2b09b107-5783-430f-8f77-52e69681f3bd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:54.754283 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b09b107-5783-430f-8f77-52e69681f3bd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:54.754726 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b09b107-5783-430f-8f77-52e69681f3bd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:54.755495 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b09b107-5783-430f-8f77-52e69681f3bd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:54.755960 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b09b107-5783-430f-8f77-52e69681f3bd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:54.884904 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2b09b107-5783-430f-8f77-52e69681f3bd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:54.894682 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2b09b107-5783-430f-8f77-52e69681f3bd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152035 Feb 21 01:33:54.895270 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 863/1751] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:54 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:55.910944 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e7db6563-68f6-4380-b000-4c480d94d84d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:55.911535 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e7db6563-68f6-4380-b000-4c480d94d84d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:55.917859 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7db6563-68f6-4380-b000-4c480d94d84d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:55.918310 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7db6563-68f6-4380-b000-4c480d94d84d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:55.919120 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7db6563-68f6-4380-b000-4c480d94d84d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:55.919555 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7db6563-68f6-4380-b000-4c480d94d84d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:56.055766 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e7db6563-68f6-4380-b000-4c480d94d84d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:56.063672 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e7db6563-68f6-4380-b000-4c480d94d84d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.156476 Feb 21 01:33:56.064273 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 889/1752] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:55 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:57.082656 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c841bacb-50be-4e9a-8fc5-5ccbf11e1d6c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:57.083422 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c841bacb-50be-4e9a-8fc5-5ccbf11e1d6c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:57.089896 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c841bacb-50be-4e9a-8fc5-5ccbf11e1d6c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:57.090336 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c841bacb-50be-4e9a-8fc5-5ccbf11e1d6c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:57.092654 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c841bacb-50be-4e9a-8fc5-5ccbf11e1d6c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:57.093140 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c841bacb-50be-4e9a-8fc5-5ccbf11e1d6c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:57.233539 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c841bacb-50be-4e9a-8fc5-5ccbf11e1d6c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:57.241507 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c841bacb-50be-4e9a-8fc5-5ccbf11e1d6c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.163940 Feb 21 01:33:57.242077 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 864/1753] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:57 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:58.258385 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-31c00770-eaa2-4b92-813f-1e99465b45c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:58.258982 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-31c00770-eaa2-4b92-813f-1e99465b45c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:58.265107 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-31c00770-eaa2-4b92-813f-1e99465b45c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:58.265545 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-31c00770-eaa2-4b92-813f-1e99465b45c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:58.266308 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-31c00770-eaa2-4b92-813f-1e99465b45c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:58.266731 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-31c00770-eaa2-4b92-813f-1e99465b45c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:58.400054 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-31c00770-eaa2-4b92-813f-1e99465b45c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:58.407711 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-31c00770-eaa2-4b92-813f-1e99465b45c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152913 Feb 21 01:33:58.408524 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 890/1754] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:58 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:59.425203 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3482a092-c3c1-4deb-a0df-5698b7582674 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:59.425855 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3482a092-c3c1-4deb-a0df-5698b7582674 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:59.432038 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3482a092-c3c1-4deb-a0df-5698b7582674 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:59.432490 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3482a092-c3c1-4deb-a0df-5698b7582674 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:59.433266 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3482a092-c3c1-4deb-a0df-5698b7582674 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:59.433701 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3482a092-c3c1-4deb-a0df-5698b7582674 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:59.565569 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3482a092-c3c1-4deb-a0df-5698b7582674 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:59.573490 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3482a092-c3c1-4deb-a0df-5698b7582674 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152578 Feb 21 01:33:59.574059 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 865/1755] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:59 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:00.590081 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5797aeea-2486-4388-ac1d-cb23ed328016 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:00.590693 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5797aeea-2486-4388-ac1d-cb23ed328016 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:00.597762 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5797aeea-2486-4388-ac1d-cb23ed328016 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:00.598203 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5797aeea-2486-4388-ac1d-cb23ed328016 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:00.598967 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5797aeea-2486-4388-ac1d-cb23ed328016 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:00.599390 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5797aeea-2486-4388-ac1d-cb23ed328016 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:00.729200 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5797aeea-2486-4388-ac1d-cb23ed328016 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:00.737333 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5797aeea-2486-4388-ac1d-cb23ed328016 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.150378 Feb 21 01:34:00.737883 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 891/1756] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:00 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:01.754861 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d7543ed6-72d5-4f9f-b085-7cc4d458cb4b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:01.755443 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d7543ed6-72d5-4f9f-b085-7cc4d458cb4b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:01.761962 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d7543ed6-72d5-4f9f-b085-7cc4d458cb4b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:01.762411 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d7543ed6-72d5-4f9f-b085-7cc4d458cb4b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:01.763388 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d7543ed6-72d5-4f9f-b085-7cc4d458cb4b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:01.763931 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d7543ed6-72d5-4f9f-b085-7cc4d458cb4b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:01.898187 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d7543ed6-72d5-4f9f-b085-7cc4d458cb4b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:01.905686 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d7543ed6-72d5-4f9f-b085-7cc4d458cb4b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155167 Feb 21 01:34:01.906246 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 866/1757] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:01 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:02.922230 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ec856eed-c64c-471a-93b4-aa00792c4a0a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:02.922815 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ec856eed-c64c-471a-93b4-aa00792c4a0a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:02.929192 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec856eed-c64c-471a-93b4-aa00792c4a0a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:02.929635 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec856eed-c64c-471a-93b4-aa00792c4a0a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:02.930412 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec856eed-c64c-471a-93b4-aa00792c4a0a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:02.930840 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ec856eed-c64c-471a-93b4-aa00792c4a0a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:03.059667 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ec856eed-c64c-471a-93b4-aa00792c4a0a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:03.067546 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ec856eed-c64c-471a-93b4-aa00792c4a0a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.148936 Feb 21 01:34:03.068146 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 892/1758] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:02 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:04.084512 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3fb21c9a-bbc5-479f-89d5-8f9fb15ecb10 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:04.085120 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3fb21c9a-bbc5-479f-89d5-8f9fb15ecb10 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:04.091339 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3fb21c9a-bbc5-479f-89d5-8f9fb15ecb10 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:04.091778 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3fb21c9a-bbc5-479f-89d5-8f9fb15ecb10 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:04.092569 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3fb21c9a-bbc5-479f-89d5-8f9fb15ecb10 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:04.093030 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3fb21c9a-bbc5-479f-89d5-8f9fb15ecb10 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:04.227382 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3fb21c9a-bbc5-479f-89d5-8f9fb15ecb10 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:04.235155 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3fb21c9a-bbc5-479f-89d5-8f9fb15ecb10 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154577 Feb 21 01:34:04.235716 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 867/1759] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:04 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:05.253918 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d9ff55f4-6038-46f2-9ab5-63c0ba8432c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:05.254540 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d9ff55f4-6038-46f2-9ab5-63c0ba8432c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:05.260564 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d9ff55f4-6038-46f2-9ab5-63c0ba8432c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:05.261037 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d9ff55f4-6038-46f2-9ab5-63c0ba8432c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:05.261814 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d9ff55f4-6038-46f2-9ab5-63c0ba8432c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:05.262248 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d9ff55f4-6038-46f2-9ab5-63c0ba8432c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:05.398808 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d9ff55f4-6038-46f2-9ab5-63c0ba8432c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:05.406581 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d9ff55f4-6038-46f2-9ab5-63c0ba8432c6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.157365 Feb 21 01:34:05.407158 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 893/1760] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:05 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:06.424062 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-eced14c6-0036-4fbe-973b-6e2ce7936846 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:06.424725 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-eced14c6-0036-4fbe-973b-6e2ce7936846 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:06.430664 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eced14c6-0036-4fbe-973b-6e2ce7936846 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:06.431101 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eced14c6-0036-4fbe-973b-6e2ce7936846 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:06.431892 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eced14c6-0036-4fbe-973b-6e2ce7936846 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:06.432358 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eced14c6-0036-4fbe-973b-6e2ce7936846 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:06.563186 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-eced14c6-0036-4fbe-973b-6e2ce7936846 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:06.571588 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-eced14c6-0036-4fbe-973b-6e2ce7936846 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151210 Feb 21 01:34:06.572181 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 868/1761] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:06 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:07.588720 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7e791a82-f25d-4a95-8b17-abb065a59dfc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:07.589359 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7e791a82-f25d-4a95-8b17-abb065a59dfc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:07.595570 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7e791a82-f25d-4a95-8b17-abb065a59dfc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:07.596598 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7e791a82-f25d-4a95-8b17-abb065a59dfc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:07.597405 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7e791a82-f25d-4a95-8b17-abb065a59dfc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:07.597837 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7e791a82-f25d-4a95-8b17-abb065a59dfc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:07.731013 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7e791a82-f25d-4a95-8b17-abb065a59dfc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:07.739827 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7e791a82-f25d-4a95-8b17-abb065a59dfc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154621 Feb 21 01:34:07.740430 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 894/1762] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:07 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:08.756809 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c802097e-4160-49fe-98ce-e5ebd42e5b18 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:08.757442 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c802097e-4160-49fe-98ce-e5ebd42e5b18 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:08.763732 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c802097e-4160-49fe-98ce-e5ebd42e5b18 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:08.764218 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c802097e-4160-49fe-98ce-e5ebd42e5b18 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:08.764990 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c802097e-4160-49fe-98ce-e5ebd42e5b18 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:08.765441 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c802097e-4160-49fe-98ce-e5ebd42e5b18 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:08.903535 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c802097e-4160-49fe-98ce-e5ebd42e5b18 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:08.911903 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c802097e-4160-49fe-98ce-e5ebd42e5b18 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.158741 Feb 21 01:34:08.912468 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 869/1763] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:08 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:09.932683 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5475fc00-1580-40ed-956e-4ff589cb493e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:09.933373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5475fc00-1580-40ed-956e-4ff589cb493e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:09.939872 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5475fc00-1580-40ed-956e-4ff589cb493e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:09.940588 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5475fc00-1580-40ed-956e-4ff589cb493e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:09.941443 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5475fc00-1580-40ed-956e-4ff589cb493e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:09.941965 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5475fc00-1580-40ed-956e-4ff589cb493e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:10.042130 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:34:10.042982 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:34:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:34:10.086701 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5475fc00-1580-40ed-956e-4ff589cb493e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:10.094463 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5475fc00-1580-40ed-956e-4ff589cb493e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.166072 Feb 21 01:34:10.095018 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 895/1764] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:09 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:34:10.824135 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:34:10.824366 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:34:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:34:11.110296 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a531f5c4-04a1-45b8-a010-9ff6f4ee08cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:11.110860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a531f5c4-04a1-45b8-a010-9ff6f4ee08cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:11.117729 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a531f5c4-04a1-45b8-a010-9ff6f4ee08cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:11.118181 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a531f5c4-04a1-45b8-a010-9ff6f4ee08cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:11.118950 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a531f5c4-04a1-45b8-a010-9ff6f4ee08cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:11.119379 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a531f5c4-04a1-45b8-a010-9ff6f4ee08cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:11.248393 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a531f5c4-04a1-45b8-a010-9ff6f4ee08cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:11.256061 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a531f5c4-04a1-45b8-a010-9ff6f4ee08cc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.149481 Feb 21 01:34:11.256622 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 870/1765] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:11 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:12.272688 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-28623ea5-5d0f-4008-bd62-299a27ec5ff0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:12.273314 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-28623ea5-5d0f-4008-bd62-299a27ec5ff0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:12.279554 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-28623ea5-5d0f-4008-bd62-299a27ec5ff0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:12.280038 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-28623ea5-5d0f-4008-bd62-299a27ec5ff0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:12.280806 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-28623ea5-5d0f-4008-bd62-299a27ec5ff0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:12.281228 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-28623ea5-5d0f-4008-bd62-299a27ec5ff0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:12.411328 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-28623ea5-5d0f-4008-bd62-299a27ec5ff0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:12.419208 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-28623ea5-5d0f-4008-bd62-299a27ec5ff0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.150172 Feb 21 01:34:12.419765 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 896/1766] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:12 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:34:13.435648 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a3bdfcc6-c3a9-4d71-a473-6e35b1260623 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:13.436294 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a3bdfcc6-c3a9-4d71-a473-6e35b1260623 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:13.443128 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a3bdfcc6-c3a9-4d71-a473-6e35b1260623 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:13.443576 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a3bdfcc6-c3a9-4d71-a473-6e35b1260623 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:13.444400 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a3bdfcc6-c3a9-4d71-a473-6e35b1260623 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:13.444840 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a3bdfcc6-c3a9-4d71-a473-6e35b1260623 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:13.579000 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a3bdfcc6-c3a9-4d71-a473-6e35b1260623 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:13.587187 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a3bdfcc6-c3a9-4d71-a473-6e35b1260623 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155220 Feb 21 01:34:13.587748 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 871/1767] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:13 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:14.604259 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3505a736-1117-4b46-8b82-1a33590f78a4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:14.604888 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3505a736-1117-4b46-8b82-1a33590f78a4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:14.611862 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3505a736-1117-4b46-8b82-1a33590f78a4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:14.612614 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3505a736-1117-4b46-8b82-1a33590f78a4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:14.613403 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3505a736-1117-4b46-8b82-1a33590f78a4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:14.613842 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3505a736-1117-4b46-8b82-1a33590f78a4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:14.744665 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3505a736-1117-4b46-8b82-1a33590f78a4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:14.752651 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3505a736-1117-4b46-8b82-1a33590f78a4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151921 Feb 21 01:34:14.753221 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 897/1768] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:14 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:15.769813 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0e05c7f0-68d6-418e-8b72-0211f15c3589 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:15.770455 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0e05c7f0-68d6-418e-8b72-0211f15c3589 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:15.776917 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0e05c7f0-68d6-418e-8b72-0211f15c3589 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:15.777467 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0e05c7f0-68d6-418e-8b72-0211f15c3589 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:15.778238 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0e05c7f0-68d6-418e-8b72-0211f15c3589 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:15.778669 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0e05c7f0-68d6-418e-8b72-0211f15c3589 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:15.916680 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0e05c7f0-68d6-418e-8b72-0211f15c3589 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:15.924497 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0e05c7f0-68d6-418e-8b72-0211f15c3589 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.158919 Feb 21 01:34:15.925053 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 872/1769] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:15 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:16.940594 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-bfdaad6b-53c5-4033-b940-d9a5edd7fdce tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:16.941195 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-bfdaad6b-53c5-4033-b940-d9a5edd7fdce tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:16.947416 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bfdaad6b-53c5-4033-b940-d9a5edd7fdce tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:16.947881 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bfdaad6b-53c5-4033-b940-d9a5edd7fdce tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:16.948651 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bfdaad6b-53c5-4033-b940-d9a5edd7fdce tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:16.949074 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bfdaad6b-53c5-4033-b940-d9a5edd7fdce tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:17.082429 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-bfdaad6b-53c5-4033-b940-d9a5edd7fdce tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:17.090235 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-bfdaad6b-53c5-4033-b940-d9a5edd7fdce tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.153360 Feb 21 01:34:17.090801 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 898/1770] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:16 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:18.107795 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-bcd97170-6c3f-4296-b24a-38cd6ccd07f2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:18.108440 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-bcd97170-6c3f-4296-b24a-38cd6ccd07f2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:18.114632 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bcd97170-6c3f-4296-b24a-38cd6ccd07f2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:18.115077 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bcd97170-6c3f-4296-b24a-38cd6ccd07f2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:18.115865 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bcd97170-6c3f-4296-b24a-38cd6ccd07f2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:18.116681 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bcd97170-6c3f-4296-b24a-38cd6ccd07f2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:18.248425 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bcd97170-6c3f-4296-b24a-38cd6ccd07f2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:18.256659 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-bcd97170-6c3f-4296-b24a-38cd6ccd07f2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152541 Feb 21 01:34:18.257225 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 873/1771] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:18 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:19.273340 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4703d198-9e19-4be6-9169-3017c58aa368 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:19.273930 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4703d198-9e19-4be6-9169-3017c58aa368 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:19.280193 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4703d198-9e19-4be6-9169-3017c58aa368 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:19.281280 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4703d198-9e19-4be6-9169-3017c58aa368 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:19.282066 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4703d198-9e19-4be6-9169-3017c58aa368 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:19.282497 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4703d198-9e19-4be6-9169-3017c58aa368 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:19.416511 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4703d198-9e19-4be6-9169-3017c58aa368 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:19.424675 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4703d198-9e19-4be6-9169-3017c58aa368 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.155020 Feb 21 01:34:19.425232 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 899/1772] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:19 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:20.442761 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3f69a2ba-9846-40f0-9ab3-caeb72241110 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:20.443384 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3f69a2ba-9846-40f0-9ab3-caeb72241110 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:20.449924 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3f69a2ba-9846-40f0-9ab3-caeb72241110 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:20.450476 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3f69a2ba-9846-40f0-9ab3-caeb72241110 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:20.451327 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3f69a2ba-9846-40f0-9ab3-caeb72241110 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:20.451787 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3f69a2ba-9846-40f0-9ab3-caeb72241110 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:20.606376 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3f69a2ba-9846-40f0-9ab3-caeb72241110 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:20.615388 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3f69a2ba-9846-40f0-9ab3-caeb72241110 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.177617 Feb 21 01:34:20.616189 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 874/1773] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:20 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:20.873863 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-52470b90-f8cf-44c8-a5a7-980dcd25609f tempest-TestShelveInstance-2000146732 tempest-TestShelveInstance-2000146732-project] Calling method '.version_select at 0x7f4ace71e1f0>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:20.877797 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: ERROR oslo.messaging._drivers.impl_rabbit [None req-52470b90-f8cf-44c8-a5a7-980dcd25609f tempest-TestShelveInstance-2000146732 tempest-TestShelveInstance-2000146732-project] [a5dd64f2-f84c-40b3-b52f-28664849fe93] AMQP server on 10.222.0.91:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 21 01:34:21.634181 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-549b6464-1fd9-4e4f-9433-ab92b9eb787d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:21.634814 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-549b6464-1fd9-4e4f-9433-ab92b9eb787d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:21.641006 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-549b6464-1fd9-4e4f-9433-ab92b9eb787d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:21.641464 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-549b6464-1fd9-4e4f-9433-ab92b9eb787d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:21.642883 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-549b6464-1fd9-4e4f-9433-ab92b9eb787d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:21.643319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-549b6464-1fd9-4e4f-9433-ab92b9eb787d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:21.772393 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-549b6464-1fd9-4e4f-9433-ab92b9eb787d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:21.780044 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-549b6464-1fd9-4e4f-9433-ab92b9eb787d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.149467 Feb 21 01:34:21.780606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 875/1774] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:21 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:34:21.885788 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [None req-52470b90-f8cf-44c8-a5a7-980dcd25609f tempest-TestShelveInstance-2000146732 tempest-TestShelveInstance-2000146732-project] [a5dd64f2-f84c-40b3-b52f-28664849fe93] Reconnected to AMQP server on 10.222.0.91:5672 via [amqp] client with port 52220. Feb 21 01:34:21.966277 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-52470b90-f8cf-44c8-a5a7-980dcd25609f tempest-TestShelveInstance-2000146732 tempest-TestShelveInstance-2000146732-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1157500470" status: 202 len: 0 microversion: 2.1 time: 1.096282 Feb 21 01:34:21.966848 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 900/1775] 10.222.0.91 () {58 vars in 1253 bytes} [Mon Feb 21 01:34:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1157500470 => generated 0 bytes in 1098 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:34:22.798924 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4c846e70-d14b-48b4-9c5d-01b815dbc42c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:22.799608 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4c846e70-d14b-48b4-9c5d-01b815dbc42c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:22.806063 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4c846e70-d14b-48b4-9c5d-01b815dbc42c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:22.806511 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4c846e70-d14b-48b4-9c5d-01b815dbc42c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:22.807303 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4c846e70-d14b-48b4-9c5d-01b815dbc42c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:22.807732 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4c846e70-d14b-48b4-9c5d-01b815dbc42c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:22.952004 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4c846e70-d14b-48b4-9c5d-01b815dbc42c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:22.960065 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4c846e70-d14b-48b4-9c5d-01b815dbc42c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.165333 Feb 21 01:34:22.960645 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 876/1776] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:22 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:23.163169 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:34:23.163384 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:34:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:34:23.977131 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d20dedbe-d933-4a85-b56d-80c6c39fbdf8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:23.978351 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d20dedbe-d933-4a85-b56d-80c6c39fbdf8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:23.985661 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d20dedbe-d933-4a85-b56d-80c6c39fbdf8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:23.986105 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d20dedbe-d933-4a85-b56d-80c6c39fbdf8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:23.986900 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d20dedbe-d933-4a85-b56d-80c6c39fbdf8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:23.987340 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d20dedbe-d933-4a85-b56d-80c6c39fbdf8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:24.098246 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:34:24.098405 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:34:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc (ip 10.222.0.91) !!! Feb 21 01:34:24.166402 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d20dedbe-d933-4a85-b56d-80c6c39fbdf8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:24.174498 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d20dedbe-d933-4a85-b56d-80c6c39fbdf8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.200903 Feb 21 01:34:24.180012 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 901/1777] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:23 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:25.193982 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-20d8caac-5352-4b1b-ab09-d79f7e7ca66d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:25.194599 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-20d8caac-5352-4b1b-ab09-d79f7e7ca66d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:25.201305 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-20d8caac-5352-4b1b-ab09-d79f7e7ca66d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:25.201466 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-20d8caac-5352-4b1b-ab09-d79f7e7ca66d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:25.202170 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-20d8caac-5352-4b1b-ab09-d79f7e7ca66d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:25.202605 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-20d8caac-5352-4b1b-ab09-d79f7e7ca66d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:25.343012 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-20d8caac-5352-4b1b-ab09-d79f7e7ca66d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:25.352468 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-20d8caac-5352-4b1b-ab09-d79f7e7ca66d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.164495 Feb 21 01:34:25.353275 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 877/1778] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:25 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:26.370847 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-eb520f54-2e40-4875-ba4e-df6fd3502a41 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:26.371624 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-eb520f54-2e40-4875-ba4e-df6fd3502a41 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:26.379162 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eb520f54-2e40-4875-ba4e-df6fd3502a41 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:26.379772 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eb520f54-2e40-4875-ba4e-df6fd3502a41 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:26.380617 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eb520f54-2e40-4875-ba4e-df6fd3502a41 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:26.381040 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eb520f54-2e40-4875-ba4e-df6fd3502a41 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:26.518349 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-eb520f54-2e40-4875-ba4e-df6fd3502a41 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:26.526059 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-eb520f54-2e40-4875-ba4e-df6fd3502a41 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.159047 Feb 21 01:34:26.526618 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 902/1779] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:26 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:27.543507 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9d25a011-79d3-4d58-ade6-2ffda2a63417 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:27.544081 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9d25a011-79d3-4d58-ade6-2ffda2a63417 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:27.550247 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9d25a011-79d3-4d58-ade6-2ffda2a63417 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:27.550687 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9d25a011-79d3-4d58-ade6-2ffda2a63417 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:27.551458 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9d25a011-79d3-4d58-ade6-2ffda2a63417 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:27.551974 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9d25a011-79d3-4d58-ade6-2ffda2a63417 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:27.774360 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9d25a011-79d3-4d58-ade6-2ffda2a63417 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:27.781951 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9d25a011-79d3-4d58-ade6-2ffda2a63417 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.242233 Feb 21 01:34:27.783049 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 878/1780] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:27 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:28.799259 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9c50682b-4db2-455f-a0b1-b9ef8445f17d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:28.799926 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9c50682b-4db2-455f-a0b1-b9ef8445f17d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:28.806499 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9c50682b-4db2-455f-a0b1-b9ef8445f17d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:28.806943 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9c50682b-4db2-455f-a0b1-b9ef8445f17d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:28.807722 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9c50682b-4db2-455f-a0b1-b9ef8445f17d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:28.808181 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9c50682b-4db2-455f-a0b1-b9ef8445f17d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:28.960476 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9c50682b-4db2-455f-a0b1-b9ef8445f17d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:28.968454 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9c50682b-4db2-455f-a0b1-b9ef8445f17d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.173010 Feb 21 01:34:28.969398 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 903/1781] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:28 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:29.988783 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0931e5ea-f639-4d60-aadb-9dbe38e1397b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:29.990035 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0931e5ea-f639-4d60-aadb-9dbe38e1397b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:29.997549 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0931e5ea-f639-4d60-aadb-9dbe38e1397b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:29.998121 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0931e5ea-f639-4d60-aadb-9dbe38e1397b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:29.998972 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0931e5ea-f639-4d60-aadb-9dbe38e1397b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:29.999501 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0931e5ea-f639-4d60-aadb-9dbe38e1397b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:30.198504 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0931e5ea-f639-4d60-aadb-9dbe38e1397b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:30.208679 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0931e5ea-f639-4d60-aadb-9dbe38e1397b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.226257 Feb 21 01:34:30.209330 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 879/1782] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:29 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:31.225623 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-21da1491-8719-4653-b309-229cb1dedcfe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:31.226231 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-21da1491-8719-4653-b309-229cb1dedcfe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:31.232948 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-21da1491-8719-4653-b309-229cb1dedcfe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:31.233623 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-21da1491-8719-4653-b309-229cb1dedcfe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:31.235850 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-21da1491-8719-4653-b309-229cb1dedcfe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:31.235850 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-21da1491-8719-4653-b309-229cb1dedcfe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:31.378655 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-21da1491-8719-4653-b309-229cb1dedcfe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:31.386370 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-21da1491-8719-4653-b309-229cb1dedcfe tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.164501 Feb 21 01:34:31.386934 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 904/1783] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:31 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:32.403062 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6b349e40-bd85-454b-9f6d-b7c8969049c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:32.403601 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6b349e40-bd85-454b-9f6d-b7c8969049c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:32.410447 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b349e40-bd85-454b-9f6d-b7c8969049c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:32.410886 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b349e40-bd85-454b-9f6d-b7c8969049c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:32.411661 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b349e40-bd85-454b-9f6d-b7c8969049c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:32.412120 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b349e40-bd85-454b-9f6d-b7c8969049c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:32.546021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6b349e40-bd85-454b-9f6d-b7c8969049c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:32.554177 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6b349e40-bd85-454b-9f6d-b7c8969049c8 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154762 Feb 21 01:34:32.554727 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 880/1784] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:32 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:33.570801 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-306b98e1-d58e-4967-99d3-35635751b682 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:33.571379 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-306b98e1-d58e-4967-99d3-35635751b682 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:33.577638 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-306b98e1-d58e-4967-99d3-35635751b682 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:33.578085 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-306b98e1-d58e-4967-99d3-35635751b682 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:33.578896 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-306b98e1-d58e-4967-99d3-35635751b682 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:33.579660 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-306b98e1-d58e-4967-99d3-35635751b682 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:33.709446 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-306b98e1-d58e-4967-99d3-35635751b682 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:33.717170 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-306b98e1-d58e-4967-99d3-35635751b682 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.150174 Feb 21 01:34:33.717730 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 905/1785] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:33 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:34.734362 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8f70914f-4e86-4079-aedc-e0d1860683ae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:34.735547 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8f70914f-4e86-4079-aedc-e0d1860683ae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:34.741965 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8f70914f-4e86-4079-aedc-e0d1860683ae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:34.742409 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8f70914f-4e86-4079-aedc-e0d1860683ae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:34.743207 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8f70914f-4e86-4079-aedc-e0d1860683ae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:34.743640 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8f70914f-4e86-4079-aedc-e0d1860683ae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:34.873077 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8f70914f-4e86-4079-aedc-e0d1860683ae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:34.881943 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8f70914f-4e86-4079-aedc-e0d1860683ae tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.150214 Feb 21 01:34:34.882502 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 881/1786] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:34 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:35.898434 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-eebc5006-4447-43f6-b02a-e5d2508e719b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:35.899107 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-eebc5006-4447-43f6-b02a-e5d2508e719b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:35.905193 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eebc5006-4447-43f6-b02a-e5d2508e719b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:35.905631 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eebc5006-4447-43f6-b02a-e5d2508e719b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:35.906401 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eebc5006-4447-43f6-b02a-e5d2508e719b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:35.906829 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eebc5006-4447-43f6-b02a-e5d2508e719b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:36.050288 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-eebc5006-4447-43f6-b02a-e5d2508e719b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:36.057974 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-eebc5006-4447-43f6-b02a-e5d2508e719b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.163288 Feb 21 01:34:36.058552 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 906/1787] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:35 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:37.075052 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f77699cf-9535-4b01-9c3f-72c1cef9be59 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:37.075689 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f77699cf-9535-4b01-9c3f-72c1cef9be59 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:37.082628 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f77699cf-9535-4b01-9c3f-72c1cef9be59 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:37.083071 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f77699cf-9535-4b01-9c3f-72c1cef9be59 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:37.083863 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f77699cf-9535-4b01-9c3f-72c1cef9be59 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:37.084298 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f77699cf-9535-4b01-9c3f-72c1cef9be59 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:37.215497 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f77699cf-9535-4b01-9c3f-72c1cef9be59 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:37.223411 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f77699cf-9535-4b01-9c3f-72c1cef9be59 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151986 Feb 21 01:34:37.223985 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 882/1788] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:37 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:38.240307 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5b340957-fbaf-418e-834b-704b926b7d55 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:38.241209 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5b340957-fbaf-418e-834b-704b926b7d55 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:38.247440 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5b340957-fbaf-418e-834b-704b926b7d55 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:38.247909 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5b340957-fbaf-418e-834b-704b926b7d55 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:38.248675 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5b340957-fbaf-418e-834b-704b926b7d55 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:38.249098 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5b340957-fbaf-418e-834b-704b926b7d55 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:38.383443 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5b340957-fbaf-418e-834b-704b926b7d55 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:38.391787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5b340957-fbaf-418e-834b-704b926b7d55 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154568 Feb 21 01:34:38.392373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 907/1789] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:38 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:39.408948 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b1ef800f-edde-4dc2-83cb-0915b0b1dbd9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:39.409583 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b1ef800f-edde-4dc2-83cb-0915b0b1dbd9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:39.415773 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b1ef800f-edde-4dc2-83cb-0915b0b1dbd9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:39.416248 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b1ef800f-edde-4dc2-83cb-0915b0b1dbd9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:39.417020 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b1ef800f-edde-4dc2-83cb-0915b0b1dbd9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:39.417457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b1ef800f-edde-4dc2-83cb-0915b0b1dbd9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:39.552142 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b1ef800f-edde-4dc2-83cb-0915b0b1dbd9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:39.559668 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b1ef800f-edde-4dc2-83cb-0915b0b1dbd9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154911 Feb 21 01:34:39.560266 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 883/1790] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:39 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:40.576344 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-19793074-22ef-4ed3-a33b-71c82059fa2b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:40.576963 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-19793074-22ef-4ed3-a33b-71c82059fa2b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:40.583933 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-19793074-22ef-4ed3-a33b-71c82059fa2b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:40.584387 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-19793074-22ef-4ed3-a33b-71c82059fa2b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:40.585162 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-19793074-22ef-4ed3-a33b-71c82059fa2b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:40.585601 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-19793074-22ef-4ed3-a33b-71c82059fa2b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:40.719194 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-19793074-22ef-4ed3-a33b-71c82059fa2b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:40.727191 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-19793074-22ef-4ed3-a33b-71c82059fa2b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154546 Feb 21 01:34:40.727749 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 908/1791] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:40 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:41.743711 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d3168d57-0e0a-43f1-a35f-95cf9b928e4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:41.744490 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d3168d57-0e0a-43f1-a35f-95cf9b928e4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:41.750703 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d3168d57-0e0a-43f1-a35f-95cf9b928e4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:41.751139 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d3168d57-0e0a-43f1-a35f-95cf9b928e4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:41.751952 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d3168d57-0e0a-43f1-a35f-95cf9b928e4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:41.752382 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d3168d57-0e0a-43f1-a35f-95cf9b928e4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:41.883432 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d3168d57-0e0a-43f1-a35f-95cf9b928e4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:41.892017 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d3168d57-0e0a-43f1-a35f-95cf9b928e4f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152217 Feb 21 01:34:41.892585 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 884/1792] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:41 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:42.909280 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7c17d53a-006a-4cd0-8800-d1e053f9d349 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:42.909911 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7c17d53a-006a-4cd0-8800-d1e053f9d349 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:42.916241 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7c17d53a-006a-4cd0-8800-d1e053f9d349 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:42.916689 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7c17d53a-006a-4cd0-8800-d1e053f9d349 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:42.917457 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7c17d53a-006a-4cd0-8800-d1e053f9d349 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:42.917880 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7c17d53a-006a-4cd0-8800-d1e053f9d349 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:43.054515 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7c17d53a-006a-4cd0-8800-d1e053f9d349 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:43.062095 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7c17d53a-006a-4cd0-8800-d1e053f9d349 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.157171 Feb 21 01:34:43.062668 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 909/1793] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:42 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:44.078263 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-eb177825-f66e-4f87-bfff-51b4546e6049 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:44.078907 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-eb177825-f66e-4f87-bfff-51b4546e6049 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:44.085063 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eb177825-f66e-4f87-bfff-51b4546e6049 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:44.085503 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eb177825-f66e-4f87-bfff-51b4546e6049 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:44.086272 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eb177825-f66e-4f87-bfff-51b4546e6049 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:44.086701 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eb177825-f66e-4f87-bfff-51b4546e6049 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:44.218357 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-eb177825-f66e-4f87-bfff-51b4546e6049 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:44.226506 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-eb177825-f66e-4f87-bfff-51b4546e6049 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151858 Feb 21 01:34:44.227064 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 885/1794] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:44 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:45.243952 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-114a2f20-1847-4749-9cbe-fe9f1909c0a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:45.244560 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-114a2f20-1847-4749-9cbe-fe9f1909c0a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:45.251352 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-114a2f20-1847-4749-9cbe-fe9f1909c0a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:45.251792 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-114a2f20-1847-4749-9cbe-fe9f1909c0a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:45.252581 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-114a2f20-1847-4749-9cbe-fe9f1909c0a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:45.253007 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-114a2f20-1847-4749-9cbe-fe9f1909c0a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:45.382676 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-114a2f20-1847-4749-9cbe-fe9f1909c0a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:45.390315 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-114a2f20-1847-4749-9cbe-fe9f1909c0a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.150288 Feb 21 01:34:45.391586 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 910/1795] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:45 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:46.407471 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-102fcf8e-7969-4f8a-bfa9-5c6119d25c34 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:46.408112 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-102fcf8e-7969-4f8a-bfa9-5c6119d25c34 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:46.414444 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-102fcf8e-7969-4f8a-bfa9-5c6119d25c34 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:46.414896 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-102fcf8e-7969-4f8a-bfa9-5c6119d25c34 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:46.415675 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-102fcf8e-7969-4f8a-bfa9-5c6119d25c34 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:46.416144 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-102fcf8e-7969-4f8a-bfa9-5c6119d25c34 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:46.545309 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-102fcf8e-7969-4f8a-bfa9-5c6119d25c34 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:46.553676 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-102fcf8e-7969-4f8a-bfa9-5c6119d25c34 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.150177 Feb 21 01:34:46.554241 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 886/1796] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:46 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:47.570764 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-35795b61-c3f1-48b7-bf13-77e0ad8c319a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:47.571376 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-35795b61-c3f1-48b7-bf13-77e0ad8c319a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:47.577680 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-35795b61-c3f1-48b7-bf13-77e0ad8c319a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:47.578836 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-35795b61-c3f1-48b7-bf13-77e0ad8c319a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:47.579716 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-35795b61-c3f1-48b7-bf13-77e0ad8c319a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:47.580174 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-35795b61-c3f1-48b7-bf13-77e0ad8c319a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:47.713095 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-35795b61-c3f1-48b7-bf13-77e0ad8c319a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:47.721266 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-35795b61-c3f1-48b7-bf13-77e0ad8c319a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154229 Feb 21 01:34:47.721820 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 911/1797] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:47 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:48.738342 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-44f5707f-b5bf-4926-b5d7-9b951fe04fb7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:48.738954 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-44f5707f-b5bf-4926-b5d7-9b951fe04fb7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:48.745648 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-44f5707f-b5bf-4926-b5d7-9b951fe04fb7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:48.746080 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-44f5707f-b5bf-4926-b5d7-9b951fe04fb7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:48.746848 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-44f5707f-b5bf-4926-b5d7-9b951fe04fb7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:48.747273 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-44f5707f-b5bf-4926-b5d7-9b951fe04fb7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:48.895682 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-44f5707f-b5bf-4926-b5d7-9b951fe04fb7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:48.903925 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-44f5707f-b5bf-4926-b5d7-9b951fe04fb7 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.169614 Feb 21 01:34:48.904486 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 887/1798] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:48 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:49.920156 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9e50c3e0-3aad-4b23-aba9-3e9a10283795 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:49.920793 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9e50c3e0-3aad-4b23-aba9-3e9a10283795 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:49.927605 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9e50c3e0-3aad-4b23-aba9-3e9a10283795 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:49.928078 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9e50c3e0-3aad-4b23-aba9-3e9a10283795 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:49.928846 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9e50c3e0-3aad-4b23-aba9-3e9a10283795 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:49.929269 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9e50c3e0-3aad-4b23-aba9-3e9a10283795 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:50.058665 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9e50c3e0-3aad-4b23-aba9-3e9a10283795 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:50.066267 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9e50c3e0-3aad-4b23-aba9-3e9a10283795 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.149855 Feb 21 01:34:50.066986 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 912/1799] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:49 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:51.083178 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-92ebf9f0-3f64-4628-89ad-d53259ead7ce tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:51.083785 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-92ebf9f0-3f64-4628-89ad-d53259ead7ce tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:51.090027 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-92ebf9f0-3f64-4628-89ad-d53259ead7ce tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:51.090478 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-92ebf9f0-3f64-4628-89ad-d53259ead7ce tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:51.091254 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-92ebf9f0-3f64-4628-89ad-d53259ead7ce tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:51.091689 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-92ebf9f0-3f64-4628-89ad-d53259ead7ce tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:51.225263 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-92ebf9f0-3f64-4628-89ad-d53259ead7ce tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:51.232948 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-92ebf9f0-3f64-4628-89ad-d53259ead7ce tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.153686 Feb 21 01:34:51.233502 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 888/1800] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:51 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:52.250450 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7b6406f0-9f91-495d-b0c0-550e50e9c2eb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:52.251057 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7b6406f0-9f91-495d-b0c0-550e50e9c2eb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:52.257373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7b6406f0-9f91-495d-b0c0-550e50e9c2eb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:52.257820 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7b6406f0-9f91-495d-b0c0-550e50e9c2eb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:52.258602 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7b6406f0-9f91-495d-b0c0-550e50e9c2eb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:52.259035 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7b6406f0-9f91-495d-b0c0-550e50e9c2eb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:52.393190 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7b6406f0-9f91-495d-b0c0-550e50e9c2eb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:52.400762 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7b6406f0-9f91-495d-b0c0-550e50e9c2eb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.153950 Feb 21 01:34:52.401317 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 913/1801] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:52 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:53.418056 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5df78461-82f8-47ee-877c-bb0e2cdc3503 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:53.418671 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5df78461-82f8-47ee-877c-bb0e2cdc3503 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:53.426106 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5df78461-82f8-47ee-877c-bb0e2cdc3503 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:53.426555 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5df78461-82f8-47ee-877c-bb0e2cdc3503 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:53.427333 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5df78461-82f8-47ee-877c-bb0e2cdc3503 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:53.427770 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5df78461-82f8-47ee-877c-bb0e2cdc3503 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:53.557524 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5df78461-82f8-47ee-877c-bb0e2cdc3503 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:53.565702 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5df78461-82f8-47ee-877c-bb0e2cdc3503 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151257 Feb 21 01:34:53.566285 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 889/1802] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:53 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:54.582751 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-787754af-1230-485d-92a1-1853d477f35b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:54.583359 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-787754af-1230-485d-92a1-1853d477f35b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:54.589635 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-787754af-1230-485d-92a1-1853d477f35b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:54.590081 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-787754af-1230-485d-92a1-1853d477f35b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:54.590859 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-787754af-1230-485d-92a1-1853d477f35b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:54.591292 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-787754af-1230-485d-92a1-1853d477f35b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:54.723752 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-787754af-1230-485d-92a1-1853d477f35b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:54.731611 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-787754af-1230-485d-92a1-1853d477f35b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152996 Feb 21 01:34:54.732363 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 914/1803] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:54 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:55.748112 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-86850d3d-2b56-4149-8464-3b76c094591f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:55.748742 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-86850d3d-2b56-4149-8464-3b76c094591f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:55.755388 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-86850d3d-2b56-4149-8464-3b76c094591f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:55.755847 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-86850d3d-2b56-4149-8464-3b76c094591f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:55.756634 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-86850d3d-2b56-4149-8464-3b76c094591f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:55.757239 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-86850d3d-2b56-4149-8464-3b76c094591f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:55.899098 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-86850d3d-2b56-4149-8464-3b76c094591f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:55.907030 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-86850d3d-2b56-4149-8464-3b76c094591f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.162566 Feb 21 01:34:55.907528 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 890/1804] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:55 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:56.923579 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3b1b298d-2930-4e8b-af0c-6565469cdbf4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:56.924221 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3b1b298d-2930-4e8b-af0c-6565469cdbf4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:56.930954 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b1b298d-2930-4e8b-af0c-6565469cdbf4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:56.931535 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b1b298d-2930-4e8b-af0c-6565469cdbf4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:56.932349 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b1b298d-2930-4e8b-af0c-6565469cdbf4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:56.932784 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b1b298d-2930-4e8b-af0c-6565469cdbf4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:57.065274 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3b1b298d-2930-4e8b-af0c-6565469cdbf4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:57.073861 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3b1b298d-2930-4e8b-af0c-6565469cdbf4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.153879 Feb 21 01:34:57.074448 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 915/1805] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:56 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:58.091284 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-53a9b189-e432-4fcd-a35d-c9cfd0a2df37 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:58.091888 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-53a9b189-e432-4fcd-a35d-c9cfd0a2df37 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:58.098592 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-53a9b189-e432-4fcd-a35d-c9cfd0a2df37 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:58.099043 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-53a9b189-e432-4fcd-a35d-c9cfd0a2df37 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:58.099826 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-53a9b189-e432-4fcd-a35d-c9cfd0a2df37 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:58.100312 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-53a9b189-e432-4fcd-a35d-c9cfd0a2df37 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:58.231156 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-53a9b189-e432-4fcd-a35d-c9cfd0a2df37 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:58.239060 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-53a9b189-e432-4fcd-a35d-c9cfd0a2df37 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.151494 Feb 21 01:34:58.239929 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 891/1806] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:58 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:59.256656 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9df13f2d-d21a-440b-8e32-bb0ca512370d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:59.257258 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9df13f2d-d21a-440b-8e32-bb0ca512370d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:59.263395 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9df13f2d-d21a-440b-8e32-bb0ca512370d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:59.263850 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9df13f2d-d21a-440b-8e32-bb0ca512370d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:59.264622 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9df13f2d-d21a-440b-8e32-bb0ca512370d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:59.265046 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9df13f2d-d21a-440b-8e32-bb0ca512370d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:59.399608 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9df13f2d-d21a-440b-8e32-bb0ca512370d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:59.407360 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9df13f2d-d21a-440b-8e32-bb0ca512370d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.154961 Feb 21 01:34:59.408231 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 916/1807] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:59 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:00.426027 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f0908022-2e86-4f7f-b91c-206b2841f3a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:00.426648 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f0908022-2e86-4f7f-b91c-206b2841f3a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:00.432910 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f0908022-2e86-4f7f-b91c-206b2841f3a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:00.433362 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f0908022-2e86-4f7f-b91c-206b2841f3a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:00.434204 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f0908022-2e86-4f7f-b91c-206b2841f3a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:00.434641 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f0908022-2e86-4f7f-b91c-206b2841f3a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:00.567028 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f0908022-2e86-4f7f-b91c-206b2841f3a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:00.574702 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f0908022-2e86-4f7f-b91c-206b2841f3a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.153519 Feb 21 01:35:00.575260 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 892/1808] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:00 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:01.591367 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-79b3902d-1ca1-4f1f-b616-4e373f209042 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:01.592003 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-79b3902d-1ca1-4f1f-b616-4e373f209042 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:01.598181 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-79b3902d-1ca1-4f1f-b616-4e373f209042 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:01.598629 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-79b3902d-1ca1-4f1f-b616-4e373f209042 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:01.599400 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-79b3902d-1ca1-4f1f-b616-4e373f209042 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:01.599860 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-79b3902d-1ca1-4f1f-b616-4e373f209042 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:01.728642 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-79b3902d-1ca1-4f1f-b616-4e373f209042 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:01.736372 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-79b3902d-1ca1-4f1f-b616-4e373f209042 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.148657 Feb 21 01:35:01.736952 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 917/1809] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:01 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:02.753129 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-dd3c962a-7301-4e18-b71a-449e0cfa8d11 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:02.753737 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-dd3c962a-7301-4e18-b71a-449e0cfa8d11 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:02.760137 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dd3c962a-7301-4e18-b71a-449e0cfa8d11 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:02.760574 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dd3c962a-7301-4e18-b71a-449e0cfa8d11 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:02.761344 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dd3c962a-7301-4e18-b71a-449e0cfa8d11 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:02.761770 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dd3c962a-7301-4e18-b71a-449e0cfa8d11 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:02.894631 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-dd3c962a-7301-4e18-b71a-449e0cfa8d11 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:02.902269 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-dd3c962a-7301-4e18-b71a-449e0cfa8d11 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.152812 Feb 21 01:35:02.902817 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 893/1810] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:02 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:03.920075 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4df66840-2cfd-4fd0-98a4-dec2453fdff5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:03.920686 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4df66840-2cfd-4fd0-98a4-dec2453fdff5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:03.927754 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4df66840-2cfd-4fd0-98a4-dec2453fdff5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:03.928221 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4df66840-2cfd-4fd0-98a4-dec2453fdff5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:03.928993 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4df66840-2cfd-4fd0-98a4-dec2453fdff5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:03.929420 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4df66840-2cfd-4fd0-98a4-dec2453fdff5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:04.062450 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4df66840-2cfd-4fd0-98a4-dec2453fdff5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:04.070099 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4df66840-2cfd-4fd0-98a4-dec2453fdff5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.153722 Feb 21 01:35:04.070642 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 918/1811] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:03 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:05.086978 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-946fd1cd-1fea-4b07-84d2-832f239a4383 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:05.087590 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-946fd1cd-1fea-4b07-84d2-832f239a4383 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:05.093727 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-946fd1cd-1fea-4b07-84d2-832f239a4383 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:05.094179 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-946fd1cd-1fea-4b07-84d2-832f239a4383 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:05.094956 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-946fd1cd-1fea-4b07-84d2-832f239a4383 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:05.095388 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-946fd1cd-1fea-4b07-84d2-832f239a4383 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:05.380709 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-946fd1cd-1fea-4b07-84d2-832f239a4383 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:05.389133 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-946fd1cd-1fea-4b07-84d2-832f239a4383 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1560 microversion: 2.1 time: 0.305804 Feb 21 01:35:05.389682 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 894/1812] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:05 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1560 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:05.981083 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-9a736e21-70c2-46c1-9b68-5580a9d5a76e req-95802073-63ce-4325-912c-24b1cf832faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d1f7594-329f-44cb-a627-184aa02bd0fc", "name": "network-vif-deleted", "tag": "9a617465-d24d-4c1a-b319-2adef58652a5"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:35:05.982640 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:35:05.982640 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:35:05.990630 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-9a736e21-70c2-46c1-9b68-5580a9d5a76e req-95802073-63ce-4325-912c-24b1cf832faf service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:05.991069 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-9a736e21-70c2-46c1-9b68-5580a9d5a76e req-95802073-63ce-4325-912c-24b1cf832faf service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:06.001602 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-9a736e21-70c2-46c1-9b68-5580a9d5a76e req-95802073-63ce-4325-912c-24b1cf832faf service nova] Creating event network-vif-deleted:9a617465-d24d-4c1a-b319-2adef58652a5 for instance 9d1f7594-329f-44cb-a627-184aa02bd0fc on hv-cinder-81322 Feb 21 01:35:06.008068 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-9a736e21-70c2-46c1-9b68-5580a9d5a76e req-95802073-63ce-4325-912c-24b1cf832faf service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031153 Feb 21 01:35:06.008640 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 919/1813] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:35:06.405704 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-83c04e6b-a6c3-4153-a14d-8a000d3960b5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:06.406309 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-83c04e6b-a6c3-4153-a14d-8a000d3960b5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:06.413516 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-83c04e6b-a6c3-4153-a14d-8a000d3960b5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:06.413970 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-83c04e6b-a6c3-4153-a14d-8a000d3960b5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:06.415822 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-83c04e6b-a6c3-4153-a14d-8a000d3960b5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:06.415822 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-83c04e6b-a6c3-4153-a14d-8a000d3960b5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:06.477319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-83c04e6b-a6c3-4153-a14d-8a000d3960b5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:06.485082 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-83c04e6b-a6c3-4153-a14d-8a000d3960b5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.083117 Feb 21 01:35:06.485635 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 895/1814] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:06 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:07.503896 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7b6091cd-5704-44f9-8de2-624740469a30 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:07.504601 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7b6091cd-5704-44f9-8de2-624740469a30 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:07.510575 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7b6091cd-5704-44f9-8de2-624740469a30 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:07.511060 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7b6091cd-5704-44f9-8de2-624740469a30 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:07.511869 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7b6091cd-5704-44f9-8de2-624740469a30 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:07.512308 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7b6091cd-5704-44f9-8de2-624740469a30 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:07.580705 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7b6091cd-5704-44f9-8de2-624740469a30 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:07.588530 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7b6091cd-5704-44f9-8de2-624740469a30 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.089731 Feb 21 01:35:07.589093 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 920/1815] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:07 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:08.605436 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f23f1f0f-2a0d-4d21-93b1-1fe8a36d3e3a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:08.606044 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f23f1f0f-2a0d-4d21-93b1-1fe8a36d3e3a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:08.612294 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f23f1f0f-2a0d-4d21-93b1-1fe8a36d3e3a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:08.612735 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f23f1f0f-2a0d-4d21-93b1-1fe8a36d3e3a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:08.613503 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f23f1f0f-2a0d-4d21-93b1-1fe8a36d3e3a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:08.613946 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f23f1f0f-2a0d-4d21-93b1-1fe8a36d3e3a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:08.672186 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f23f1f0f-2a0d-4d21-93b1-1fe8a36d3e3a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:08.680453 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f23f1f0f-2a0d-4d21-93b1-1fe8a36d3e3a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.078543 Feb 21 01:35:08.681026 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 896/1816] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:08 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:09.696677 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1c08a99b-aedd-468a-8319-e693779c8b72 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:09.697302 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1c08a99b-aedd-468a-8319-e693779c8b72 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:09.703437 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c08a99b-aedd-468a-8319-e693779c8b72 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:09.703910 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c08a99b-aedd-468a-8319-e693779c8b72 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:09.704689 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c08a99b-aedd-468a-8319-e693779c8b72 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:09.705124 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c08a99b-aedd-468a-8319-e693779c8b72 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:09.817304 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1c08a99b-aedd-468a-8319-e693779c8b72 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:09.825080 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1c08a99b-aedd-468a-8319-e693779c8b72 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.132020 Feb 21 01:35:09.825700 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 921/1817] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:09 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:10.845477 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-43407f26-216d-4e76-82cb-05f98e0b6018 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:10.846597 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-43407f26-216d-4e76-82cb-05f98e0b6018 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:10.852721 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-43407f26-216d-4e76-82cb-05f98e0b6018 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:10.853165 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-43407f26-216d-4e76-82cb-05f98e0b6018 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:10.853934 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-43407f26-216d-4e76-82cb-05f98e0b6018 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:10.854359 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-43407f26-216d-4e76-82cb-05f98e0b6018 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:10.915146 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-43407f26-216d-4e76-82cb-05f98e0b6018 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:10.925353 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-43407f26-216d-4e76-82cb-05f98e0b6018 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.083424 Feb 21 01:35:10.925913 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 897/1818] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:10 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:11.942808 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2e6f9f4c-497f-47d4-86be-cdf28aa221fb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:11.943419 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2e6f9f4c-497f-47d4-86be-cdf28aa221fb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:11.949743 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e6f9f4c-497f-47d4-86be-cdf28aa221fb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:11.950199 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e6f9f4c-497f-47d4-86be-cdf28aa221fb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:11.950990 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e6f9f4c-497f-47d4-86be-cdf28aa221fb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:11.951429 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e6f9f4c-497f-47d4-86be-cdf28aa221fb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:12.012724 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2e6f9f4c-497f-47d4-86be-cdf28aa221fb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:12.020465 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2e6f9f4c-497f-47d4-86be-cdf28aa221fb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.082387 Feb 21 01:35:12.021012 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 922/1819] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:11 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:13.036397 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b6b936ce-6861-444e-a7db-004129eb338c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:13.036934 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b6b936ce-6861-444e-a7db-004129eb338c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:13.043136 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b6b936ce-6861-444e-a7db-004129eb338c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:13.043582 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b6b936ce-6861-444e-a7db-004129eb338c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:13.044390 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b6b936ce-6861-444e-a7db-004129eb338c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:13.044826 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b6b936ce-6861-444e-a7db-004129eb338c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:13.106907 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b6b936ce-6861-444e-a7db-004129eb338c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:13.115332 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b6b936ce-6861-444e-a7db-004129eb338c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.082598 Feb 21 01:35:13.115930 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 898/1820] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:13 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:14.131554 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4070c9b7-2ebe-4049-adb9-97858e00eaa0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:14.132112 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4070c9b7-2ebe-4049-adb9-97858e00eaa0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:14.138366 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4070c9b7-2ebe-4049-adb9-97858e00eaa0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:14.138822 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4070c9b7-2ebe-4049-adb9-97858e00eaa0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:14.139599 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4070c9b7-2ebe-4049-adb9-97858e00eaa0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:14.140064 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4070c9b7-2ebe-4049-adb9-97858e00eaa0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:14.202191 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4070c9b7-2ebe-4049-adb9-97858e00eaa0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:14.210563 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4070c9b7-2ebe-4049-adb9-97858e00eaa0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.083073 Feb 21 01:35:14.211118 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 923/1821] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:14 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:15.226843 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7489ed19-8560-47ed-b357-063079dc0fa5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:15.227456 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7489ed19-8560-47ed-b357-063079dc0fa5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:15.233702 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7489ed19-8560-47ed-b357-063079dc0fa5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:15.234157 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7489ed19-8560-47ed-b357-063079dc0fa5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:15.234934 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7489ed19-8560-47ed-b357-063079dc0fa5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:15.235388 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7489ed19-8560-47ed-b357-063079dc0fa5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:15.293959 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7489ed19-8560-47ed-b357-063079dc0fa5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:15.302604 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7489ed19-8560-47ed-b357-063079dc0fa5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.079505 Feb 21 01:35:15.303169 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 899/1822] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:15 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:16.319228 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6163b37b-19c6-4d2f-8801-1e3413003039 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:16.319905 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6163b37b-19c6-4d2f-8801-1e3413003039 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:16.326282 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6163b37b-19c6-4d2f-8801-1e3413003039 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:16.326728 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6163b37b-19c6-4d2f-8801-1e3413003039 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:16.327507 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6163b37b-19c6-4d2f-8801-1e3413003039 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:16.327977 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6163b37b-19c6-4d2f-8801-1e3413003039 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:16.387896 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-6163b37b-19c6-4d2f-8801-1e3413003039 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:16.396584 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6163b37b-19c6-4d2f-8801-1e3413003039 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.081010 Feb 21 01:35:16.397151 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 924/1823] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:16 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:17.414614 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-24615376-53ec-4767-a9c8-edace267ebcb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:17.415250 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-24615376-53ec-4767-a9c8-edace267ebcb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:17.421409 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-24615376-53ec-4767-a9c8-edace267ebcb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:17.421844 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-24615376-53ec-4767-a9c8-edace267ebcb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:17.422606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-24615376-53ec-4767-a9c8-edace267ebcb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:17.423030 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-24615376-53ec-4767-a9c8-edace267ebcb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:17.483458 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-24615376-53ec-4767-a9c8-edace267ebcb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:17.492001 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-24615376-53ec-4767-a9c8-edace267ebcb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.080990 Feb 21 01:35:17.492871 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 900/1824] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:17 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:18.509184 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-57464996-cc93-4b1b-9ca1-506d7d76ebb3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:18.509818 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-57464996-cc93-4b1b-9ca1-506d7d76ebb3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:18.516349 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57464996-cc93-4b1b-9ca1-506d7d76ebb3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:18.516797 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57464996-cc93-4b1b-9ca1-506d7d76ebb3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:18.517583 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57464996-cc93-4b1b-9ca1-506d7d76ebb3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:18.518008 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-57464996-cc93-4b1b-9ca1-506d7d76ebb3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:18.578286 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-57464996-cc93-4b1b-9ca1-506d7d76ebb3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:18.586223 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-57464996-cc93-4b1b-9ca1-506d7d76ebb3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.080710 Feb 21 01:35:18.586788 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 925/1825] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:18 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:19.602573 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-259253e4-7935-426f-b656-cc14c2716d8d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:19.603182 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-259253e4-7935-426f-b656-cc14c2716d8d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:19.609739 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-259253e4-7935-426f-b656-cc14c2716d8d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:19.610185 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-259253e4-7935-426f-b656-cc14c2716d8d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:19.610956 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-259253e4-7935-426f-b656-cc14c2716d8d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:19.612556 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-259253e4-7935-426f-b656-cc14c2716d8d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:19.671513 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-259253e4-7935-426f-b656-cc14c2716d8d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:19.680392 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-259253e4-7935-426f-b656-cc14c2716d8d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.081478 Feb 21 01:35:19.680953 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 901/1826] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:19 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:20.697970 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-40bfe0ab-d38d-4739-be4f-e3044d7f6ce5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:20.698529 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-40bfe0ab-d38d-4739-be4f-e3044d7f6ce5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:20.705315 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-40bfe0ab-d38d-4739-be4f-e3044d7f6ce5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:20.705756 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-40bfe0ab-d38d-4739-be4f-e3044d7f6ce5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:20.706530 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-40bfe0ab-d38d-4739-be4f-e3044d7f6ce5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:20.706960 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-40bfe0ab-d38d-4739-be4f-e3044d7f6ce5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:20.768812 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-40bfe0ab-d38d-4739-be4f-e3044d7f6ce5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:20.776467 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-40bfe0ab-d38d-4739-be4f-e3044d7f6ce5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.082189 Feb 21 01:35:20.777034 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 926/1827] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:20 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:21.794021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3c69db11-c870-4de4-b67a-e4f5d6a870f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:21.794616 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3c69db11-c870-4de4-b67a-e4f5d6a870f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:21.801698 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3c69db11-c870-4de4-b67a-e4f5d6a870f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:21.802134 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3c69db11-c870-4de4-b67a-e4f5d6a870f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:21.802895 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3c69db11-c870-4de4-b67a-e4f5d6a870f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:21.803324 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3c69db11-c870-4de4-b67a-e4f5d6a870f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:21.862227 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3c69db11-c870-4de4-b67a-e4f5d6a870f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:21.870033 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3c69db11-c870-4de4-b67a-e4f5d6a870f5 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.079685 Feb 21 01:35:21.870586 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 902/1828] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:21 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:22.886247 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-071292d5-3918-48f2-a62e-7371a44b01a9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:22.886850 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-071292d5-3918-48f2-a62e-7371a44b01a9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:22.893791 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-071292d5-3918-48f2-a62e-7371a44b01a9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:22.894410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-071292d5-3918-48f2-a62e-7371a44b01a9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:22.895190 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-071292d5-3918-48f2-a62e-7371a44b01a9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:22.895637 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-071292d5-3918-48f2-a62e-7371a44b01a9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:22.954016 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-071292d5-3918-48f2-a62e-7371a44b01a9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:22.961676 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-071292d5-3918-48f2-a62e-7371a44b01a9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.078974 Feb 21 01:35:22.962228 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 927/1829] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:22 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:23.977730 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c06d5e2f-efd1-4f0b-a4e4-b4f3324b726a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:23.978357 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c06d5e2f-efd1-4f0b-a4e4-b4f3324b726a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:23.984766 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c06d5e2f-efd1-4f0b-a4e4-b4f3324b726a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:23.985249 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c06d5e2f-efd1-4f0b-a4e4-b4f3324b726a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:23.986721 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c06d5e2f-efd1-4f0b-a4e4-b4f3324b726a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:23.987305 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c06d5e2f-efd1-4f0b-a4e4-b4f3324b726a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:24.049627 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c06d5e2f-efd1-4f0b-a4e4-b4f3324b726a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:24.057240 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c06d5e2f-efd1-4f0b-a4e4-b4f3324b726a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.083200 Feb 21 01:35:24.057803 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 903/1830] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:23 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:25.072803 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7793562b-aa31-4661-9a74-249ad126ad57 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:25.073416 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7793562b-aa31-4661-9a74-249ad126ad57 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:25.080576 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7793562b-aa31-4661-9a74-249ad126ad57 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:25.081028 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7793562b-aa31-4661-9a74-249ad126ad57 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:25.081959 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7793562b-aa31-4661-9a74-249ad126ad57 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:25.082395 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7793562b-aa31-4661-9a74-249ad126ad57 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:25.140670 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7793562b-aa31-4661-9a74-249ad126ad57 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:25.149020 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7793562b-aa31-4661-9a74-249ad126ad57 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.079882 Feb 21 01:35:25.149573 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 928/1831] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:25 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:26.165563 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fbdf8797-60f2-4e91-aa2a-d90c0d3e76a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:26.166252 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fbdf8797-60f2-4e91-aa2a-d90c0d3e76a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:26.172362 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fbdf8797-60f2-4e91-aa2a-d90c0d3e76a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:26.172807 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fbdf8797-60f2-4e91-aa2a-d90c0d3e76a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:26.174111 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fbdf8797-60f2-4e91-aa2a-d90c0d3e76a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:26.174551 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fbdf8797-60f2-4e91-aa2a-d90c0d3e76a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:26.232841 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fbdf8797-60f2-4e91-aa2a-d90c0d3e76a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:26.241341 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fbdf8797-60f2-4e91-aa2a-d90c0d3e76a2 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.079464 Feb 21 01:35:26.241898 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 904/1832] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:26 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:27.258258 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-dc2836f4-1ff8-494c-a612-09db9b7047db tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:27.258870 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-dc2836f4-1ff8-494c-a612-09db9b7047db tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:27.264940 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dc2836f4-1ff8-494c-a612-09db9b7047db tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:27.265392 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dc2836f4-1ff8-494c-a612-09db9b7047db tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:27.266212 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dc2836f4-1ff8-494c-a612-09db9b7047db tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:27.266654 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dc2836f4-1ff8-494c-a612-09db9b7047db tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:27.330776 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-dc2836f4-1ff8-494c-a612-09db9b7047db tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:27.338598 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-dc2836f4-1ff8-494c-a612-09db9b7047db tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.084033 Feb 21 01:35:27.343326 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 929/1833] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:27 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:28.355256 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fab84261-f523-4163-b335-8c5198c1e27f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:28.355904 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fab84261-f523-4163-b335-8c5198c1e27f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:28.362624 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fab84261-f523-4163-b335-8c5198c1e27f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:28.363075 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fab84261-f523-4163-b335-8c5198c1e27f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:28.364146 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fab84261-f523-4163-b335-8c5198c1e27f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:28.364582 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fab84261-f523-4163-b335-8c5198c1e27f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:28.424029 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fab84261-f523-4163-b335-8c5198c1e27f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:28.431796 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fab84261-f523-4163-b335-8c5198c1e27f tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.080217 Feb 21 01:35:28.432387 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 905/1834] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:28 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:29.447280 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-01bd5333-8a24-4b3a-b80b-abb349d2306e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:29.447915 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-01bd5333-8a24-4b3a-b80b-abb349d2306e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:29.454170 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-01bd5333-8a24-4b3a-b80b-abb349d2306e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:29.454853 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-01bd5333-8a24-4b3a-b80b-abb349d2306e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:29.455905 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-01bd5333-8a24-4b3a-b80b-abb349d2306e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:29.456346 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-01bd5333-8a24-4b3a-b80b-abb349d2306e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:29.516309 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-01bd5333-8a24-4b3a-b80b-abb349d2306e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:29.524373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-01bd5333-8a24-4b3a-b80b-abb349d2306e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.080686 Feb 21 01:35:29.524945 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 930/1835] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:29 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:30.541846 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-500f6e5e-ef90-48b0-b780-7acc22117e6c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:30.542455 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-500f6e5e-ef90-48b0-b780-7acc22117e6c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:30.549277 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-500f6e5e-ef90-48b0-b780-7acc22117e6c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:30.549721 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-500f6e5e-ef90-48b0-b780-7acc22117e6c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:30.550496 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-500f6e5e-ef90-48b0-b780-7acc22117e6c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:30.550924 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-500f6e5e-ef90-48b0-b780-7acc22117e6c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:30.612121 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-500f6e5e-ef90-48b0-b780-7acc22117e6c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:30.620259 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-500f6e5e-ef90-48b0-b780-7acc22117e6c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.082075 Feb 21 01:35:30.620835 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 906/1836] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:30 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:31.637891 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2e1b9301-1678-4e24-8e85-1a26adde8b8c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:31.638510 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2e1b9301-1678-4e24-8e85-1a26adde8b8c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:31.645281 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e1b9301-1678-4e24-8e85-1a26adde8b8c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:31.645728 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e1b9301-1678-4e24-8e85-1a26adde8b8c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:31.646503 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e1b9301-1678-4e24-8e85-1a26adde8b8c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:31.646936 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e1b9301-1678-4e24-8e85-1a26adde8b8c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:31.706153 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2e1b9301-1678-4e24-8e85-1a26adde8b8c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:31.713731 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2e1b9301-1678-4e24-8e85-1a26adde8b8c tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.079497 Feb 21 01:35:31.714296 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 931/1837] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:31 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:32.730069 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1bdd1712-3bd6-4ff3-b696-85f25acb1b31 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:32.730700 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1bdd1712-3bd6-4ff3-b696-85f25acb1b31 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:32.737371 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1bdd1712-3bd6-4ff3-b696-85f25acb1b31 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:32.737799 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1bdd1712-3bd6-4ff3-b696-85f25acb1b31 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:32.738812 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1bdd1712-3bd6-4ff3-b696-85f25acb1b31 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:32.739230 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1bdd1712-3bd6-4ff3-b696-85f25acb1b31 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:32.954689 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1bdd1712-3bd6-4ff3-b696-85f25acb1b31 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:32.962575 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1bdd1712-3bd6-4ff3-b696-85f25acb1b31 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.236127 Feb 21 01:35:32.963119 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 907/1838] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:32 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:33.979641 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3015795d-2429-4c32-a66a-f99adf6a1fed tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:33.980323 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3015795d-2429-4c32-a66a-f99adf6a1fed tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:33.987293 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3015795d-2429-4c32-a66a-f99adf6a1fed tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:33.987742 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3015795d-2429-4c32-a66a-f99adf6a1fed tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:33.988819 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3015795d-2429-4c32-a66a-f99adf6a1fed tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:33.989255 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3015795d-2429-4c32-a66a-f99adf6a1fed tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:34.048932 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3015795d-2429-4c32-a66a-f99adf6a1fed tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:34.056692 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3015795d-2429-4c32-a66a-f99adf6a1fed tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.080724 Feb 21 01:35:34.057249 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 932/1839] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:33 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:35.072910 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ee60480f-223b-4627-8d1e-92061b2fad8a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:35.073517 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ee60480f-223b-4627-8d1e-92061b2fad8a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:35.079979 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee60480f-223b-4627-8d1e-92061b2fad8a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:35.080422 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee60480f-223b-4627-8d1e-92061b2fad8a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:35.081189 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee60480f-223b-4627-8d1e-92061b2fad8a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:35.081614 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee60480f-223b-4627-8d1e-92061b2fad8a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:35.139788 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ee60480f-223b-4627-8d1e-92061b2fad8a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:35.148508 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ee60480f-223b-4627-8d1e-92061b2fad8a tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.079224 Feb 21 01:35:35.149054 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 908/1840] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:35 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:36.165788 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a871d1bd-f349-45c5-a1bc-1659b491dda3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:36.166396 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a871d1bd-f349-45c5-a1bc-1659b491dda3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:36.172400 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a871d1bd-f349-45c5-a1bc-1659b491dda3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:36.173499 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a871d1bd-f349-45c5-a1bc-1659b491dda3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:36.175034 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a871d1bd-f349-45c5-a1bc-1659b491dda3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:36.175468 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a871d1bd-f349-45c5-a1bc-1659b491dda3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:36.236024 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a871d1bd-f349-45c5-a1bc-1659b491dda3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:36.244784 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a871d1bd-f349-45c5-a1bc-1659b491dda3 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.082553 Feb 21 01:35:36.245370 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 933/1841] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:36 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:37.261333 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6a361358-96d2-4027-b590-f3772b44698d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:37.261921 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6a361358-96d2-4027-b590-f3772b44698d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:37.268141 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6a361358-96d2-4027-b590-f3772b44698d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:37.270398 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6a361358-96d2-4027-b590-f3772b44698d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:37.270398 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6a361358-96d2-4027-b590-f3772b44698d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:37.270398 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6a361358-96d2-4027-b590-f3772b44698d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:37.333971 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6a361358-96d2-4027-b590-f3772b44698d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:37.341680 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6a361358-96d2-4027-b590-f3772b44698d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.083943 Feb 21 01:35:37.351402 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 909/1842] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:37 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:38.361444 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f1be225c-1c77-4acd-85f5-1347fd5ec863 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:38.362060 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f1be225c-1c77-4acd-85f5-1347fd5ec863 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:38.368565 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f1be225c-1c77-4acd-85f5-1347fd5ec863 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:38.369017 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f1be225c-1c77-4acd-85f5-1347fd5ec863 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:38.369833 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f1be225c-1c77-4acd-85f5-1347fd5ec863 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:38.370299 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f1be225c-1c77-4acd-85f5-1347fd5ec863 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:38.433166 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f1be225c-1c77-4acd-85f5-1347fd5ec863 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:38.441228 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f1be225c-1c77-4acd-85f5-1347fd5ec863 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.083806 Feb 21 01:35:38.441785 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 934/1843] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:38 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:39.457760 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-bf98d356-fc69-438a-8d7b-0e93a9a14d00 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:39.458480 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-bf98d356-fc69-438a-8d7b-0e93a9a14d00 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:39.464670 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bf98d356-fc69-438a-8d7b-0e93a9a14d00 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:39.465114 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bf98d356-fc69-438a-8d7b-0e93a9a14d00 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:39.465893 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bf98d356-fc69-438a-8d7b-0e93a9a14d00 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:39.466319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bf98d356-fc69-438a-8d7b-0e93a9a14d00 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:39.525397 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bf98d356-fc69-438a-8d7b-0e93a9a14d00 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:39.533270 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-bf98d356-fc69-438a-8d7b-0e93a9a14d00 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.079852 Feb 21 01:35:39.533810 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 910/1844] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:39 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:40.549490 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-708f0ee3-c106-4f36-99a2-02a69cf1d393 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:40.550097 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-708f0ee3-c106-4f36-99a2-02a69cf1d393 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:40.556258 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-708f0ee3-c106-4f36-99a2-02a69cf1d393 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:40.556646 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-708f0ee3-c106-4f36-99a2-02a69cf1d393 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:40.557483 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-708f0ee3-c106-4f36-99a2-02a69cf1d393 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:40.557914 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-708f0ee3-c106-4f36-99a2-02a69cf1d393 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:40.621618 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-708f0ee3-c106-4f36-99a2-02a69cf1d393 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:40.629770 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-708f0ee3-c106-4f36-99a2-02a69cf1d393 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.083896 Feb 21 01:35:40.630318 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 935/1845] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:40 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:41.646241 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6bf5bcc6-c8f8-4bc3-aaab-fafe250535ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:41.646851 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6bf5bcc6-c8f8-4bc3-aaab-fafe250535ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:41.652980 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6bf5bcc6-c8f8-4bc3-aaab-fafe250535ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:41.653424 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6bf5bcc6-c8f8-4bc3-aaab-fafe250535ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:41.654197 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6bf5bcc6-c8f8-4bc3-aaab-fafe250535ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:41.654627 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6bf5bcc6-c8f8-4bc3-aaab-fafe250535ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:41.713939 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6bf5bcc6-c8f8-4bc3-aaab-fafe250535ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:41.722804 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6bf5bcc6-c8f8-4bc3-aaab-fafe250535ea tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.080123 Feb 21 01:35:41.723356 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 911/1846] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:41 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:35:42.740456 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d0c6e359-1499-4b95-b081-4968f8c153ac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:42.741558 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d0c6e359-1499-4b95-b081-4968f8c153ac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:42.749390 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d0c6e359-1499-4b95-b081-4968f8c153ac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:42.749836 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d0c6e359-1499-4b95-b081-4968f8c153ac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:42.751819 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d0c6e359-1499-4b95-b081-4968f8c153ac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:42.752441 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d0c6e359-1499-4b95-b081-4968f8c153ac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:42.814661 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d0c6e359-1499-4b95-b081-4968f8c153ac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:42.822330 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d0c6e359-1499-4b95-b081-4968f8c153ac tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.086468 Feb 21 01:35:42.822883 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 936/1847] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:42 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:43.838904 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-afb60722-0077-4c99-89b7-a54040a6e490 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:43.839512 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-afb60722-0077-4c99-89b7-a54040a6e490 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:43.845903 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-afb60722-0077-4c99-89b7-a54040a6e490 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:43.846349 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-afb60722-0077-4c99-89b7-a54040a6e490 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:43.847128 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-afb60722-0077-4c99-89b7-a54040a6e490 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:43.847560 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-afb60722-0077-4c99-89b7-a54040a6e490 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:43.909993 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-afb60722-0077-4c99-89b7-a54040a6e490 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:43.917675 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-afb60722-0077-4c99-89b7-a54040a6e490 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.082346 Feb 21 01:35:43.918163 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 912/1848] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:43 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:44.934216 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-bfd57a02-e6ae-4782-8629-94fd61234810 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:44.934885 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-bfd57a02-e6ae-4782-8629-94fd61234810 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:44.941330 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bfd57a02-e6ae-4782-8629-94fd61234810 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:44.941768 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bfd57a02-e6ae-4782-8629-94fd61234810 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:44.942542 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bfd57a02-e6ae-4782-8629-94fd61234810 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:44.942967 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bfd57a02-e6ae-4782-8629-94fd61234810 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:45.002377 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-bfd57a02-e6ae-4782-8629-94fd61234810 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:45.009991 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-bfd57a02-e6ae-4782-8629-94fd61234810 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.079504 Feb 21 01:35:45.010537 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 937/1849] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:44 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:46.026204 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a0be83aa-e74d-47d7-85c8-c4a68e0a0c82 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:46.026812 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a0be83aa-e74d-47d7-85c8-c4a68e0a0c82 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:46.033506 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a0be83aa-e74d-47d7-85c8-c4a68e0a0c82 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:46.036627 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a0be83aa-e74d-47d7-85c8-c4a68e0a0c82 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:46.036627 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a0be83aa-e74d-47d7-85c8-c4a68e0a0c82 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:46.036627 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a0be83aa-e74d-47d7-85c8-c4a68e0a0c82 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:46.096098 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a0be83aa-e74d-47d7-85c8-c4a68e0a0c82 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:46.103857 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a0be83aa-e74d-47d7-85c8-c4a68e0a0c82 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.081275 Feb 21 01:35:46.104400 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 913/1850] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:46 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:47.120326 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fe777d89-7b91-4e2d-933a-a1c68035a681 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:47.120891 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fe777d89-7b91-4e2d-933a-a1c68035a681 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:47.128025 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fe777d89-7b91-4e2d-933a-a1c68035a681 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:47.128465 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fe777d89-7b91-4e2d-933a-a1c68035a681 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:47.129233 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fe777d89-7b91-4e2d-933a-a1c68035a681 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:47.129658 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fe777d89-7b91-4e2d-933a-a1c68035a681 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:47.187796 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fe777d89-7b91-4e2d-933a-a1c68035a681 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:47.196070 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-fe777d89-7b91-4e2d-933a-a1c68035a681 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.079384 Feb 21 01:35:47.196626 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 938/1851] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:47 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:48.212407 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a28e9213-ed65-4f8e-8bea-da6a4b6cff21 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:48.212934 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a28e9213-ed65-4f8e-8bea-da6a4b6cff21 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:48.219127 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a28e9213-ed65-4f8e-8bea-da6a4b6cff21 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:48.219572 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a28e9213-ed65-4f8e-8bea-da6a4b6cff21 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:48.220458 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a28e9213-ed65-4f8e-8bea-da6a4b6cff21 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:48.220912 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a28e9213-ed65-4f8e-8bea-da6a4b6cff21 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:48.279340 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a28e9213-ed65-4f8e-8bea-da6a4b6cff21 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:48.287031 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a28e9213-ed65-4f8e-8bea-da6a4b6cff21 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.078355 Feb 21 01:35:48.287592 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 914/1852] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:48 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:49.303764 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1ff05525-e46d-47af-85fe-deecb90a9391 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:49.304357 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1ff05525-e46d-47af-85fe-deecb90a9391 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:49.310613 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1ff05525-e46d-47af-85fe-deecb90a9391 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:49.311057 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1ff05525-e46d-47af-85fe-deecb90a9391 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:49.311861 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1ff05525-e46d-47af-85fe-deecb90a9391 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:49.312366 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1ff05525-e46d-47af-85fe-deecb90a9391 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:49.374620 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1ff05525-e46d-47af-85fe-deecb90a9391 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:49.382558 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1ff05525-e46d-47af-85fe-deecb90a9391 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.082539 Feb 21 01:35:49.383123 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 939/1853] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:49 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:50.399561 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5f414dd7-099d-4e55-8ad4-bfddbaee506d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:50.400279 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5f414dd7-099d-4e55-8ad4-bfddbaee506d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:50.408437 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5f414dd7-099d-4e55-8ad4-bfddbaee506d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:50.409154 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5f414dd7-099d-4e55-8ad4-bfddbaee506d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:50.410334 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5f414dd7-099d-4e55-8ad4-bfddbaee506d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:50.410774 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5f414dd7-099d-4e55-8ad4-bfddbaee506d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:50.471558 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5f414dd7-099d-4e55-8ad4-bfddbaee506d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:50.479427 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5f414dd7-099d-4e55-8ad4-bfddbaee506d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.083534 Feb 21 01:35:50.480026 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 915/1854] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:50 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:51.496902 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c317ab1b-4775-4770-a679-477dedbac2c0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:51.497512 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c317ab1b-4775-4770-a679-477dedbac2c0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:51.503808 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c317ab1b-4775-4770-a679-477dedbac2c0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:51.504281 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c317ab1b-4775-4770-a679-477dedbac2c0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:51.505053 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c317ab1b-4775-4770-a679-477dedbac2c0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:51.505482 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c317ab1b-4775-4770-a679-477dedbac2c0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:51.565875 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c317ab1b-4775-4770-a679-477dedbac2c0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:51.573602 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c317ab1b-4775-4770-a679-477dedbac2c0 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.080338 Feb 21 01:35:51.574166 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 940/1855] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:51 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:52.590348 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fd8e9a72-6731-49b0-8ece-a8ed3b7e9bcd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:52.590983 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fd8e9a72-6731-49b0-8ece-a8ed3b7e9bcd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:52.597661 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fd8e9a72-6731-49b0-8ece-a8ed3b7e9bcd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:52.598110 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fd8e9a72-6731-49b0-8ece-a8ed3b7e9bcd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:52.598923 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fd8e9a72-6731-49b0-8ece-a8ed3b7e9bcd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:52.599355 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fd8e9a72-6731-49b0-8ece-a8ed3b7e9bcd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:52.658610 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fd8e9a72-6731-49b0-8ece-a8ed3b7e9bcd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:52.666301 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fd8e9a72-6731-49b0-8ece-a8ed3b7e9bcd tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.079685 Feb 21 01:35:52.666866 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 916/1856] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:52 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:53.682729 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-06e6103a-1fab-4bb6-8873-3d70a0c485b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:53.683291 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-06e6103a-1fab-4bb6-8873-3d70a0c485b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:53.689776 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-06e6103a-1fab-4bb6-8873-3d70a0c485b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:53.690217 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-06e6103a-1fab-4bb6-8873-3d70a0c485b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:53.690988 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-06e6103a-1fab-4bb6-8873-3d70a0c485b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:53.691413 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-06e6103a-1fab-4bb6-8873-3d70a0c485b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:53.757495 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-06e6103a-1fab-4bb6-8873-3d70a0c485b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:53.765194 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-06e6103a-1fab-4bb6-8873-3d70a0c485b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.086194 Feb 21 01:35:53.765747 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 941/1857] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:53 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:54.782648 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-208988b1-8da7-44f8-8798-7b9edf578d07 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:54.783427 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-208988b1-8da7-44f8-8798-7b9edf578d07 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:54.789637 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-208988b1-8da7-44f8-8798-7b9edf578d07 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:54.790085 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-208988b1-8da7-44f8-8798-7b9edf578d07 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:54.790863 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-208988b1-8da7-44f8-8798-7b9edf578d07 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:54.791297 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-208988b1-8da7-44f8-8798-7b9edf578d07 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:54.852976 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-208988b1-8da7-44f8-8798-7b9edf578d07 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:54.861470 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-208988b1-8da7-44f8-8798-7b9edf578d07 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.082925 Feb 21 01:35:54.862019 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 917/1858] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:54 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:55.878656 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c5455d65-335a-4158-a4ad-8fab003a3845 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:55.879264 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c5455d65-335a-4158-a4ad-8fab003a3845 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:55.885624 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c5455d65-335a-4158-a4ad-8fab003a3845 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:55.886066 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c5455d65-335a-4158-a4ad-8fab003a3845 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:55.886871 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c5455d65-335a-4158-a4ad-8fab003a3845 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:55.887299 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c5455d65-335a-4158-a4ad-8fab003a3845 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:55.946681 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c5455d65-335a-4158-a4ad-8fab003a3845 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:55.954333 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c5455d65-335a-4158-a4ad-8fab003a3845 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.080129 Feb 21 01:35:55.954893 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 942/1859] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:55 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:56.971200 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5397260d-23cb-4a90-9523-d5f919fa3bbc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:56.971860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5397260d-23cb-4a90-9523-d5f919fa3bbc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:56.978020 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5397260d-23cb-4a90-9523-d5f919fa3bbc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:56.978465 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5397260d-23cb-4a90-9523-d5f919fa3bbc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:56.979250 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5397260d-23cb-4a90-9523-d5f919fa3bbc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:56.979681 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5397260d-23cb-4a90-9523-d5f919fa3bbc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:57.039043 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5397260d-23cb-4a90-9523-d5f919fa3bbc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:57.046678 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5397260d-23cb-4a90-9523-d5f919fa3bbc tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.079766 Feb 21 01:35:57.047224 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 918/1860] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:56 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:58.063308 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2867dce3-86ad-4e92-b9cf-9236def59346 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:58.064199 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2867dce3-86ad-4e92-b9cf-9236def59346 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:58.070485 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2867dce3-86ad-4e92-b9cf-9236def59346 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:58.070937 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2867dce3-86ad-4e92-b9cf-9236def59346 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:58.071717 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2867dce3-86ad-4e92-b9cf-9236def59346 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:58.072178 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2867dce3-86ad-4e92-b9cf-9236def59346 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:58.131987 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2867dce3-86ad-4e92-b9cf-9236def59346 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:58.141110 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2867dce3-86ad-4e92-b9cf-9236def59346 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.081439 Feb 21 01:35:58.142691 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 943/1861] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:58 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:59.159195 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-63cc9bd0-1eab-4bcd-b529-46ac35f90a94 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:59.159805 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-63cc9bd0-1eab-4bcd-b529-46ac35f90a94 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:59.166045 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-63cc9bd0-1eab-4bcd-b529-46ac35f90a94 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:59.166492 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-63cc9bd0-1eab-4bcd-b529-46ac35f90a94 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:59.167270 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-63cc9bd0-1eab-4bcd-b529-46ac35f90a94 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:59.167705 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-63cc9bd0-1eab-4bcd-b529-46ac35f90a94 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:59.229354 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-63cc9bd0-1eab-4bcd-b529-46ac35f90a94 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:59.237390 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-63cc9bd0-1eab-4bcd-b529-46ac35f90a94 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.082497 Feb 21 01:35:59.237932 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 919/1862] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:59 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:00.254785 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5d79b356-2def-49aa-aec5-b63642348228 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:00.255339 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5d79b356-2def-49aa-aec5-b63642348228 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:00.261534 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5d79b356-2def-49aa-aec5-b63642348228 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:00.261978 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5d79b356-2def-49aa-aec5-b63642348228 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:00.262745 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5d79b356-2def-49aa-aec5-b63642348228 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:00.263172 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5d79b356-2def-49aa-aec5-b63642348228 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:00.322605 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5d79b356-2def-49aa-aec5-b63642348228 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:00.330877 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5d79b356-2def-49aa-aec5-b63642348228 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.080392 Feb 21 01:36:00.331432 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 944/1863] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:00 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:01.347260 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5145ac15-4ece-43a9-9187-cdd2897bf85d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:01.347874 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5145ac15-4ece-43a9-9187-cdd2897bf85d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:01.354168 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5145ac15-4ece-43a9-9187-cdd2897bf85d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:01.354624 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5145ac15-4ece-43a9-9187-cdd2897bf85d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:01.355410 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5145ac15-4ece-43a9-9187-cdd2897bf85d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:01.355859 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5145ac15-4ece-43a9-9187-cdd2897bf85d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:01.416795 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5145ac15-4ece-43a9-9187-cdd2897bf85d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:01.425438 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5145ac15-4ece-43a9-9187-cdd2897bf85d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.081943 Feb 21 01:36:01.435192 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 920/1864] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:01 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:02.448259 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8561c390-beab-4394-b527-3f3e453262d9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:02.448877 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8561c390-beab-4394-b527-3f3e453262d9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:02.455870 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8561c390-beab-4394-b527-3f3e453262d9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:02.456267 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8561c390-beab-4394-b527-3f3e453262d9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:02.457050 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8561c390-beab-4394-b527-3f3e453262d9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:02.457485 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8561c390-beab-4394-b527-3f3e453262d9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:02.517183 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8561c390-beab-4394-b527-3f3e453262d9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:02.525012 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8561c390-beab-4394-b527-3f3e453262d9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.080412 Feb 21 01:36:02.525574 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 945/1865] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:02 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:03.541224 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1bd10d77-1263-4586-832f-4a92ea1c06e4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:03.541832 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1bd10d77-1263-4586-832f-4a92ea1c06e4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:03.549238 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1bd10d77-1263-4586-832f-4a92ea1c06e4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:03.549693 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1bd10d77-1263-4586-832f-4a92ea1c06e4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:03.550519 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1bd10d77-1263-4586-832f-4a92ea1c06e4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:03.550956 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1bd10d77-1263-4586-832f-4a92ea1c06e4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:03.613794 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1bd10d77-1263-4586-832f-4a92ea1c06e4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:03.621596 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1bd10d77-1263-4586-832f-4a92ea1c06e4 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.084018 Feb 21 01:36:03.622149 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 921/1866] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:03 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:04.638812 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5a0a900a-9cf2-4246-9df3-b68cfffe728e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:04.639386 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5a0a900a-9cf2-4246-9df3-b68cfffe728e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 9d1f7594-329f-44cb-a627-184aa02bd0fc] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:04.646563 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5a0a900a-9cf2-4246-9df3-b68cfffe728e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:04.647009 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5a0a900a-9cf2-4246-9df3-b68cfffe728e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:04.647789 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5a0a900a-9cf2-4246-9df3-b68cfffe728e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:04.648252 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5a0a900a-9cf2-4246-9df3-b68cfffe728e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:04.708683 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5a0a900a-9cf2-4246-9df3-b68cfffe728e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:04.716246 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5a0a900a-9cf2-4246-9df3-b68cfffe728e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc" status: 200 len: 1349 microversion: 2.1 time: 0.081141 Feb 21 01:36:04.716810 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 946/1867] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:04 2022] GET /compute/v2.1/servers/9d1f7594-329f-44cb-a627-184aa02bd0fc => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:02.254968 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-accfb16e-f137-42ca-962f-a9c49022969a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:02.255492 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-accfb16e-f137-42ca-962f-a9c49022969a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:02.261285 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-accfb16e-f137-42ca-962f-a9c49022969a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:02.261724 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-accfb16e-f137-42ca-962f-a9c49022969a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:02.262518 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-accfb16e-f137-42ca-962f-a9c49022969a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:02.262946 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-accfb16e-f137-42ca-962f-a9c49022969a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:02.286660 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-accfb16e-f137-42ca-962f-a9c49022969a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Going to try to terminate instance {{(pid=117138) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:37:02.568983 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-accfb16e-f137-42ca-962f-a9c49022969a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "DELETE /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 204 len: 0 microversion: 2.1 time: 0.317373 Feb 21 01:37:02.569488 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 922/1868] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Feb 21 01:37:02 2022] DELETE /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:37:02.577110 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-839cd075-1b4c-4ad4-9cce-f38230ec38ec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:02.585546 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-839cd075-1b4c-4ad4-9cce-f38230ec38ec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:02.585546 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-839cd075-1b4c-4ad4-9cce-f38230ec38ec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:02.585546 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-839cd075-1b4c-4ad4-9cce-f38230ec38ec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:02.585887 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-839cd075-1b4c-4ad4-9cce-f38230ec38ec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:02.586058 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-839cd075-1b4c-4ad4-9cce-f38230ec38ec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:02.719651 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-839cd075-1b4c-4ad4-9cce-f38230ec38ec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:02.726836 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-839cd075-1b4c-4ad4-9cce-f38230ec38ec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1506 microversion: 2.1 time: 0.153343 Feb 21 01:37:02.727389 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 947/1869] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:02 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:37:03.741780 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-d86cd5f0-cd12-48a0-ab9c-a1758ebf4a36 req-0c04a05a-f375-433f-b200-bd292f1cce1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1beb65b4-c732-4d82-aebd-9e9e531ce358", "name": "network-vif-deleted", "tag": "39c05458-94e5-4923-817e-c11c68084a56"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:37:03.743312 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:37:03.743312 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:37:03.743562 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-040bae96-1fd1-4ad1-8f79-d6626ca7bc6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:03.744155 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-040bae96-1fd1-4ad1-8f79-d6626ca7bc6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:03.751330 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-040bae96-1fd1-4ad1-8f79-d6626ca7bc6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:03.752057 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-040bae96-1fd1-4ad1-8f79-d6626ca7bc6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:03.756351 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-d86cd5f0-cd12-48a0-ab9c-a1758ebf4a36 req-0c04a05a-f375-433f-b200-bd292f1cce1d service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:03.756351 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-d86cd5f0-cd12-48a0-ab9c-a1758ebf4a36 req-0c04a05a-f375-433f-b200-bd292f1cce1d service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:03.756617 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-040bae96-1fd1-4ad1-8f79-d6626ca7bc6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:03.756617 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-040bae96-1fd1-4ad1-8f79-d6626ca7bc6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:03.764161 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-d86cd5f0-cd12-48a0-ab9c-a1758ebf4a36 req-0c04a05a-f375-433f-b200-bd292f1cce1d service nova] Creating event network-vif-deleted:39c05458-94e5-4923-817e-c11c68084a56 for instance 1beb65b4-c732-4d82-aebd-9e9e531ce358 on hv-cinder-81322 Feb 21 01:37:03.770180 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-d86cd5f0-cd12-48a0-ab9c-a1758ebf4a36 req-0c04a05a-f375-433f-b200-bd292f1cce1d service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092190 Feb 21 01:37:03.770882 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 923/1870] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:37:03.816941 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-040bae96-1fd1-4ad1-8f79-d6626ca7bc6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:03.824556 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-040bae96-1fd1-4ad1-8f79-d6626ca7bc6f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 200 len: 1464 microversion: 2.1 time: 0.084616 Feb 21 01:37:03.825112 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 948/1871] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:03 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 1464 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:37:04.843200 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f0b8482d-8dd7-42a9-a440-c2049ac67d97 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:04.844672 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f0b8482d-8dd7-42a9-a440-c2049ac67d97 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 1beb65b4-c732-4d82-aebd-9e9e531ce358] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:04.850711 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f0b8482d-8dd7-42a9-a440-c2049ac67d97 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:04.851240 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f0b8482d-8dd7-42a9-a440-c2049ac67d97 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:04.852080 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f0b8482d-8dd7-42a9-a440-c2049ac67d97 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:04.852509 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f0b8482d-8dd7-42a9-a440-c2049ac67d97 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:04.865491 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.wsgi [None req-f0b8482d-8dd7-42a9-a440-c2049ac67d97 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] HTTP exception thrown: Instance 1beb65b4-c732-4d82-aebd-9e9e531ce358 could not be found. Feb 21 01:37:04.866057 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f0b8482d-8dd7-42a9-a440-c2049ac67d97 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Returning 404 to user: Instance 1beb65b4-c732-4d82-aebd-9e9e531ce358 could not be found. {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:37:04.866849 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f0b8482d-8dd7-42a9-a440-c2049ac67d97 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358" status: 404 len: 111 microversion: 2.1 time: 0.028239 Feb 21 01:37:04.867370 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 924/1872] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:04 2022] GET /compute/v2.1/servers/1beb65b4-c732-4d82-aebd-9e9e531ce358 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:37:04.875396 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-53ee4df4-ffd1-4cc4-952b-69f023fa78bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:04.875936 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-53ee4df4-ffd1-4cc4-952b-69f023fa78bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:04.882209 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-53ee4df4-ffd1-4cc4-952b-69f023fa78bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:04.882657 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-53ee4df4-ffd1-4cc4-952b-69f023fa78bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:04.883667 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-53ee4df4-ffd1-4cc4-952b-69f023fa78bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:04.884138 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-53ee4df4-ffd1-4cc4-952b-69f023fa78bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:04.909700 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-53ee4df4-ffd1-4cc4-952b-69f023fa78bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Going to try to terminate instance {{(pid=117139) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:37:05.157762 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-53ee4df4-ffd1-4cc4-952b-69f023fa78bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "DELETE /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 204 len: 0 microversion: 2.1 time: 0.285972 Feb 21 01:37:05.158273 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 949/1873] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Feb 21 01:37:04 2022] DELETE /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:37:05.166115 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ee965ae8-2147-42de-8d53-13147aff240c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:05.167611 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ee965ae8-2147-42de-8d53-13147aff240c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:05.173571 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee965ae8-2147-42de-8d53-13147aff240c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:05.174056 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee965ae8-2147-42de-8d53-13147aff240c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:05.174845 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee965ae8-2147-42de-8d53-13147aff240c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:05.175285 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee965ae8-2147-42de-8d53-13147aff240c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:05.306818 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ee965ae8-2147-42de-8d53-13147aff240c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:05.315155 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ee965ae8-2147-42de-8d53-13147aff240c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1567 microversion: 2.1 time: 0.152779 Feb 21 01:37:05.315712 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 925/1874] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:05 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:06.304508 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-3a2c529b-2b9e-4de5-9909-1cafb7474146 req-f2c86300-3938-4055-8ad7-eeb3e35318f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c2b10b2-e67d-4479-9f7a-0ce69607b1ab", "name": "network-vif-deleted", "tag": "10c581fc-f817-48b4-9e2f-a1221c3603ea"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:37:06.306050 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:37:06.306050 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:37:06.313485 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-3a2c529b-2b9e-4de5-9909-1cafb7474146 req-f2c86300-3938-4055-8ad7-eeb3e35318f7 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:06.316776 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-3a2c529b-2b9e-4de5-9909-1cafb7474146 req-f2c86300-3938-4055-8ad7-eeb3e35318f7 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:06.324868 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-3a2c529b-2b9e-4de5-9909-1cafb7474146 req-f2c86300-3938-4055-8ad7-eeb3e35318f7 service nova] Creating event network-vif-deleted:10c581fc-f817-48b4-9e2f-a1221c3603ea for instance 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab on hv-cinder-81322 Feb 21 01:37:06.330007 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-3a2c529b-2b9e-4de5-9909-1cafb7474146 req-f2c86300-3938-4055-8ad7-eeb3e35318f7 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029711 Feb 21 01:37:06.330590 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 950/1875] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:37:06.332360 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d9ad8205-5675-4d7e-8778-61b612f88130 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:06.333103 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d9ad8205-5675-4d7e-8778-61b612f88130 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:06.339146 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d9ad8205-5675-4d7e-8778-61b612f88130 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:06.346059 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d9ad8205-5675-4d7e-8778-61b612f88130 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:06.346059 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d9ad8205-5675-4d7e-8778-61b612f88130 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:06.346059 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d9ad8205-5675-4d7e-8778-61b612f88130 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:06.401395 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d9ad8205-5675-4d7e-8778-61b612f88130 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:06.409948 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d9ad8205-5675-4d7e-8778-61b612f88130 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1525 microversion: 2.1 time: 0.081888 Feb 21 01:37:06.410809 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 926/1876] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:06 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1525 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:37:07.427222 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b357266a-829e-46d6-bddf-17a5b86160cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:07.427999 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b357266a-829e-46d6-bddf-17a5b86160cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:07.434074 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b357266a-829e-46d6-bddf-17a5b86160cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:07.434518 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b357266a-829e-46d6-bddf-17a5b86160cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:07.435288 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b357266a-829e-46d6-bddf-17a5b86160cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:07.435720 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b357266a-829e-46d6-bddf-17a5b86160cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:07.496138 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b357266a-829e-46d6-bddf-17a5b86160cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:07.504554 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b357266a-829e-46d6-bddf-17a5b86160cc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081754 Feb 21 01:37:07.505152 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 951/1877] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:07 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:08.521632 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-76ec3408-1e07-4e71-9719-51ced97d248a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:08.522278 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-76ec3408-1e07-4e71-9719-51ced97d248a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:08.528562 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-76ec3408-1e07-4e71-9719-51ced97d248a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:08.529014 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-76ec3408-1e07-4e71-9719-51ced97d248a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:08.529795 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-76ec3408-1e07-4e71-9719-51ced97d248a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:08.530235 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-76ec3408-1e07-4e71-9719-51ced97d248a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:08.593519 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-76ec3408-1e07-4e71-9719-51ced97d248a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:08.602064 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-76ec3408-1e07-4e71-9719-51ced97d248a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084872 Feb 21 01:37:08.602623 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 927/1878] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:08 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:09.618472 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a5774f4f-4c96-4452-b915-86a2d77c4085 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:09.619016 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a5774f4f-4c96-4452-b915-86a2d77c4085 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:09.625257 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a5774f4f-4c96-4452-b915-86a2d77c4085 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:09.625704 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a5774f4f-4c96-4452-b915-86a2d77c4085 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:09.627122 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a5774f4f-4c96-4452-b915-86a2d77c4085 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:09.627671 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a5774f4f-4c96-4452-b915-86a2d77c4085 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:09.690067 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a5774f4f-4c96-4452-b915-86a2d77c4085 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:09.697691 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a5774f4f-4c96-4452-b915-86a2d77c4085 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082948 Feb 21 01:37:09.698268 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 952/1879] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:09 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:10.714360 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6ffde2bf-2d93-45bb-971a-5a0769314953 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:10.714900 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6ffde2bf-2d93-45bb-971a-5a0769314953 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:10.721172 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6ffde2bf-2d93-45bb-971a-5a0769314953 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:10.721616 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6ffde2bf-2d93-45bb-971a-5a0769314953 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:10.722392 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6ffde2bf-2d93-45bb-971a-5a0769314953 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:10.722823 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6ffde2bf-2d93-45bb-971a-5a0769314953 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:10.783989 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6ffde2bf-2d93-45bb-971a-5a0769314953 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:10.791606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6ffde2bf-2d93-45bb-971a-5a0769314953 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081002 Feb 21 01:37:10.792202 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 928/1880] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:10 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:37:11.809793 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1e21449a-ccff-4783-9591-50f9d46d7599 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:11.810405 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1e21449a-ccff-4783-9591-50f9d46d7599 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:11.816887 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e21449a-ccff-4783-9591-50f9d46d7599 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:11.817336 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e21449a-ccff-4783-9591-50f9d46d7599 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:11.818118 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e21449a-ccff-4783-9591-50f9d46d7599 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:11.818556 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e21449a-ccff-4783-9591-50f9d46d7599 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:11.879083 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1e21449a-ccff-4783-9591-50f9d46d7599 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:11.886798 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1e21449a-ccff-4783-9591-50f9d46d7599 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080770 Feb 21 01:37:11.887362 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 953/1881] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:11 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:12.903665 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-791a50fc-edcd-4fdb-a512-2db293a314b0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:12.904387 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-791a50fc-edcd-4fdb-a512-2db293a314b0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:12.911046 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-791a50fc-edcd-4fdb-a512-2db293a314b0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:12.911486 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-791a50fc-edcd-4fdb-a512-2db293a314b0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:12.912307 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-791a50fc-edcd-4fdb-a512-2db293a314b0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:12.912732 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-791a50fc-edcd-4fdb-a512-2db293a314b0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:12.970789 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-791a50fc-edcd-4fdb-a512-2db293a314b0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:12.978328 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-791a50fc-edcd-4fdb-a512-2db293a314b0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078309 Feb 21 01:37:12.978890 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 929/1882] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:12 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:13.995458 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9a2afcdc-5dbe-47a5-bc58-d073858c2579 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:13.996154 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9a2afcdc-5dbe-47a5-bc58-d073858c2579 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:14.003219 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9a2afcdc-5dbe-47a5-bc58-d073858c2579 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:14.003661 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9a2afcdc-5dbe-47a5-bc58-d073858c2579 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:14.004460 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9a2afcdc-5dbe-47a5-bc58-d073858c2579 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:14.004888 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9a2afcdc-5dbe-47a5-bc58-d073858c2579 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:14.064767 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9a2afcdc-5dbe-47a5-bc58-d073858c2579 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:14.072412 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9a2afcdc-5dbe-47a5-bc58-d073858c2579 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080592 Feb 21 01:37:14.072955 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 954/1883] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:13 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:15.091282 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c8f5cc51-f326-4b69-aeb3-78afff327751 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:15.091906 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c8f5cc51-f326-4b69-aeb3-78afff327751 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:15.098306 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c8f5cc51-f326-4b69-aeb3-78afff327751 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:15.098752 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c8f5cc51-f326-4b69-aeb3-78afff327751 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:15.099673 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c8f5cc51-f326-4b69-aeb3-78afff327751 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:15.100271 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c8f5cc51-f326-4b69-aeb3-78afff327751 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:15.159923 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c8f5cc51-f326-4b69-aeb3-78afff327751 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:15.167610 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c8f5cc51-f326-4b69-aeb3-78afff327751 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082143 Feb 21 01:37:15.168198 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 930/1884] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:15 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:16.184145 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2ff507ee-a865-40db-90b4-b677a78ed3a4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:16.184886 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2ff507ee-a865-40db-90b4-b677a78ed3a4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:16.191552 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2ff507ee-a865-40db-90b4-b677a78ed3a4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:16.192021 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2ff507ee-a865-40db-90b4-b677a78ed3a4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:16.192787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2ff507ee-a865-40db-90b4-b677a78ed3a4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:16.193214 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2ff507ee-a865-40db-90b4-b677a78ed3a4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:16.255029 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2ff507ee-a865-40db-90b4-b677a78ed3a4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:16.262860 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2ff507ee-a865-40db-90b4-b677a78ed3a4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082341 Feb 21 01:37:16.263368 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 955/1885] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:16 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:17.279199 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-70b1257e-d7f6-4a05-b3fb-4119501accfd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:17.279911 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-70b1257e-d7f6-4a05-b3fb-4119501accfd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:17.286237 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-70b1257e-d7f6-4a05-b3fb-4119501accfd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:17.286679 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-70b1257e-d7f6-4a05-b3fb-4119501accfd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:17.287488 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-70b1257e-d7f6-4a05-b3fb-4119501accfd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:17.287958 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-70b1257e-d7f6-4a05-b3fb-4119501accfd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:17.350753 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-70b1257e-d7f6-4a05-b3fb-4119501accfd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:17.358922 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-70b1257e-d7f6-4a05-b3fb-4119501accfd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083105 Feb 21 01:37:17.359578 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 931/1886] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:17 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:18.375059 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0092a065-6da8-4bb4-a64c-75b3c1c5d2a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:18.375806 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0092a065-6da8-4bb4-a64c-75b3c1c5d2a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:18.382282 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0092a065-6da8-4bb4-a64c-75b3c1c5d2a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:18.382733 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0092a065-6da8-4bb4-a64c-75b3c1c5d2a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:18.383513 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0092a065-6da8-4bb4-a64c-75b3c1c5d2a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:18.383970 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0092a065-6da8-4bb4-a64c-75b3c1c5d2a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:18.442913 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0092a065-6da8-4bb4-a64c-75b3c1c5d2a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:18.450599 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0092a065-6da8-4bb4-a64c-75b3c1c5d2a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079250 Feb 21 01:37:18.451156 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 956/1887] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:18 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:19.467772 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-eda96892-c576-4582-84ec-0bf7b02fe253 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:19.468398 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-eda96892-c576-4582-84ec-0bf7b02fe253 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:19.475096 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eda96892-c576-4582-84ec-0bf7b02fe253 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:19.475533 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eda96892-c576-4582-84ec-0bf7b02fe253 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:19.476328 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eda96892-c576-4582-84ec-0bf7b02fe253 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:19.476756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eda96892-c576-4582-84ec-0bf7b02fe253 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:19.535957 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-eda96892-c576-4582-84ec-0bf7b02fe253 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:19.543513 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-eda96892-c576-4582-84ec-0bf7b02fe253 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079410 Feb 21 01:37:19.544095 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 932/1888] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:19 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:20.560606 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-61af443d-3607-417c-963f-efd0743d9cac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:20.561217 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-61af443d-3607-417c-963f-efd0743d9cac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:20.568281 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-61af443d-3607-417c-963f-efd0743d9cac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:20.568727 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-61af443d-3607-417c-963f-efd0743d9cac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:20.569505 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-61af443d-3607-417c-963f-efd0743d9cac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:20.569933 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-61af443d-3607-417c-963f-efd0743d9cac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:20.628987 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-61af443d-3607-417c-963f-efd0743d9cac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:20.636469 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-61af443d-3607-417c-963f-efd0743d9cac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079522 Feb 21 01:37:20.637029 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 957/1889] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:20 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:21.653397 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2426dea7-c23f-4710-bd4b-77c0e348667b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:21.653971 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2426dea7-c23f-4710-bd4b-77c0e348667b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:21.661370 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2426dea7-c23f-4710-bd4b-77c0e348667b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:21.661822 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2426dea7-c23f-4710-bd4b-77c0e348667b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:21.662606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2426dea7-c23f-4710-bd4b-77c0e348667b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:21.663040 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2426dea7-c23f-4710-bd4b-77c0e348667b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:21.723969 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2426dea7-c23f-4710-bd4b-77c0e348667b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:21.731596 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2426dea7-c23f-4710-bd4b-77c0e348667b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081981 Feb 21 01:37:21.732184 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 933/1890] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:21 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:22.748117 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-408032b5-2a24-4496-9210-64ab175631b2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:22.748724 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-408032b5-2a24-4496-9210-64ab175631b2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:22.755150 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-408032b5-2a24-4496-9210-64ab175631b2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:22.755599 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-408032b5-2a24-4496-9210-64ab175631b2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:22.756404 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-408032b5-2a24-4496-9210-64ab175631b2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:22.756839 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-408032b5-2a24-4496-9210-64ab175631b2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:22.818890 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-408032b5-2a24-4496-9210-64ab175631b2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:22.826505 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-408032b5-2a24-4496-9210-64ab175631b2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081990 Feb 21 01:37:22.827093 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 958/1891] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:22 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:23.843618 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-acccb855-b5bb-406a-ae2e-088d61106f08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:23.844824 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-acccb855-b5bb-406a-ae2e-088d61106f08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:23.850990 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-acccb855-b5bb-406a-ae2e-088d61106f08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:23.851441 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-acccb855-b5bb-406a-ae2e-088d61106f08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:23.852255 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-acccb855-b5bb-406a-ae2e-088d61106f08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:23.852685 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-acccb855-b5bb-406a-ae2e-088d61106f08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:23.911556 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-acccb855-b5bb-406a-ae2e-088d61106f08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:23.919369 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-acccb855-b5bb-406a-ae2e-088d61106f08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079500 Feb 21 01:37:23.919938 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 934/1892] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:23 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:24.936165 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-cac2f3bc-1a4c-4d12-9ea7-15bf6118d2c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:24.936766 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-cac2f3bc-1a4c-4d12-9ea7-15bf6118d2c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:24.942999 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cac2f3bc-1a4c-4d12-9ea7-15bf6118d2c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:24.943444 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cac2f3bc-1a4c-4d12-9ea7-15bf6118d2c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:24.944232 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cac2f3bc-1a4c-4d12-9ea7-15bf6118d2c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:24.944660 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cac2f3bc-1a4c-4d12-9ea7-15bf6118d2c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:25.007152 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-cac2f3bc-1a4c-4d12-9ea7-15bf6118d2c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:25.014954 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-cac2f3bc-1a4c-4d12-9ea7-15bf6118d2c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082508 Feb 21 01:37:25.015523 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 959/1893] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:24 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:25.718495 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:37:25.719079 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:37:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:37:26.031916 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-760da547-2fa4-4f60-9439-2d244435a0a1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:26.038148 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-760da547-2fa4-4f60-9439-2d244435a0a1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:26.039048 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-760da547-2fa4-4f60-9439-2d244435a0a1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:26.039505 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-760da547-2fa4-4f60-9439-2d244435a0a1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:26.040318 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-760da547-2fa4-4f60-9439-2d244435a0a1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:26.040760 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-760da547-2fa4-4f60-9439-2d244435a0a1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:26.103007 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-760da547-2fa4-4f60-9439-2d244435a0a1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:26.111708 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-760da547-2fa4-4f60-9439-2d244435a0a1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083590 Feb 21 01:37:26.112298 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 935/1894] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:26 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:27.128772 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2bc99940-8d4b-43bf-87fa-3d17f52c6e66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:27.129489 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2bc99940-8d4b-43bf-87fa-3d17f52c6e66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:27.135710 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2bc99940-8d4b-43bf-87fa-3d17f52c6e66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:27.136186 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2bc99940-8d4b-43bf-87fa-3d17f52c6e66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:27.136956 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2bc99940-8d4b-43bf-87fa-3d17f52c6e66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:27.137420 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2bc99940-8d4b-43bf-87fa-3d17f52c6e66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:27.197663 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2bc99940-8d4b-43bf-87fa-3d17f52c6e66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:27.206704 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2bc99940-8d4b-43bf-87fa-3d17f52c6e66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082102 Feb 21 01:37:27.207293 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 960/1895] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:27 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:28.223635 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-050d4bc0-c70b-4f55-a669-ee788c8e101b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:28.224356 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-050d4bc0-c70b-4f55-a669-ee788c8e101b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:28.230495 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-050d4bc0-c70b-4f55-a669-ee788c8e101b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:28.230941 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-050d4bc0-c70b-4f55-a669-ee788c8e101b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:28.231704 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-050d4bc0-c70b-4f55-a669-ee788c8e101b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:28.232164 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-050d4bc0-c70b-4f55-a669-ee788c8e101b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:28.291176 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-050d4bc0-c70b-4f55-a669-ee788c8e101b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:28.298859 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-050d4bc0-c70b-4f55-a669-ee788c8e101b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079592 Feb 21 01:37:28.299411 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 936/1896] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:28 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:29.314248 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-cf8bcfc4-100f-4f3b-a0bc-afe7da564c08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:29.314969 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-cf8bcfc4-100f-4f3b-a0bc-afe7da564c08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:29.321221 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cf8bcfc4-100f-4f3b-a0bc-afe7da564c08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:29.321666 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cf8bcfc4-100f-4f3b-a0bc-afe7da564c08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:29.322444 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cf8bcfc4-100f-4f3b-a0bc-afe7da564c08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:29.322874 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cf8bcfc4-100f-4f3b-a0bc-afe7da564c08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:29.382726 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-cf8bcfc4-100f-4f3b-a0bc-afe7da564c08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:29.390487 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-cf8bcfc4-100f-4f3b-a0bc-afe7da564c08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079948 Feb 21 01:37:29.391040 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 961/1897] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:29 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:30.051439 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:37:30.051915 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:37:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:37:30.407564 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-acdee84b-6aa4-404c-b2dc-ef316f93a851 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:30.408195 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-acdee84b-6aa4-404c-b2dc-ef316f93a851 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:30.415186 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-acdee84b-6aa4-404c-b2dc-ef316f93a851 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:30.415651 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-acdee84b-6aa4-404c-b2dc-ef316f93a851 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:30.416457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-acdee84b-6aa4-404c-b2dc-ef316f93a851 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:30.416901 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-acdee84b-6aa4-404c-b2dc-ef316f93a851 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:30.477514 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-acdee84b-6aa4-404c-b2dc-ef316f93a851 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:30.485519 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-acdee84b-6aa4-404c-b2dc-ef316f93a851 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081722 Feb 21 01:37:30.486069 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 937/1898] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:30 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:30.832159 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:37:30.832650 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:37:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:37:31.502479 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e1e2da7c-8d37-468a-b044-b4f79d07c171 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:31.504019 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e1e2da7c-8d37-468a-b044-b4f79d07c171 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:31.509854 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e1e2da7c-8d37-468a-b044-b4f79d07c171 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:31.510295 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e1e2da7c-8d37-468a-b044-b4f79d07c171 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:31.511061 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e1e2da7c-8d37-468a-b044-b4f79d07c171 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:31.511486 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e1e2da7c-8d37-468a-b044-b4f79d07c171 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:31.572218 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e1e2da7c-8d37-468a-b044-b4f79d07c171 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:31.579981 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e1e2da7c-8d37-468a-b044-b4f79d07c171 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081162 Feb 21 01:37:31.580529 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 962/1899] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:31 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:32.596909 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-950d8ed3-96a8-4c2b-b10d-7f8b1af1e57a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:32.597521 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-950d8ed3-96a8-4c2b-b10d-7f8b1af1e57a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:32.603770 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-950d8ed3-96a8-4c2b-b10d-7f8b1af1e57a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:32.604248 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-950d8ed3-96a8-4c2b-b10d-7f8b1af1e57a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:32.605028 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-950d8ed3-96a8-4c2b-b10d-7f8b1af1e57a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:32.605479 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-950d8ed3-96a8-4c2b-b10d-7f8b1af1e57a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:32.664729 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-950d8ed3-96a8-4c2b-b10d-7f8b1af1e57a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:32.672382 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-950d8ed3-96a8-4c2b-b10d-7f8b1af1e57a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079255 Feb 21 01:37:32.672943 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 938/1900] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:32 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:33.688719 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8776adf6-de2b-43ca-b6ec-d5dee09492cb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:33.689332 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8776adf6-de2b-43ca-b6ec-d5dee09492cb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:33.696394 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8776adf6-de2b-43ca-b6ec-d5dee09492cb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:33.696840 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8776adf6-de2b-43ca-b6ec-d5dee09492cb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:33.697618 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8776adf6-de2b-43ca-b6ec-d5dee09492cb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:33.698050 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8776adf6-de2b-43ca-b6ec-d5dee09492cb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:33.757703 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8776adf6-de2b-43ca-b6ec-d5dee09492cb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:33.765343 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8776adf6-de2b-43ca-b6ec-d5dee09492cb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080240 Feb 21 01:37:33.765903 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 963/1901] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:33 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:34.781742 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fe4bdf8a-81ff-4128-9c4d-363a4ad37fc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:34.782347 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fe4bdf8a-81ff-4128-9c4d-363a4ad37fc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:34.789160 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe4bdf8a-81ff-4128-9c4d-363a4ad37fc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:34.789596 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe4bdf8a-81ff-4128-9c4d-363a4ad37fc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:34.790360 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe4bdf8a-81ff-4128-9c4d-363a4ad37fc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:34.790788 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe4bdf8a-81ff-4128-9c4d-363a4ad37fc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:34.851442 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fe4bdf8a-81ff-4128-9c4d-363a4ad37fc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:34.859319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fe4bdf8a-81ff-4128-9c4d-363a4ad37fc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081377 Feb 21 01:37:34.859893 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 939/1902] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:34 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:35.875989 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-66c52385-b893-41d9-8d98-8b4980b8f7da tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:35.876599 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-66c52385-b893-41d9-8d98-8b4980b8f7da tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:35.882447 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-66c52385-b893-41d9-8d98-8b4980b8f7da tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:35.882892 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-66c52385-b893-41d9-8d98-8b4980b8f7da tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:35.883651 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-66c52385-b893-41d9-8d98-8b4980b8f7da tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:35.884122 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-66c52385-b893-41d9-8d98-8b4980b8f7da tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:35.949428 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-66c52385-b893-41d9-8d98-8b4980b8f7da tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:35.958623 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-66c52385-b893-41d9-8d98-8b4980b8f7da tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.085305 Feb 21 01:37:35.958623 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 964/1903] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:35 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:36.974925 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-642b70d1-fa06-46d0-bde4-ed05ad0344ed tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:36.975543 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-642b70d1-fa06-46d0-bde4-ed05ad0344ed tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:36.981820 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-642b70d1-fa06-46d0-bde4-ed05ad0344ed tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:36.982272 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-642b70d1-fa06-46d0-bde4-ed05ad0344ed tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:36.983356 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-642b70d1-fa06-46d0-bde4-ed05ad0344ed tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:36.983794 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-642b70d1-fa06-46d0-bde4-ed05ad0344ed tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:37.044901 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-642b70d1-fa06-46d0-bde4-ed05ad0344ed tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:37.052879 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-642b70d1-fa06-46d0-bde4-ed05ad0344ed tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082664 Feb 21 01:37:37.053436 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 940/1904] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:36 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:38.070148 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5bbd028f-ee41-47bc-ad97-ac1e77a898b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:38.070790 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5bbd028f-ee41-47bc-ad97-ac1e77a898b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:38.077207 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5bbd028f-ee41-47bc-ad97-ac1e77a898b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:38.077661 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5bbd028f-ee41-47bc-ad97-ac1e77a898b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:38.078440 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5bbd028f-ee41-47bc-ad97-ac1e77a898b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:38.078876 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5bbd028f-ee41-47bc-ad97-ac1e77a898b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:38.143379 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5bbd028f-ee41-47bc-ad97-ac1e77a898b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:38.151108 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5bbd028f-ee41-47bc-ad97-ac1e77a898b7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084638 Feb 21 01:37:38.151670 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 965/1905] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:38 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:39.168133 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-da089cfe-fc7b-434f-aa09-8592a8bd80c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:39.168740 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-da089cfe-fc7b-434f-aa09-8592a8bd80c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:39.175161 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-da089cfe-fc7b-434f-aa09-8592a8bd80c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:39.175614 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-da089cfe-fc7b-434f-aa09-8592a8bd80c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:39.176424 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-da089cfe-fc7b-434f-aa09-8592a8bd80c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:39.176861 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-da089cfe-fc7b-434f-aa09-8592a8bd80c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:39.235723 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-da089cfe-fc7b-434f-aa09-8592a8bd80c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:39.243964 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-da089cfe-fc7b-434f-aa09-8592a8bd80c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079478 Feb 21 01:37:39.244519 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 941/1906] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:39 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:40.261195 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e8df86f7-f1da-43d6-83ce-29ca7e7f5a9a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:40.261799 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e8df86f7-f1da-43d6-83ce-29ca7e7f5a9a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:40.268683 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e8df86f7-f1da-43d6-83ce-29ca7e7f5a9a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:40.269337 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e8df86f7-f1da-43d6-83ce-29ca7e7f5a9a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:40.270133 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e8df86f7-f1da-43d6-83ce-29ca7e7f5a9a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:40.270569 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e8df86f7-f1da-43d6-83ce-29ca7e7f5a9a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:40.331528 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e8df86f7-f1da-43d6-83ce-29ca7e7f5a9a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:40.339225 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e8df86f7-f1da-43d6-83ce-29ca7e7f5a9a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081754 Feb 21 01:37:40.339778 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 966/1907] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:40 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:41.356886 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c23580f9-cea9-4e01-9e41-48d92c3b8f15 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:41.357513 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c23580f9-cea9-4e01-9e41-48d92c3b8f15 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:41.364426 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c23580f9-cea9-4e01-9e41-48d92c3b8f15 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:41.364872 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c23580f9-cea9-4e01-9e41-48d92c3b8f15 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:41.365680 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c23580f9-cea9-4e01-9e41-48d92c3b8f15 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:41.366121 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c23580f9-cea9-4e01-9e41-48d92c3b8f15 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:41.425772 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c23580f9-cea9-4e01-9e41-48d92c3b8f15 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:41.433475 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c23580f9-cea9-4e01-9e41-48d92c3b8f15 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080284 Feb 21 01:37:41.434033 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 942/1908] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:41 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:42.450432 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8071a9ae-a090-4906-8363-b6ed76f3eccb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:42.451047 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8071a9ae-a090-4906-8363-b6ed76f3eccb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:42.457496 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8071a9ae-a090-4906-8363-b6ed76f3eccb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:42.457944 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8071a9ae-a090-4906-8363-b6ed76f3eccb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:42.458724 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8071a9ae-a090-4906-8363-b6ed76f3eccb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:42.459157 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8071a9ae-a090-4906-8363-b6ed76f3eccb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:42.518307 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8071a9ae-a090-4906-8363-b6ed76f3eccb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:42.525962 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8071a9ae-a090-4906-8363-b6ed76f3eccb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079249 Feb 21 01:37:42.526519 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 967/1909] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:42 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:43.541674 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-68c5920a-00a9-449e-bf19-fed34bed621d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:43.542278 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-68c5920a-00a9-449e-bf19-fed34bed621d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:43.548662 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68c5920a-00a9-449e-bf19-fed34bed621d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:43.549257 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68c5920a-00a9-449e-bf19-fed34bed621d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:43.550036 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68c5920a-00a9-449e-bf19-fed34bed621d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:43.550472 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68c5920a-00a9-449e-bf19-fed34bed621d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:43.609556 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-68c5920a-00a9-449e-bf19-fed34bed621d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:43.617426 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-68c5920a-00a9-449e-bf19-fed34bed621d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079422 Feb 21 01:37:43.617989 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 943/1910] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:43 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:44.633929 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3ede84a0-ab6b-4a7d-b196-ec3bc9a8681e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:44.634462 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3ede84a0-ab6b-4a7d-b196-ec3bc9a8681e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:44.640753 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3ede84a0-ab6b-4a7d-b196-ec3bc9a8681e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:44.641211 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3ede84a0-ab6b-4a7d-b196-ec3bc9a8681e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:44.641986 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3ede84a0-ab6b-4a7d-b196-ec3bc9a8681e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:44.642431 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3ede84a0-ab6b-4a7d-b196-ec3bc9a8681e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:44.703231 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3ede84a0-ab6b-4a7d-b196-ec3bc9a8681e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:44.711404 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3ede84a0-ab6b-4a7d-b196-ec3bc9a8681e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081273 Feb 21 01:37:44.711980 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 968/1911] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:44 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:45.727985 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-288651d7-bf60-42dd-835f-5c7c4f99c12d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:45.728600 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-288651d7-bf60-42dd-835f-5c7c4f99c12d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:45.735054 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-288651d7-bf60-42dd-835f-5c7c4f99c12d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:45.735515 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-288651d7-bf60-42dd-835f-5c7c4f99c12d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:45.736389 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-288651d7-bf60-42dd-835f-5c7c4f99c12d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:45.737395 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-288651d7-bf60-42dd-835f-5c7c4f99c12d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:45.801416 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-288651d7-bf60-42dd-835f-5c7c4f99c12d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:45.809144 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-288651d7-bf60-42dd-835f-5c7c4f99c12d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084974 Feb 21 01:37:45.809705 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 944/1912] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:45 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:46.825141 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-01b8a9c5-98b8-4e20-8795-9bc4dfd73035 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:46.825769 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-01b8a9c5-98b8-4e20-8795-9bc4dfd73035 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:46.832917 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-01b8a9c5-98b8-4e20-8795-9bc4dfd73035 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:46.833408 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-01b8a9c5-98b8-4e20-8795-9bc4dfd73035 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:46.834187 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-01b8a9c5-98b8-4e20-8795-9bc4dfd73035 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:46.834621 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-01b8a9c5-98b8-4e20-8795-9bc4dfd73035 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:46.893488 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-01b8a9c5-98b8-4e20-8795-9bc4dfd73035 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:46.901153 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-01b8a9c5-98b8-4e20-8795-9bc4dfd73035 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079726 Feb 21 01:37:46.901720 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 969/1913] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:46 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:47.918158 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-61f94996-f6b4-42fa-9beb-1c48b89a9ef6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:47.918750 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-61f94996-f6b4-42fa-9beb-1c48b89a9ef6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:47.925989 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-61f94996-f6b4-42fa-9beb-1c48b89a9ef6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:47.926440 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-61f94996-f6b4-42fa-9beb-1c48b89a9ef6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:47.927223 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-61f94996-f6b4-42fa-9beb-1c48b89a9ef6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:47.927661 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-61f94996-f6b4-42fa-9beb-1c48b89a9ef6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:47.988640 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-61f94996-f6b4-42fa-9beb-1c48b89a9ef6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:47.996522 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-61f94996-f6b4-42fa-9beb-1c48b89a9ef6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082035 Feb 21 01:37:47.997066 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 945/1914] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:47 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:49.013651 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ee42b1c9-f564-49e7-82ca-1b6d6c6006d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:49.014263 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ee42b1c9-f564-49e7-82ca-1b6d6c6006d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:49.021050 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ee42b1c9-f564-49e7-82ca-1b6d6c6006d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:49.021502 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ee42b1c9-f564-49e7-82ca-1b6d6c6006d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:49.022285 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ee42b1c9-f564-49e7-82ca-1b6d6c6006d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:49.022729 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ee42b1c9-f564-49e7-82ca-1b6d6c6006d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:49.084674 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ee42b1c9-f564-49e7-82ca-1b6d6c6006d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:49.092383 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ee42b1c9-f564-49e7-82ca-1b6d6c6006d5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082466 Feb 21 01:37:49.092951 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 970/1915] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:49 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:50.109801 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6c808a0a-e34c-49d7-8df8-64050f41bf41 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:50.110410 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6c808a0a-e34c-49d7-8df8-64050f41bf41 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:50.117091 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6c808a0a-e34c-49d7-8df8-64050f41bf41 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:50.117539 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6c808a0a-e34c-49d7-8df8-64050f41bf41 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:50.118319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6c808a0a-e34c-49d7-8df8-64050f41bf41 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:50.118752 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6c808a0a-e34c-49d7-8df8-64050f41bf41 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:50.177655 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6c808a0a-e34c-49d7-8df8-64050f41bf41 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:50.185321 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6c808a0a-e34c-49d7-8df8-64050f41bf41 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079481 Feb 21 01:37:50.185870 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 946/1916] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:50 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:51.202658 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9c6eb257-9179-4e14-8f39-ea35764df1c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:51.203309 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9c6eb257-9179-4e14-8f39-ea35764df1c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:51.210577 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9c6eb257-9179-4e14-8f39-ea35764df1c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:51.211024 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9c6eb257-9179-4e14-8f39-ea35764df1c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:51.211822 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9c6eb257-9179-4e14-8f39-ea35764df1c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:51.212289 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9c6eb257-9179-4e14-8f39-ea35764df1c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:51.272774 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9c6eb257-9179-4e14-8f39-ea35764df1c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:51.280608 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9c6eb257-9179-4e14-8f39-ea35764df1c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081703 Feb 21 01:37:51.281177 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 971/1917] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:51 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:52.297824 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-528b96af-0a27-42a1-ad87-ed379fafd865 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:52.298354 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-528b96af-0a27-42a1-ad87-ed379fafd865 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:52.305604 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-528b96af-0a27-42a1-ad87-ed379fafd865 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:52.306056 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-528b96af-0a27-42a1-ad87-ed379fafd865 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:52.306837 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-528b96af-0a27-42a1-ad87-ed379fafd865 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:52.307272 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-528b96af-0a27-42a1-ad87-ed379fafd865 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:52.369794 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-528b96af-0a27-42a1-ad87-ed379fafd865 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:52.378014 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-528b96af-0a27-42a1-ad87-ed379fafd865 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083946 Feb 21 01:37:52.378573 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 947/1918] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:52 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:53.395115 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c99c7328-b705-4546-83f4-3a1f34e183da tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:53.395743 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c99c7328-b705-4546-83f4-3a1f34e183da tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:53.401921 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c99c7328-b705-4546-83f4-3a1f34e183da tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:53.402363 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c99c7328-b705-4546-83f4-3a1f34e183da tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:53.403137 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c99c7328-b705-4546-83f4-3a1f34e183da tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:53.403562 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c99c7328-b705-4546-83f4-3a1f34e183da tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:53.463310 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c99c7328-b705-4546-83f4-3a1f34e183da tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:53.475026 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c99c7328-b705-4546-83f4-3a1f34e183da tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084419 Feb 21 01:37:53.475580 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 972/1919] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:53 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:54.491649 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-79ba078e-1abd-4872-a6b9-07e83da7ff59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:54.492305 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-79ba078e-1abd-4872-a6b9-07e83da7ff59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:54.498575 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-79ba078e-1abd-4872-a6b9-07e83da7ff59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:54.499026 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-79ba078e-1abd-4872-a6b9-07e83da7ff59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:54.499802 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-79ba078e-1abd-4872-a6b9-07e83da7ff59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:54.500393 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-79ba078e-1abd-4872-a6b9-07e83da7ff59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:54.559674 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-79ba078e-1abd-4872-a6b9-07e83da7ff59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:54.568190 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-79ba078e-1abd-4872-a6b9-07e83da7ff59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080241 Feb 21 01:37:54.568761 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 948/1920] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:54 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:55.584750 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c9b515e7-84a6-4d74-bfb2-f6c7a26cfb66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:55.585380 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c9b515e7-84a6-4d74-bfb2-f6c7a26cfb66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:55.591563 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c9b515e7-84a6-4d74-bfb2-f6c7a26cfb66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:55.592053 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c9b515e7-84a6-4d74-bfb2-f6c7a26cfb66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:55.592826 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c9b515e7-84a6-4d74-bfb2-f6c7a26cfb66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:55.593258 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c9b515e7-84a6-4d74-bfb2-f6c7a26cfb66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:55.653625 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c9b515e7-84a6-4d74-bfb2-f6c7a26cfb66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:55.661879 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c9b515e7-84a6-4d74-bfb2-f6c7a26cfb66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080820 Feb 21 01:37:55.662434 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 973/1921] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:55 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:56.678461 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1c68fd5d-03ed-46fa-b550-1c6af160ceb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:56.679068 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1c68fd5d-03ed-46fa-b550-1c6af160ceb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:56.685255 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1c68fd5d-03ed-46fa-b550-1c6af160ceb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:56.685697 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1c68fd5d-03ed-46fa-b550-1c6af160ceb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:56.686477 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1c68fd5d-03ed-46fa-b550-1c6af160ceb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:56.686905 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1c68fd5d-03ed-46fa-b550-1c6af160ceb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:56.749599 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1c68fd5d-03ed-46fa-b550-1c6af160ceb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:56.757925 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1c68fd5d-03ed-46fa-b550-1c6af160ceb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083438 Feb 21 01:37:56.758488 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 949/1922] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:56 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:57.774916 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-37d2b78d-0dc3-42c3-a8d1-ecb99067f5cb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:57.775520 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-37d2b78d-0dc3-42c3-a8d1-ecb99067f5cb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:57.781746 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-37d2b78d-0dc3-42c3-a8d1-ecb99067f5cb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:57.782196 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-37d2b78d-0dc3-42c3-a8d1-ecb99067f5cb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:57.782976 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-37d2b78d-0dc3-42c3-a8d1-ecb99067f5cb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:57.783410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-37d2b78d-0dc3-42c3-a8d1-ecb99067f5cb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:57.842633 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-37d2b78d-0dc3-42c3-a8d1-ecb99067f5cb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:57.850620 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-37d2b78d-0dc3-42c3-a8d1-ecb99067f5cb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079344 Feb 21 01:37:57.851179 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 974/1923] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:57 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:58.866714 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a056206c-cf79-49af-bece-3411a9db95dd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:58.867363 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a056206c-cf79-49af-bece-3411a9db95dd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:58.873598 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a056206c-cf79-49af-bece-3411a9db95dd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:58.874047 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a056206c-cf79-49af-bece-3411a9db95dd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:58.874827 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a056206c-cf79-49af-bece-3411a9db95dd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:58.875264 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a056206c-cf79-49af-bece-3411a9db95dd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:58.936438 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a056206c-cf79-49af-bece-3411a9db95dd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:58.944514 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a056206c-cf79-49af-bece-3411a9db95dd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081500 Feb 21 01:37:58.945066 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 950/1924] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:58 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:59.960906 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8953c8b6-36a9-48d8-83bd-94f7bd5f453c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:59.961517 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8953c8b6-36a9-48d8-83bd-94f7bd5f453c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:59.967971 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8953c8b6-36a9-48d8-83bd-94f7bd5f453c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:59.968423 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8953c8b6-36a9-48d8-83bd-94f7bd5f453c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:59.969199 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8953c8b6-36a9-48d8-83bd-94f7bd5f453c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:59.969663 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8953c8b6-36a9-48d8-83bd-94f7bd5f453c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:00.028809 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8953c8b6-36a9-48d8-83bd-94f7bd5f453c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:00.037327 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8953c8b6-36a9-48d8-83bd-94f7bd5f453c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080087 Feb 21 01:38:00.038036 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 975/1925] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:59 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:01.054046 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-365eb635-593a-4cc4-99f2-6f3b0e23095c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:01.054701 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-365eb635-593a-4cc4-99f2-6f3b0e23095c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:01.060956 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-365eb635-593a-4cc4-99f2-6f3b0e23095c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:01.061408 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-365eb635-593a-4cc4-99f2-6f3b0e23095c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:01.062199 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-365eb635-593a-4cc4-99f2-6f3b0e23095c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:01.062638 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-365eb635-593a-4cc4-99f2-6f3b0e23095c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:01.122344 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-365eb635-593a-4cc4-99f2-6f3b0e23095c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:01.130034 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-365eb635-593a-4cc4-99f2-6f3b0e23095c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080110 Feb 21 01:38:01.130585 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 951/1926] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:01 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:02.147086 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1a10f013-79a8-4a47-9e70-39a639111087 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:02.147708 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1a10f013-79a8-4a47-9e70-39a639111087 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:02.154919 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1a10f013-79a8-4a47-9e70-39a639111087 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:02.155412 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1a10f013-79a8-4a47-9e70-39a639111087 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:02.156238 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1a10f013-79a8-4a47-9e70-39a639111087 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:02.156679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1a10f013-79a8-4a47-9e70-39a639111087 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:02.220209 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1a10f013-79a8-4a47-9e70-39a639111087 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:02.228951 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1a10f013-79a8-4a47-9e70-39a639111087 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.086012 Feb 21 01:38:02.229513 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 976/1927] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:02 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:38:03.246803 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b303b65f-3e53-456d-be1c-c1f1f023bbc7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:03.247400 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b303b65f-3e53-456d-be1c-c1f1f023bbc7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:03.254488 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b303b65f-3e53-456d-be1c-c1f1f023bbc7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:03.254936 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b303b65f-3e53-456d-be1c-c1f1f023bbc7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:03.255705 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b303b65f-3e53-456d-be1c-c1f1f023bbc7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:03.256160 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b303b65f-3e53-456d-be1c-c1f1f023bbc7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:03.314079 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b303b65f-3e53-456d-be1c-c1f1f023bbc7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:03.322547 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b303b65f-3e53-456d-be1c-c1f1f023bbc7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079518 Feb 21 01:38:03.323099 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 952/1928] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:03 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:04.338325 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6f7bafc6-dc86-4f3b-98d5-e50e91e6fb80 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:04.338858 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6f7bafc6-dc86-4f3b-98d5-e50e91e6fb80 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:04.345107 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6f7bafc6-dc86-4f3b-98d5-e50e91e6fb80 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:04.345560 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6f7bafc6-dc86-4f3b-98d5-e50e91e6fb80 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:04.347089 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6f7bafc6-dc86-4f3b-98d5-e50e91e6fb80 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:04.347694 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6f7bafc6-dc86-4f3b-98d5-e50e91e6fb80 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:04.407057 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-6f7bafc6-dc86-4f3b-98d5-e50e91e6fb80 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:04.415587 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6f7bafc6-dc86-4f3b-98d5-e50e91e6fb80 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081019 Feb 21 01:38:04.416192 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 977/1929] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:04 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:05.433057 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1b9a335f-8cad-4c1b-bcca-000f9275ed48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:05.433670 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1b9a335f-8cad-4c1b-bcca-000f9275ed48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:05.439512 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1b9a335f-8cad-4c1b-bcca-000f9275ed48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:05.440094 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1b9a335f-8cad-4c1b-bcca-000f9275ed48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:05.440897 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1b9a335f-8cad-4c1b-bcca-000f9275ed48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:05.441325 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1b9a335f-8cad-4c1b-bcca-000f9275ed48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:05.502163 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1b9a335f-8cad-4c1b-bcca-000f9275ed48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:05.509864 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1b9a335f-8cad-4c1b-bcca-000f9275ed48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080618 Feb 21 01:38:05.510421 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 953/1930] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:05 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:06.526740 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4d401e81-bbaf-4b6a-a01a-bf709d13d7ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:06.527346 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4d401e81-bbaf-4b6a-a01a-bf709d13d7ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:06.533292 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4d401e81-bbaf-4b6a-a01a-bf709d13d7ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:06.533742 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4d401e81-bbaf-4b6a-a01a-bf709d13d7ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:06.534514 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4d401e81-bbaf-4b6a-a01a-bf709d13d7ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:06.534939 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4d401e81-bbaf-4b6a-a01a-bf709d13d7ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:06.597068 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4d401e81-bbaf-4b6a-a01a-bf709d13d7ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:06.604880 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4d401e81-bbaf-4b6a-a01a-bf709d13d7ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081761 Feb 21 01:38:06.605443 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 978/1931] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:06 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:07.622500 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3daaa8b1-8f76-452d-aa7f-72913aced3c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:07.623054 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3daaa8b1-8f76-452d-aa7f-72913aced3c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:07.629404 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3daaa8b1-8f76-452d-aa7f-72913aced3c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:07.629847 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3daaa8b1-8f76-452d-aa7f-72913aced3c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:07.630626 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3daaa8b1-8f76-452d-aa7f-72913aced3c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:07.631052 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3daaa8b1-8f76-452d-aa7f-72913aced3c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:07.688983 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3daaa8b1-8f76-452d-aa7f-72913aced3c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:07.696936 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3daaa8b1-8f76-452d-aa7f-72913aced3c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078238 Feb 21 01:38:07.697486 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 954/1932] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:07 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:08.713928 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9a645c9e-e0c8-4b89-9b3c-b7f5fc81e5c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:08.714498 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9a645c9e-e0c8-4b89-9b3c-b7f5fc81e5c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:08.720720 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9a645c9e-e0c8-4b89-9b3c-b7f5fc81e5c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:08.721166 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9a645c9e-e0c8-4b89-9b3c-b7f5fc81e5c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:08.722033 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9a645c9e-e0c8-4b89-9b3c-b7f5fc81e5c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:08.722460 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9a645c9e-e0c8-4b89-9b3c-b7f5fc81e5c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:08.781604 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9a645c9e-e0c8-4b89-9b3c-b7f5fc81e5c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:08.789747 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9a645c9e-e0c8-4b89-9b3c-b7f5fc81e5c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079551 Feb 21 01:38:08.790304 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 979/1933] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:08 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:09.806021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e3b62fe0-d7d6-42dc-aa7e-eb0c4c792080 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:09.806618 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e3b62fe0-d7d6-42dc-aa7e-eb0c4c792080 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:09.813066 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e3b62fe0-d7d6-42dc-aa7e-eb0c4c792080 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:09.813509 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e3b62fe0-d7d6-42dc-aa7e-eb0c4c792080 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:09.814313 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e3b62fe0-d7d6-42dc-aa7e-eb0c4c792080 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:09.815322 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e3b62fe0-d7d6-42dc-aa7e-eb0c4c792080 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:09.877590 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e3b62fe0-d7d6-42dc-aa7e-eb0c4c792080 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:09.885185 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e3b62fe0-d7d6-42dc-aa7e-eb0c4c792080 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082899 Feb 21 01:38:09.885738 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 955/1934] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:09 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:10.902369 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0b3fb4f6-e027-49cd-9e96-c3c0772c065d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:10.902957 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0b3fb4f6-e027-49cd-9e96-c3c0772c065d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:10.909742 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0b3fb4f6-e027-49cd-9e96-c3c0772c065d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:10.910181 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0b3fb4f6-e027-49cd-9e96-c3c0772c065d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:10.910947 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0b3fb4f6-e027-49cd-9e96-c3c0772c065d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:10.911374 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0b3fb4f6-e027-49cd-9e96-c3c0772c065d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:10.979788 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0b3fb4f6-e027-49cd-9e96-c3c0772c065d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:10.988039 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0b3fb4f6-e027-49cd-9e96-c3c0772c065d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.089284 Feb 21 01:38:10.988606 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 980/1935] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:10 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:12.004911 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8a2901c1-13e3-4b6c-9314-15f831922daf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:12.005506 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8a2901c1-13e3-4b6c-9314-15f831922daf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:12.011697 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8a2901c1-13e3-4b6c-9314-15f831922daf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:12.012170 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8a2901c1-13e3-4b6c-9314-15f831922daf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:12.013053 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8a2901c1-13e3-4b6c-9314-15f831922daf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:12.013485 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8a2901c1-13e3-4b6c-9314-15f831922daf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:12.072760 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8a2901c1-13e3-4b6c-9314-15f831922daf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:12.080922 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8a2901c1-13e3-4b6c-9314-15f831922daf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079607 Feb 21 01:38:12.081478 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 956/1936] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:11 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:13.097443 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-825b0577-576b-432c-86f6-e2aa75c723cf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:13.098047 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-825b0577-576b-432c-86f6-e2aa75c723cf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:13.104318 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-825b0577-576b-432c-86f6-e2aa75c723cf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:13.104766 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-825b0577-576b-432c-86f6-e2aa75c723cf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:13.105540 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-825b0577-576b-432c-86f6-e2aa75c723cf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:13.105971 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-825b0577-576b-432c-86f6-e2aa75c723cf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:13.165389 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-825b0577-576b-432c-86f6-e2aa75c723cf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:13.172994 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-825b0577-576b-432c-86f6-e2aa75c723cf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079801 Feb 21 01:38:13.173544 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 981/1937] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:13 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:14.189353 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c033e04e-76bc-4de1-8dbb-336cf2c4a7c8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:14.189960 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c033e04e-76bc-4de1-8dbb-336cf2c4a7c8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:14.196484 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c033e04e-76bc-4de1-8dbb-336cf2c4a7c8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:14.196940 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c033e04e-76bc-4de1-8dbb-336cf2c4a7c8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:14.197729 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c033e04e-76bc-4de1-8dbb-336cf2c4a7c8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:14.198167 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c033e04e-76bc-4de1-8dbb-336cf2c4a7c8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:14.257297 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c033e04e-76bc-4de1-8dbb-336cf2c4a7c8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:14.264907 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c033e04e-76bc-4de1-8dbb-336cf2c4a7c8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079382 Feb 21 01:38:14.265464 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 957/1938] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:14 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:15.280712 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-36ff4adf-c4d8-455e-a515-0d6dd53756c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:15.281335 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-36ff4adf-c4d8-455e-a515-0d6dd53756c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:15.287493 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-36ff4adf-c4d8-455e-a515-0d6dd53756c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:15.287970 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-36ff4adf-c4d8-455e-a515-0d6dd53756c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:15.288745 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-36ff4adf-c4d8-455e-a515-0d6dd53756c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:15.289171 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-36ff4adf-c4d8-455e-a515-0d6dd53756c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:15.350586 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-36ff4adf-c4d8-455e-a515-0d6dd53756c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:15.358638 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-36ff4adf-c4d8-455e-a515-0d6dd53756c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081566 Feb 21 01:38:15.359199 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 982/1939] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:15 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:16.375723 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-098d6144-75b5-408e-bcd3-fe40a636260e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:16.376367 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-098d6144-75b5-408e-bcd3-fe40a636260e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:16.383192 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-098d6144-75b5-408e-bcd3-fe40a636260e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:16.383648 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-098d6144-75b5-408e-bcd3-fe40a636260e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:16.384452 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-098d6144-75b5-408e-bcd3-fe40a636260e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:16.384887 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-098d6144-75b5-408e-bcd3-fe40a636260e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:16.443470 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-098d6144-75b5-408e-bcd3-fe40a636260e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:16.451080 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-098d6144-75b5-408e-bcd3-fe40a636260e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079008 Feb 21 01:38:16.451638 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 958/1940] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:16 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:17.468102 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c0c29e0f-5198-4446-930b-9a407211e9b3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:17.468705 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c0c29e0f-5198-4446-930b-9a407211e9b3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:17.475673 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c0c29e0f-5198-4446-930b-9a407211e9b3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:17.476147 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c0c29e0f-5198-4446-930b-9a407211e9b3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:17.476918 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c0c29e0f-5198-4446-930b-9a407211e9b3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:17.477347 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c0c29e0f-5198-4446-930b-9a407211e9b3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:17.540273 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c0c29e0f-5198-4446-930b-9a407211e9b3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:17.548040 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c0c29e0f-5198-4446-930b-9a407211e9b3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083546 Feb 21 01:38:17.548620 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 983/1941] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:17 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:18.563566 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ccbb67d9-a247-4789-a41a-a5eca8dc28ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:18.565017 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ccbb67d9-a247-4789-a41a-a5eca8dc28ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:18.571190 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ccbb67d9-a247-4789-a41a-a5eca8dc28ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:18.571683 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ccbb67d9-a247-4789-a41a-a5eca8dc28ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:18.572455 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ccbb67d9-a247-4789-a41a-a5eca8dc28ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:18.572891 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ccbb67d9-a247-4789-a41a-a5eca8dc28ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:18.632320 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ccbb67d9-a247-4789-a41a-a5eca8dc28ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:18.640011 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ccbb67d9-a247-4789-a41a-a5eca8dc28ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080140 Feb 21 01:38:18.640594 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 959/1942] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:18 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:19.655870 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-db0bdaba-d29e-4e97-ae2f-7d75c5bc0814 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:19.656561 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-db0bdaba-d29e-4e97-ae2f-7d75c5bc0814 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:19.662811 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db0bdaba-d29e-4e97-ae2f-7d75c5bc0814 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:19.663258 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db0bdaba-d29e-4e97-ae2f-7d75c5bc0814 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:19.664065 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db0bdaba-d29e-4e97-ae2f-7d75c5bc0814 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:19.664495 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db0bdaba-d29e-4e97-ae2f-7d75c5bc0814 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:19.723234 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-db0bdaba-d29e-4e97-ae2f-7d75c5bc0814 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:19.730799 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-db0bdaba-d29e-4e97-ae2f-7d75c5bc0814 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078665 Feb 21 01:38:19.731609 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 984/1943] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:19 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:20.747854 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d2f77bc4-5879-44c9-a210-601c049c9932 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:20.748485 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d2f77bc4-5879-44c9-a210-601c049c9932 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:20.755104 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d2f77bc4-5879-44c9-a210-601c049c9932 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:20.755554 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d2f77bc4-5879-44c9-a210-601c049c9932 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:20.756366 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d2f77bc4-5879-44c9-a210-601c049c9932 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:20.756807 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d2f77bc4-5879-44c9-a210-601c049c9932 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:20.821410 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d2f77bc4-5879-44c9-a210-601c049c9932 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:20.829061 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d2f77bc4-5879-44c9-a210-601c049c9932 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084906 Feb 21 01:38:20.830432 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 960/1944] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:20 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:21.846453 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-82a40b05-d475-4c14-9191-f8d658b64e98 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:21.847067 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-82a40b05-d475-4c14-9191-f8d658b64e98 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:21.853529 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-82a40b05-d475-4c14-9191-f8d658b64e98 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:21.853980 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-82a40b05-d475-4c14-9191-f8d658b64e98 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:21.854760 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-82a40b05-d475-4c14-9191-f8d658b64e98 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:21.855196 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-82a40b05-d475-4c14-9191-f8d658b64e98 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:21.914690 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-82a40b05-d475-4c14-9191-f8d658b64e98 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:21.922383 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-82a40b05-d475-4c14-9191-f8d658b64e98 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079909 Feb 21 01:38:21.922950 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 985/1945] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:21 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:22.939618 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4ab7ada2-1fcb-4127-8c87-ed4eb2fa8b2e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:22.940250 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4ab7ada2-1fcb-4127-8c87-ed4eb2fa8b2e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:22.946558 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ab7ada2-1fcb-4127-8c87-ed4eb2fa8b2e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:22.947016 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ab7ada2-1fcb-4127-8c87-ed4eb2fa8b2e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:22.947797 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ab7ada2-1fcb-4127-8c87-ed4eb2fa8b2e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:22.948266 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ab7ada2-1fcb-4127-8c87-ed4eb2fa8b2e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:23.011643 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4ab7ada2-1fcb-4127-8c87-ed4eb2fa8b2e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:23.021110 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4ab7ada2-1fcb-4127-8c87-ed4eb2fa8b2e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.085406 Feb 21 01:38:23.021674 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 961/1946] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:22 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:24.038189 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b762edd4-59e1-441f-91b0-8ccd9040227d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:24.038788 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b762edd4-59e1-441f-91b0-8ccd9040227d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:24.045112 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b762edd4-59e1-441f-91b0-8ccd9040227d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:24.045568 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b762edd4-59e1-441f-91b0-8ccd9040227d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:24.046351 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b762edd4-59e1-441f-91b0-8ccd9040227d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:24.046788 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b762edd4-59e1-441f-91b0-8ccd9040227d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:24.109349 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b762edd4-59e1-441f-91b0-8ccd9040227d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:24.117723 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b762edd4-59e1-441f-91b0-8ccd9040227d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083253 Feb 21 01:38:24.118281 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 986/1947] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:24 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:25.134235 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3e7d6ee2-274b-467a-957b-187ee99d418c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:25.134834 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3e7d6ee2-274b-467a-957b-187ee99d418c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:25.141159 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3e7d6ee2-274b-467a-957b-187ee99d418c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:25.141601 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3e7d6ee2-274b-467a-957b-187ee99d418c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:25.142380 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3e7d6ee2-274b-467a-957b-187ee99d418c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:25.142806 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3e7d6ee2-274b-467a-957b-187ee99d418c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:25.201108 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3e7d6ee2-274b-467a-957b-187ee99d418c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:25.209184 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3e7d6ee2-274b-467a-957b-187ee99d418c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078680 Feb 21 01:38:25.209741 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 962/1948] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:25 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:26.226423 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d3dbb0ee-9ff5-4027-8066-61e286de1168 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:26.227286 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d3dbb0ee-9ff5-4027-8066-61e286de1168 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:26.234581 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d3dbb0ee-9ff5-4027-8066-61e286de1168 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:26.235031 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d3dbb0ee-9ff5-4027-8066-61e286de1168 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:26.236936 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d3dbb0ee-9ff5-4027-8066-61e286de1168 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:26.236936 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d3dbb0ee-9ff5-4027-8066-61e286de1168 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:26.298982 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d3dbb0ee-9ff5-4027-8066-61e286de1168 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:26.306850 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d3dbb0ee-9ff5-4027-8066-61e286de1168 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084243 Feb 21 01:38:26.307421 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 987/1949] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:26 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:38:27.323651 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2c3b0f9f-671d-4a9a-b7a9-2922b4b429b9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:27.324288 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2c3b0f9f-671d-4a9a-b7a9-2922b4b429b9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:27.330856 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2c3b0f9f-671d-4a9a-b7a9-2922b4b429b9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:27.331307 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2c3b0f9f-671d-4a9a-b7a9-2922b4b429b9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:27.332130 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2c3b0f9f-671d-4a9a-b7a9-2922b4b429b9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:27.332570 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2c3b0f9f-671d-4a9a-b7a9-2922b4b429b9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:27.393897 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2c3b0f9f-671d-4a9a-b7a9-2922b4b429b9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:27.401701 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2c3b0f9f-671d-4a9a-b7a9-2922b4b429b9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081819 Feb 21 01:38:27.402262 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 963/1950] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:27 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:28.418340 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8690f06e-ea28-4c35-88e1-ae42ded72946 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:28.418954 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8690f06e-ea28-4c35-88e1-ae42ded72946 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:28.425979 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8690f06e-ea28-4c35-88e1-ae42ded72946 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:28.426437 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8690f06e-ea28-4c35-88e1-ae42ded72946 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:28.427216 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8690f06e-ea28-4c35-88e1-ae42ded72946 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:28.427651 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8690f06e-ea28-4c35-88e1-ae42ded72946 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:28.491071 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8690f06e-ea28-4c35-88e1-ae42ded72946 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:28.498760 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8690f06e-ea28-4c35-88e1-ae42ded72946 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084067 Feb 21 01:38:28.499326 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 988/1951] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:28 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:29.515329 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-636acb1a-8e14-4cdf-a498-18ffdedc6162 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:29.516017 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-636acb1a-8e14-4cdf-a498-18ffdedc6162 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:29.522922 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-636acb1a-8e14-4cdf-a498-18ffdedc6162 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:29.526457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-636acb1a-8e14-4cdf-a498-18ffdedc6162 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:29.526457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-636acb1a-8e14-4cdf-a498-18ffdedc6162 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:29.526457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-636acb1a-8e14-4cdf-a498-18ffdedc6162 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:29.584099 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-636acb1a-8e14-4cdf-a498-18ffdedc6162 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:29.591712 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-636acb1a-8e14-4cdf-a498-18ffdedc6162 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080120 Feb 21 01:38:29.592289 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 964/1952] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:29 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:30.608598 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d7484f17-69b3-4fe5-9a98-799a161344c7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:30.609141 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d7484f17-69b3-4fe5-9a98-799a161344c7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:30.615307 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d7484f17-69b3-4fe5-9a98-799a161344c7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:30.615759 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d7484f17-69b3-4fe5-9a98-799a161344c7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:30.616614 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d7484f17-69b3-4fe5-9a98-799a161344c7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:30.617049 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d7484f17-69b3-4fe5-9a98-799a161344c7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:30.675783 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d7484f17-69b3-4fe5-9a98-799a161344c7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:30.683325 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d7484f17-69b3-4fe5-9a98-799a161344c7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078778 Feb 21 01:38:30.683906 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 989/1953] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:30 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:31.700366 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4e6185bf-472b-45cc-9798-51d85b314b81 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:31.700935 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4e6185bf-472b-45cc-9798-51d85b314b81 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:31.707559 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4e6185bf-472b-45cc-9798-51d85b314b81 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:31.708031 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4e6185bf-472b-45cc-9798-51d85b314b81 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:31.708796 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4e6185bf-472b-45cc-9798-51d85b314b81 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:31.709221 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4e6185bf-472b-45cc-9798-51d85b314b81 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:31.768414 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4e6185bf-472b-45cc-9798-51d85b314b81 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:31.776124 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4e6185bf-472b-45cc-9798-51d85b314b81 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079393 Feb 21 01:38:31.776679 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 965/1954] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:31 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:32.793370 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3cd84ed5-53d4-4275-92d6-6c6efbda0bbe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:32.793979 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3cd84ed5-53d4-4275-92d6-6c6efbda0bbe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:32.800801 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3cd84ed5-53d4-4275-92d6-6c6efbda0bbe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:32.801244 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3cd84ed5-53d4-4275-92d6-6c6efbda0bbe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:32.802022 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3cd84ed5-53d4-4275-92d6-6c6efbda0bbe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:32.802454 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3cd84ed5-53d4-4275-92d6-6c6efbda0bbe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:32.861537 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3cd84ed5-53d4-4275-92d6-6c6efbda0bbe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:32.869161 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3cd84ed5-53d4-4275-92d6-6c6efbda0bbe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079469 Feb 21 01:38:32.869725 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 990/1955] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:32 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:33.885588 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d7a1e239-25b6-4ec8-8238-492f267c0201 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:33.886209 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d7a1e239-25b6-4ec8-8238-492f267c0201 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:33.893490 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d7a1e239-25b6-4ec8-8238-492f267c0201 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:33.893942 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d7a1e239-25b6-4ec8-8238-492f267c0201 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:33.894730 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d7a1e239-25b6-4ec8-8238-492f267c0201 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:33.895168 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d7a1e239-25b6-4ec8-8238-492f267c0201 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:33.955515 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d7a1e239-25b6-4ec8-8238-492f267c0201 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:33.963129 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d7a1e239-25b6-4ec8-8238-492f267c0201 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081255 Feb 21 01:38:33.963687 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 966/1956] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:33 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:34.979774 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1c97c90d-fa77-45c5-9678-1d853fbf88f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:34.980672 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1c97c90d-fa77-45c5-9678-1d853fbf88f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:34.987813 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c97c90d-fa77-45c5-9678-1d853fbf88f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:34.987813 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c97c90d-fa77-45c5-9678-1d853fbf88f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:34.988392 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c97c90d-fa77-45c5-9678-1d853fbf88f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:34.988876 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c97c90d-fa77-45c5-9678-1d853fbf88f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:35.049565 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1c97c90d-fa77-45c5-9678-1d853fbf88f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:35.057423 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1c97c90d-fa77-45c5-9678-1d853fbf88f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081365 Feb 21 01:38:35.057986 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 991/1957] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:34 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:36.073639 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cd7ab466-b6bf-4c89-9837-eab7e8410d36 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:36.077157 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cd7ab466-b6bf-4c89-9837-eab7e8410d36 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:36.080481 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cd7ab466-b6bf-4c89-9837-eab7e8410d36 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:36.080934 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cd7ab466-b6bf-4c89-9837-eab7e8410d36 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:36.081708 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cd7ab466-b6bf-4c89-9837-eab7e8410d36 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:36.082140 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cd7ab466-b6bf-4c89-9837-eab7e8410d36 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:36.144782 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cd7ab466-b6bf-4c89-9837-eab7e8410d36 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:36.152587 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cd7ab466-b6bf-4c89-9837-eab7e8410d36 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082640 Feb 21 01:38:36.153149 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 967/1958] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:36 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:37.169961 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1aeaf36b-f5cb-42ed-9961-5e6c2eaec5e9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:37.170576 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1aeaf36b-f5cb-42ed-9961-5e6c2eaec5e9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:37.177012 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1aeaf36b-f5cb-42ed-9961-5e6c2eaec5e9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:37.177460 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1aeaf36b-f5cb-42ed-9961-5e6c2eaec5e9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:37.178240 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1aeaf36b-f5cb-42ed-9961-5e6c2eaec5e9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:37.178668 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1aeaf36b-f5cb-42ed-9961-5e6c2eaec5e9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:37.237765 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1aeaf36b-f5cb-42ed-9961-5e6c2eaec5e9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:37.245456 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1aeaf36b-f5cb-42ed-9961-5e6c2eaec5e9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079366 Feb 21 01:38:37.246005 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 992/1959] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:37 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:38.262103 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-66f1f1a2-c4b0-485a-85d8-893861fb60d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:38.262720 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-66f1f1a2-c4b0-485a-85d8-893861fb60d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:38.270250 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-66f1f1a2-c4b0-485a-85d8-893861fb60d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:38.270705 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-66f1f1a2-c4b0-485a-85d8-893861fb60d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:38.271495 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-66f1f1a2-c4b0-485a-85d8-893861fb60d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:38.271967 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-66f1f1a2-c4b0-485a-85d8-893861fb60d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:38.332640 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-66f1f1a2-c4b0-485a-85d8-893861fb60d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:38.340278 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-66f1f1a2-c4b0-485a-85d8-893861fb60d2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081884 Feb 21 01:38:38.340819 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 968/1960] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:38 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:39.356410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-86429629-5d5c-4488-9ef2-d7059129326a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:39.357009 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-86429629-5d5c-4488-9ef2-d7059129326a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:39.363806 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-86429629-5d5c-4488-9ef2-d7059129326a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:39.364286 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-86429629-5d5c-4488-9ef2-d7059129326a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:39.365116 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-86429629-5d5c-4488-9ef2-d7059129326a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:39.365553 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-86429629-5d5c-4488-9ef2-d7059129326a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:39.432670 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-86429629-5d5c-4488-9ef2-d7059129326a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:39.441246 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-86429629-5d5c-4488-9ef2-d7059129326a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.088698 Feb 21 01:38:39.441810 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 993/1961] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:39 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:40.458447 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ce82e5eb-437c-40c8-92f5-3f69d05f475c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:40.459055 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ce82e5eb-437c-40c8-92f5-3f69d05f475c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:40.465280 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ce82e5eb-437c-40c8-92f5-3f69d05f475c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:40.465734 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ce82e5eb-437c-40c8-92f5-3f69d05f475c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:40.466520 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ce82e5eb-437c-40c8-92f5-3f69d05f475c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:40.466966 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ce82e5eb-437c-40c8-92f5-3f69d05f475c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:40.559753 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ce82e5eb-437c-40c8-92f5-3f69d05f475c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:40.568388 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ce82e5eb-437c-40c8-92f5-3f69d05f475c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.114447 Feb 21 01:38:40.568962 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 969/1962] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:40 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:41.585285 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-70dd7710-1077-4f01-891d-42c57e5739fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:41.585885 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-70dd7710-1077-4f01-891d-42c57e5739fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:41.592122 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-70dd7710-1077-4f01-891d-42c57e5739fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:41.592565 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-70dd7710-1077-4f01-891d-42c57e5739fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:41.593331 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-70dd7710-1077-4f01-891d-42c57e5739fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:41.593755 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-70dd7710-1077-4f01-891d-42c57e5739fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:41.656562 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-70dd7710-1077-4f01-891d-42c57e5739fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:41.664786 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-70dd7710-1077-4f01-891d-42c57e5739fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083114 Feb 21 01:38:41.665342 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 994/1963] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:41 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:42.681503 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d6f67f9f-80b0-4bed-bbd6-21c484488c19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:42.682054 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d6f67f9f-80b0-4bed-bbd6-21c484488c19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:42.688305 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d6f67f9f-80b0-4bed-bbd6-21c484488c19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:42.688764 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d6f67f9f-80b0-4bed-bbd6-21c484488c19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:42.689531 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d6f67f9f-80b0-4bed-bbd6-21c484488c19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:42.689965 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d6f67f9f-80b0-4bed-bbd6-21c484488c19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:42.749930 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d6f67f9f-80b0-4bed-bbd6-21c484488c19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:42.757789 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d6f67f9f-80b0-4bed-bbd6-21c484488c19 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080126 Feb 21 01:38:42.758352 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 970/1964] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:42 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:43.774183 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-07519da5-e3db-40a4-9b87-a9a5db5d6a8a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:43.774801 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-07519da5-e3db-40a4-9b87-a9a5db5d6a8a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:43.781138 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-07519da5-e3db-40a4-9b87-a9a5db5d6a8a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:43.781604 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-07519da5-e3db-40a4-9b87-a9a5db5d6a8a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:43.782373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-07519da5-e3db-40a4-9b87-a9a5db5d6a8a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:43.782797 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-07519da5-e3db-40a4-9b87-a9a5db5d6a8a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:43.842282 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-07519da5-e3db-40a4-9b87-a9a5db5d6a8a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:43.850172 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-07519da5-e3db-40a4-9b87-a9a5db5d6a8a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079571 Feb 21 01:38:43.850746 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 995/1965] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:43 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:44.868777 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cc8ddf8a-d9c0-421e-a7b0-a6f91cd4159f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:44.869395 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cc8ddf8a-d9c0-421e-a7b0-a6f91cd4159f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:44.876136 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc8ddf8a-d9c0-421e-a7b0-a6f91cd4159f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:44.876576 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc8ddf8a-d9c0-421e-a7b0-a6f91cd4159f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:44.877348 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc8ddf8a-d9c0-421e-a7b0-a6f91cd4159f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:44.877777 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc8ddf8a-d9c0-421e-a7b0-a6f91cd4159f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:44.936106 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cc8ddf8a-d9c0-421e-a7b0-a6f91cd4159f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:44.944295 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cc8ddf8a-d9c0-421e-a7b0-a6f91cd4159f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080241 Feb 21 01:38:44.944856 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 971/1966] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:44 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:45.960644 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ab0460b1-9813-4db0-91c2-a6702dd3af62 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:45.961237 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ab0460b1-9813-4db0-91c2-a6702dd3af62 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:45.967680 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ab0460b1-9813-4db0-91c2-a6702dd3af62 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:45.968156 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ab0460b1-9813-4db0-91c2-a6702dd3af62 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:45.969589 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ab0460b1-9813-4db0-91c2-a6702dd3af62 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:45.970389 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ab0460b1-9813-4db0-91c2-a6702dd3af62 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:46.029001 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ab0460b1-9813-4db0-91c2-a6702dd3af62 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:46.037256 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ab0460b1-9813-4db0-91c2-a6702dd3af62 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080388 Feb 21 01:38:46.037818 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 996/1967] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:45 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:47.053989 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f96cec0f-842d-4fb6-815d-05151dd310d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:47.054579 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f96cec0f-842d-4fb6-815d-05151dd310d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:47.060944 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f96cec0f-842d-4fb6-815d-05151dd310d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:47.061390 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f96cec0f-842d-4fb6-815d-05151dd310d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:47.062157 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f96cec0f-842d-4fb6-815d-05151dd310d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:47.062580 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f96cec0f-842d-4fb6-815d-05151dd310d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:47.126800 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f96cec0f-842d-4fb6-815d-05151dd310d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:47.134670 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f96cec0f-842d-4fb6-815d-05151dd310d3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084479 Feb 21 01:38:47.135224 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 972/1968] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:47 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:48.151031 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-54e593b6-f3a4-4631-bb7a-57d738d3a7bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:48.151636 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-54e593b6-f3a4-4631-bb7a-57d738d3a7bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:48.158532 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-54e593b6-f3a4-4631-bb7a-57d738d3a7bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:48.159010 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-54e593b6-f3a4-4631-bb7a-57d738d3a7bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:48.159796 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-54e593b6-f3a4-4631-bb7a-57d738d3a7bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:48.160264 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-54e593b6-f3a4-4631-bb7a-57d738d3a7bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:48.220828 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-54e593b6-f3a4-4631-bb7a-57d738d3a7bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:48.228625 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-54e593b6-f3a4-4631-bb7a-57d738d3a7bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081234 Feb 21 01:38:48.229182 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 997/1969] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:48 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:49.246465 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0c584f3c-3ad9-4182-b3b8-24ceec265665 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:49.247103 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0c584f3c-3ad9-4182-b3b8-24ceec265665 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:49.253427 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c584f3c-3ad9-4182-b3b8-24ceec265665 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:49.253871 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c584f3c-3ad9-4182-b3b8-24ceec265665 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:49.254650 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c584f3c-3ad9-4182-b3b8-24ceec265665 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:49.255085 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0c584f3c-3ad9-4182-b3b8-24ceec265665 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:49.315680 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0c584f3c-3ad9-4182-b3b8-24ceec265665 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:49.323350 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0c584f3c-3ad9-4182-b3b8-24ceec265665 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080593 Feb 21 01:38:49.323929 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 973/1970] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:49 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:50.340842 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-89c7e1ed-20b4-4b99-88f7-d44747d665d8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:50.341386 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-89c7e1ed-20b4-4b99-88f7-d44747d665d8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:50.348500 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-89c7e1ed-20b4-4b99-88f7-d44747d665d8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:50.348952 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-89c7e1ed-20b4-4b99-88f7-d44747d665d8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:50.349729 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-89c7e1ed-20b4-4b99-88f7-d44747d665d8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:50.350164 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-89c7e1ed-20b4-4b99-88f7-d44747d665d8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:50.410682 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-89c7e1ed-20b4-4b99-88f7-d44747d665d8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:50.418425 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-89c7e1ed-20b4-4b99-88f7-d44747d665d8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081383 Feb 21 01:38:50.418969 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 998/1971] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:50 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:51.435514 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e33bf9ff-533b-4c75-9dd8-f6b7ff3b4b94 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:51.436128 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e33bf9ff-533b-4c75-9dd8-f6b7ff3b4b94 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:51.443030 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e33bf9ff-533b-4c75-9dd8-f6b7ff3b4b94 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:51.443475 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e33bf9ff-533b-4c75-9dd8-f6b7ff3b4b94 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:51.444418 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e33bf9ff-533b-4c75-9dd8-f6b7ff3b4b94 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:51.444847 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e33bf9ff-533b-4c75-9dd8-f6b7ff3b4b94 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:51.506293 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e33bf9ff-533b-4c75-9dd8-f6b7ff3b4b94 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:51.514798 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e33bf9ff-533b-4c75-9dd8-f6b7ff3b4b94 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082988 Feb 21 01:38:51.515390 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 974/1972] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:51 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:52.532109 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e735c80b-587e-47be-b9f5-ad4463e56cfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:52.532674 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e735c80b-587e-47be-b9f5-ad4463e56cfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:52.538839 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e735c80b-587e-47be-b9f5-ad4463e56cfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:52.539281 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e735c80b-587e-47be-b9f5-ad4463e56cfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:52.540079 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e735c80b-587e-47be-b9f5-ad4463e56cfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:52.540504 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e735c80b-587e-47be-b9f5-ad4463e56cfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:52.600058 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e735c80b-587e-47be-b9f5-ad4463e56cfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:52.608118 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e735c80b-587e-47be-b9f5-ad4463e56cfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080212 Feb 21 01:38:52.608617 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 999/1973] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:52 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:53.625655 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-beccee39-436b-46d0-b1e5-60fc3a98a012 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:53.626348 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-beccee39-436b-46d0-b1e5-60fc3a98a012 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:53.632517 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-beccee39-436b-46d0-b1e5-60fc3a98a012 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:53.635907 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-beccee39-436b-46d0-b1e5-60fc3a98a012 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:53.635907 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-beccee39-436b-46d0-b1e5-60fc3a98a012 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:53.635907 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-beccee39-436b-46d0-b1e5-60fc3a98a012 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:53.693663 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-beccee39-436b-46d0-b1e5-60fc3a98a012 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:53.701389 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-beccee39-436b-46d0-b1e5-60fc3a98a012 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080157 Feb 21 01:38:53.701963 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 975/1974] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:53 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:54.718116 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3c4c0bcd-4fb6-475d-82b4-7aa756523ac2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:54.719208 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3c4c0bcd-4fb6-475d-82b4-7aa756523ac2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:54.725536 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3c4c0bcd-4fb6-475d-82b4-7aa756523ac2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:54.725981 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3c4c0bcd-4fb6-475d-82b4-7aa756523ac2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:54.726765 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3c4c0bcd-4fb6-475d-82b4-7aa756523ac2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:54.727195 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3c4c0bcd-4fb6-475d-82b4-7aa756523ac2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:54.802999 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3c4c0bcd-4fb6-475d-82b4-7aa756523ac2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:54.810817 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3c4c0bcd-4fb6-475d-82b4-7aa756523ac2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.096593 Feb 21 01:38:54.811373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1000/1975] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:54 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:55.827470 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b42d0af1-c2d2-403a-8bdf-a36c55dc6a85 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:55.828129 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b42d0af1-c2d2-403a-8bdf-a36c55dc6a85 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:55.834355 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b42d0af1-c2d2-403a-8bdf-a36c55dc6a85 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:55.834794 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b42d0af1-c2d2-403a-8bdf-a36c55dc6a85 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:55.835560 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b42d0af1-c2d2-403a-8bdf-a36c55dc6a85 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:55.836020 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b42d0af1-c2d2-403a-8bdf-a36c55dc6a85 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:55.894876 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b42d0af1-c2d2-403a-8bdf-a36c55dc6a85 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:55.902539 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b42d0af1-c2d2-403a-8bdf-a36c55dc6a85 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078701 Feb 21 01:38:55.903092 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 976/1976] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:55 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:56.919309 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0466ed1a-d89f-4d20-b640-0e7e5cfe625d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:56.919959 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0466ed1a-d89f-4d20-b640-0e7e5cfe625d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:56.926523 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0466ed1a-d89f-4d20-b640-0e7e5cfe625d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:56.926975 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0466ed1a-d89f-4d20-b640-0e7e5cfe625d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:56.927756 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0466ed1a-d89f-4d20-b640-0e7e5cfe625d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:56.928221 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0466ed1a-d89f-4d20-b640-0e7e5cfe625d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:56.988741 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0466ed1a-d89f-4d20-b640-0e7e5cfe625d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:56.996414 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0466ed1a-d89f-4d20-b640-0e7e5cfe625d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080836 Feb 21 01:38:56.996968 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1001/1977] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:56 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:58.013332 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ee1191bd-a518-487a-97a2-92026e296198 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:58.013962 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ee1191bd-a518-487a-97a2-92026e296198 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:58.021552 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee1191bd-a518-487a-97a2-92026e296198 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:58.022003 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee1191bd-a518-487a-97a2-92026e296198 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:58.022785 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee1191bd-a518-487a-97a2-92026e296198 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:58.023224 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ee1191bd-a518-487a-97a2-92026e296198 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:58.086059 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ee1191bd-a518-487a-97a2-92026e296198 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:58.093827 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ee1191bd-a518-487a-97a2-92026e296198 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084256 Feb 21 01:38:58.094384 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 977/1978] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:58 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:59.111510 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8debf174-29f9-4535-a887-fc0318f73de7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:59.112222 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8debf174-29f9-4535-a887-fc0318f73de7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:59.118437 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8debf174-29f9-4535-a887-fc0318f73de7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:59.118887 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8debf174-29f9-4535-a887-fc0318f73de7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:59.119668 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8debf174-29f9-4535-a887-fc0318f73de7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:59.120136 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8debf174-29f9-4535-a887-fc0318f73de7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:59.179498 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8debf174-29f9-4535-a887-fc0318f73de7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:59.187211 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8debf174-29f9-4535-a887-fc0318f73de7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079993 Feb 21 01:38:59.187771 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1002/1979] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:59 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:00.203545 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cfaf996a-7505-48b4-b5b3-3bbab20e3c5c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:00.204661 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cfaf996a-7505-48b4-b5b3-3bbab20e3c5c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:00.211023 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cfaf996a-7505-48b4-b5b3-3bbab20e3c5c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:00.211461 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cfaf996a-7505-48b4-b5b3-3bbab20e3c5c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:00.212272 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cfaf996a-7505-48b4-b5b3-3bbab20e3c5c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:00.212702 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cfaf996a-7505-48b4-b5b3-3bbab20e3c5c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:00.271405 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cfaf996a-7505-48b4-b5b3-3bbab20e3c5c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:00.278938 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cfaf996a-7505-48b4-b5b3-3bbab20e3c5c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079031 Feb 21 01:39:00.279490 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 978/1980] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:00 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:01.295241 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5a1d6c01-b5f7-4245-828a-233701429092 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:01.296002 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5a1d6c01-b5f7-4245-828a-233701429092 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:01.302860 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5a1d6c01-b5f7-4245-828a-233701429092 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:01.303308 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5a1d6c01-b5f7-4245-828a-233701429092 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:01.304120 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5a1d6c01-b5f7-4245-828a-233701429092 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:01.304561 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5a1d6c01-b5f7-4245-828a-233701429092 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:01.459975 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5a1d6c01-b5f7-4245-828a-233701429092 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:01.459975 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5a1d6c01-b5f7-4245-828a-233701429092 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083080 Feb 21 01:39:01.459975 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1003/1981] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:01 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:02.406675 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-48a9f027-d7cf-467a-bff4-354c4dc77b56 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:02.407286 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-48a9f027-d7cf-467a-bff4-354c4dc77b56 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:02.413600 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-48a9f027-d7cf-467a-bff4-354c4dc77b56 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:02.414047 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-48a9f027-d7cf-467a-bff4-354c4dc77b56 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:02.414829 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-48a9f027-d7cf-467a-bff4-354c4dc77b56 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:02.415262 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-48a9f027-d7cf-467a-bff4-354c4dc77b56 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:02.477474 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-48a9f027-d7cf-467a-bff4-354c4dc77b56 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:02.486143 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-48a9f027-d7cf-467a-bff4-354c4dc77b56 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082604 Feb 21 01:39:02.486855 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 979/1982] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:02 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:03.503295 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-de1569b1-5201-41f7-af6e-d8a549096e9c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:03.503957 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-de1569b1-5201-41f7-af6e-d8a549096e9c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:03.510389 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-de1569b1-5201-41f7-af6e-d8a549096e9c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:03.510883 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-de1569b1-5201-41f7-af6e-d8a549096e9c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:03.511786 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-de1569b1-5201-41f7-af6e-d8a549096e9c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:03.512269 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-de1569b1-5201-41f7-af6e-d8a549096e9c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:03.573358 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-de1569b1-5201-41f7-af6e-d8a549096e9c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:03.581632 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-de1569b1-5201-41f7-af6e-d8a549096e9c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082188 Feb 21 01:39:03.582184 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1004/1983] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:03 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:04.598113 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-60e00ad1-2d26-43ce-8696-b319c94f28fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:04.598724 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-60e00ad1-2d26-43ce-8696-b319c94f28fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:04.605575 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-60e00ad1-2d26-43ce-8696-b319c94f28fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:04.606014 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-60e00ad1-2d26-43ce-8696-b319c94f28fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:04.606780 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-60e00ad1-2d26-43ce-8696-b319c94f28fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:04.607207 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-60e00ad1-2d26-43ce-8696-b319c94f28fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:04.666652 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-60e00ad1-2d26-43ce-8696-b319c94f28fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:04.674229 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-60e00ad1-2d26-43ce-8696-b319c94f28fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079798 Feb 21 01:39:04.674780 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 980/1984] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:04 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:05.690601 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-58fff83c-73e2-44ab-b369-b2556a4951ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:05.691154 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-58fff83c-73e2-44ab-b369-b2556a4951ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:05.697165 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-58fff83c-73e2-44ab-b369-b2556a4951ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:05.697611 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-58fff83c-73e2-44ab-b369-b2556a4951ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:05.698389 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-58fff83c-73e2-44ab-b369-b2556a4951ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:05.698820 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-58fff83c-73e2-44ab-b369-b2556a4951ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:05.757827 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-58fff83c-73e2-44ab-b369-b2556a4951ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:05.765389 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-58fff83c-73e2-44ab-b369-b2556a4951ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078560 Feb 21 01:39:05.765943 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1005/1985] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:05 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:06.406227 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fec2cdc3-327d-4025-920f-286eccf2e4e3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:06.406726 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fec2cdc3-327d-4025-920f-286eccf2e4e3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:06.414310 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fec2cdc3-327d-4025-920f-286eccf2e4e3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:06.415093 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fec2cdc3-327d-4025-920f-286eccf2e4e3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:06.415903 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fec2cdc3-327d-4025-920f-286eccf2e4e3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:06.416364 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fec2cdc3-327d-4025-920f-286eccf2e4e3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:06.441657 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fec2cdc3-327d-4025-920f-286eccf2e4e3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] Going to try to terminate instance {{(pid=117138) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:39:06.719251 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fec2cdc3-327d-4025-920f-286eccf2e4e3 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "DELETE /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899" status: 204 len: 0 microversion: 2.20 time: 0.316453 Feb 21 01:39:06.720549 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 981/1986] 10.222.0.91 () {60 vars in 1279 bytes} [Mon Feb 21 01:39:06 2022] DELETE /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 21 01:39:06.728435 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a36d077d-a58c-4d74-ac22-f30a0132ee5e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:06.729925 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a36d077d-a58c-4d74-ac22-f30a0132ee5e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:06.735578 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a36d077d-a58c-4d74-ac22-f30a0132ee5e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:06.736051 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a36d077d-a58c-4d74-ac22-f30a0132ee5e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:06.736848 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a36d077d-a58c-4d74-ac22-f30a0132ee5e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:06.737275 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a36d077d-a58c-4d74-ac22-f30a0132ee5e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:06.783653 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a7205e6e-be93-4f23-8742-8907ffe503f7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:06.784451 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a7205e6e-be93-4f23-8742-8907ffe503f7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:06.790396 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a7205e6e-be93-4f23-8742-8907ffe503f7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:06.790908 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a7205e6e-be93-4f23-8742-8907ffe503f7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:06.791672 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a7205e6e-be93-4f23-8742-8907ffe503f7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:06.792141 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a7205e6e-be93-4f23-8742-8907ffe503f7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:06.853122 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a7205e6e-be93-4f23-8742-8907ffe503f7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:06.861483 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a7205e6e-be93-4f23-8742-8907ffe503f7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082650 Feb 21 01:39:06.862060 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 982/1987] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:06 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:39:06.873871 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a36d077d-a58c-4d74-ac22-f30a0132ee5e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:06.881731 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a36d077d-a58c-4d74-ac22-f30a0132ee5e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:06.883223 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a36d077d-a58c-4d74-ac22-f30a0132ee5e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:06.884428 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a36d077d-a58c-4d74-ac22-f30a0132ee5e tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899" status: 200 len: 1724 microversion: 2.20 time: 0.159667 Feb 21 01:39:06.884976 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1006/1988] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:39:06 2022] GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:39:07.877543 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a53e3207-5d32-4c20-a614-caeabaf5f1bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:07.878185 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a53e3207-5d32-4c20-a614-caeabaf5f1bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:07.884771 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a53e3207-5d32-4c20-a614-caeabaf5f1bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:07.885281 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a53e3207-5d32-4c20-a614-caeabaf5f1bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:07.886148 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a53e3207-5d32-4c20-a614-caeabaf5f1bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:07.886671 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a53e3207-5d32-4c20-a614-caeabaf5f1bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:07.902184 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-eab64ccb-5863-4c3d-b311-7e4c477e7935 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:07.902799 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-eab64ccb-5863-4c3d-b311-7e4c477e7935 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:07.910028 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eab64ccb-5863-4c3d-b311-7e4c477e7935 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:07.910487 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eab64ccb-5863-4c3d-b311-7e4c477e7935 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:07.911294 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eab64ccb-5863-4c3d-b311-7e4c477e7935 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:07.911731 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eab64ccb-5863-4c3d-b311-7e4c477e7935 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:07.953032 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a53e3207-5d32-4c20-a614-caeabaf5f1bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:07.963009 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a53e3207-5d32-4c20-a614-caeabaf5f1bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.089232 Feb 21 01:39:07.971897 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 983/1989] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:07 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:07.975813 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-eab64ccb-5863-4c3d-b311-7e4c477e7935 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:07.983878 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-eab64ccb-5863-4c3d-b311-7e4c477e7935 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:07.985976 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-eab64ccb-5863-4c3d-b311-7e4c477e7935 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:07.987252 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-eab64ccb-5863-4c3d-b311-7e4c477e7935 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899" status: 200 len: 1657 microversion: 2.20 time: 0.088797 Feb 21 01:39:07.987815 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1007/1990] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:39:07 2022] GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899 => generated 1657 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:39:08.113593 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-b30349cb-0a59-48fd-a45e-844adc7e5a28 req-7cae672f-cca0-417b-81ea-31f87e8c37c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8a1c406-f790-40a9-80d8-975e707b8899", "name": "network-vif-deleted", "tag": "83a888b1-da52-44e7-9486-c1020c3facd8"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:39:08.115241 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:39:08.115241 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:39:08.126897 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-b30349cb-0a59-48fd-a45e-844adc7e5a28 req-7cae672f-cca0-417b-81ea-31f87e8c37c5 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:08.139738 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-b30349cb-0a59-48fd-a45e-844adc7e5a28 req-7cae672f-cca0-417b-81ea-31f87e8c37c5 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:08.139738 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-b30349cb-0a59-48fd-a45e-844adc7e5a28 req-7cae672f-cca0-417b-81ea-31f87e8c37c5 service nova] Creating event network-vif-deleted:83a888b1-da52-44e7-9486-c1020c3facd8 for instance d8a1c406-f790-40a9-80d8-975e707b8899 on hv-cinder-81322 Feb 21 01:39:08.145724 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-b30349cb-0a59-48fd-a45e-844adc7e5a28 req-7cae672f-cca0-417b-81ea-31f87e8c37c5 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036483 Feb 21 01:39:08.146610 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 984/1991] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:39:08.980823 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-74547e31-a015-4e4d-b89a-08ef9f1cc6c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:08.981521 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-74547e31-a015-4e4d-b89a-08ef9f1cc6c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:08.988678 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-74547e31-a015-4e4d-b89a-08ef9f1cc6c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:08.989328 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-74547e31-a015-4e4d-b89a-08ef9f1cc6c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:08.990152 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-74547e31-a015-4e4d-b89a-08ef9f1cc6c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:08.990586 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-74547e31-a015-4e4d-b89a-08ef9f1cc6c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:09.006118 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-38e1b577-3e7f-4e88-8b34-023dcfa8f30a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:09.007679 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-38e1b577-3e7f-4e88-8b34-023dcfa8f30a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:09.013723 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-38e1b577-3e7f-4e88-8b34-023dcfa8f30a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:09.014414 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-38e1b577-3e7f-4e88-8b34-023dcfa8f30a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:09.015458 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-38e1b577-3e7f-4e88-8b34-023dcfa8f30a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:09.015921 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-38e1b577-3e7f-4e88-8b34-023dcfa8f30a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:09.051070 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-38e1b577-3e7f-4e88-8b34-023dcfa8f30a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:09.051070 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-38e1b577-3e7f-4e88-8b34-023dcfa8f30a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:09.051070 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.objects.instance [None req-38e1b577-3e7f-4e88-8b34-023dcfa8f30a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lazy-loading 'fault' on Instance uuid d8a1c406-f790-40a9-80d8-975e707b8899 {{(pid=117138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:39:09.059467 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-74547e31-a015-4e4d-b89a-08ef9f1cc6c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:09.069866 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-74547e31-a015-4e4d-b89a-08ef9f1cc6c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.093255 Feb 21 01:39:09.070450 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1008/1992] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:08 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:09.106599 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-38e1b577-3e7f-4e88-8b34-023dcfa8f30a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:09.114550 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-38e1b577-3e7f-4e88-8b34-023dcfa8f30a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:09.116091 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-38e1b577-3e7f-4e88-8b34-023dcfa8f30a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5adf4837cc254e1a951dda183d795606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:09.117249 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-38e1b577-3e7f-4e88-8b34-023dcfa8f30a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899" status: 200 len: 1372 microversion: 2.20 time: 0.116374 Feb 21 01:39:09.117805 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 985/1993] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:39:08 2022] GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899 => generated 1372 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:39:10.086800 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4e4ae45b-f203-46b4-8d81-430a4f15f6f7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:10.087441 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4e4ae45b-f203-46b4-8d81-430a4f15f6f7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:10.093673 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4e4ae45b-f203-46b4-8d81-430a4f15f6f7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:10.094151 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4e4ae45b-f203-46b4-8d81-430a4f15f6f7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:10.094926 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4e4ae45b-f203-46b4-8d81-430a4f15f6f7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:10.095359 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4e4ae45b-f203-46b4-8d81-430a4f15f6f7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:10.135771 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-36a49a2a-e6ab-4571-b4fb-834644b30126 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:10.136396 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-36a49a2a-e6ab-4571-b4fb-834644b30126 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:10.143794 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-36a49a2a-e6ab-4571-b4fb-834644b30126 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:10.144270 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-36a49a2a-e6ab-4571-b4fb-834644b30126 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:10.145062 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-36a49a2a-e6ab-4571-b4fb-834644b30126 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:10.145495 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-36a49a2a-e6ab-4571-b4fb-834644b30126 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:10.165682 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4e4ae45b-f203-46b4-8d81-430a4f15f6f7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:10.173005 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.wsgi [None req-36a49a2a-e6ab-4571-b4fb-834644b30126 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] HTTP exception thrown: Instance d8a1c406-f790-40a9-80d8-975e707b8899 could not be found. Feb 21 01:39:10.173605 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4e4ae45b-f203-46b4-8d81-430a4f15f6f7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.090470 Feb 21 01:39:10.173791 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-36a49a2a-e6ab-4571-b4fb-834644b30126 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Returning 404 to user: Instance d8a1c406-f790-40a9-80d8-975e707b8899 could not be found. {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:39:10.174373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1009/1994] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:10 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:10.174837 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-36a49a2a-e6ab-4571-b4fb-834644b30126 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899" status: 404 len: 111 microversion: 2.20 time: 0.042559 Feb 21 01:39:10.177142 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 986/1995] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:39:10 2022] GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 21 01:39:10.183931 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-97b3878f-777a-43aa-9082-1f779809a38a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '.version_select at 0x7f4ad33e3ee0>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:10.297771 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-97b3878f-777a-43aa-9082-1f779809a38a tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902937667" status: 204 len: 0 microversion: 2.20 time: 0.117365 Feb 21 01:39:10.298336 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1010/1996] 10.222.0.91 () {60 vars in 1261 bytes} [Mon Feb 21 01:39:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902937667 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 21 01:39:11.189360 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e550d4d6-219e-4843-8b2e-fd4c947209fc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:11.190959 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e550d4d6-219e-4843-8b2e-fd4c947209fc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:11.197188 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e550d4d6-219e-4843-8b2e-fd4c947209fc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:11.197635 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e550d4d6-219e-4843-8b2e-fd4c947209fc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:11.198412 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e550d4d6-219e-4843-8b2e-fd4c947209fc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:11.198849 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e550d4d6-219e-4843-8b2e-fd4c947209fc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:11.258339 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e550d4d6-219e-4843-8b2e-fd4c947209fc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:11.265984 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e550d4d6-219e-4843-8b2e-fd4c947209fc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080366 Feb 21 01:39:11.266540 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 987/1997] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:11 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:12.282836 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-92fdae2f-00b1-4dd3-903d-2124a7764b93 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:12.283446 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-92fdae2f-00b1-4dd3-903d-2124a7764b93 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:12.289465 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-92fdae2f-00b1-4dd3-903d-2124a7764b93 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:12.289907 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-92fdae2f-00b1-4dd3-903d-2124a7764b93 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:12.290683 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-92fdae2f-00b1-4dd3-903d-2124a7764b93 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:12.291116 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-92fdae2f-00b1-4dd3-903d-2124a7764b93 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:12.350498 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-92fdae2f-00b1-4dd3-903d-2124a7764b93 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:12.358557 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-92fdae2f-00b1-4dd3-903d-2124a7764b93 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079844 Feb 21 01:39:12.358960 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1011/1998] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:12 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:13.375393 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-dcf88045-e81a-4808-a2dc-21bcaabc506e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:13.376103 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-dcf88045-e81a-4808-a2dc-21bcaabc506e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:13.382838 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dcf88045-e81a-4808-a2dc-21bcaabc506e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:13.383310 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dcf88045-e81a-4808-a2dc-21bcaabc506e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:13.384106 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dcf88045-e81a-4808-a2dc-21bcaabc506e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:13.384544 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dcf88045-e81a-4808-a2dc-21bcaabc506e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:13.444832 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-dcf88045-e81a-4808-a2dc-21bcaabc506e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:13.452482 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-dcf88045-e81a-4808-a2dc-21bcaabc506e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080834 Feb 21 01:39:13.453038 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 988/1999] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:13 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:14.469442 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fb9ab6f1-185a-482d-b53c-988d6715cc06 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:14.470060 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fb9ab6f1-185a-482d-b53c-988d6715cc06 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:14.476957 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fb9ab6f1-185a-482d-b53c-988d6715cc06 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:14.477412 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fb9ab6f1-185a-482d-b53c-988d6715cc06 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:14.478196 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fb9ab6f1-185a-482d-b53c-988d6715cc06 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:14.478885 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fb9ab6f1-185a-482d-b53c-988d6715cc06 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:14.537528 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fb9ab6f1-185a-482d-b53c-988d6715cc06 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:14.545238 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-fb9ab6f1-185a-482d-b53c-988d6715cc06 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079583 Feb 21 01:39:14.545801 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1012/2000] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:14 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:15.562261 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5277344c-10ed-4930-9323-2d3a2f3a6e5a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:15.562878 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5277344c-10ed-4930-9323-2d3a2f3a6e5a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:15.570130 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5277344c-10ed-4930-9323-2d3a2f3a6e5a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:15.570581 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5277344c-10ed-4930-9323-2d3a2f3a6e5a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:15.571365 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5277344c-10ed-4930-9323-2d3a2f3a6e5a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:15.571805 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5277344c-10ed-4930-9323-2d3a2f3a6e5a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:15.631519 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5277344c-10ed-4930-9323-2d3a2f3a6e5a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:15.639130 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5277344c-10ed-4930-9323-2d3a2f3a6e5a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080637 Feb 21 01:39:15.639685 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 989/2001] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:15 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:16.655915 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c9003ca2-3392-4cdb-aa61-c9517c882604 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:16.656475 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c9003ca2-3392-4cdb-aa61-c9517c882604 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:16.663415 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c9003ca2-3392-4cdb-aa61-c9517c882604 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:16.663887 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c9003ca2-3392-4cdb-aa61-c9517c882604 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:16.664672 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c9003ca2-3392-4cdb-aa61-c9517c882604 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:16.665108 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c9003ca2-3392-4cdb-aa61-c9517c882604 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:16.725215 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c9003ca2-3392-4cdb-aa61-c9517c882604 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:16.733416 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c9003ca2-3392-4cdb-aa61-c9517c882604 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081285 Feb 21 01:39:16.739301 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1013/2002] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:16 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:17.750769 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-91574c1e-f5c4-47cd-be67-5f1a2fd00cb9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:17.751379 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-91574c1e-f5c4-47cd-be67-5f1a2fd00cb9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:17.758301 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-91574c1e-f5c4-47cd-be67-5f1a2fd00cb9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:17.758749 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-91574c1e-f5c4-47cd-be67-5f1a2fd00cb9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:17.759522 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-91574c1e-f5c4-47cd-be67-5f1a2fd00cb9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:17.759985 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-91574c1e-f5c4-47cd-be67-5f1a2fd00cb9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:17.821996 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-91574c1e-f5c4-47cd-be67-5f1a2fd00cb9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:17.829692 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-91574c1e-f5c4-47cd-be67-5f1a2fd00cb9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082609 Feb 21 01:39:17.830246 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 990/2003] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:17 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:18.846304 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4013b0f1-653f-4d80-b9c7-1ec78c2f4422 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:18.847329 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4013b0f1-653f-4d80-b9c7-1ec78c2f4422 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:18.853259 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4013b0f1-653f-4d80-b9c7-1ec78c2f4422 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:18.853964 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4013b0f1-653f-4d80-b9c7-1ec78c2f4422 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:18.854757 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4013b0f1-653f-4d80-b9c7-1ec78c2f4422 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:18.855177 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4013b0f1-653f-4d80-b9c7-1ec78c2f4422 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:18.916923 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4013b0f1-653f-4d80-b9c7-1ec78c2f4422 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:18.925139 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4013b0f1-653f-4d80-b9c7-1ec78c2f4422 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081928 Feb 21 01:39:18.925795 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1014/2004] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:18 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:19.941762 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5fff81bb-ec38-4760-8eef-276afe9ab549 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:19.942368 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5fff81bb-ec38-4760-8eef-276afe9ab549 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:19.948615 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5fff81bb-ec38-4760-8eef-276afe9ab549 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:19.949062 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5fff81bb-ec38-4760-8eef-276afe9ab549 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:19.949843 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5fff81bb-ec38-4760-8eef-276afe9ab549 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:19.950280 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5fff81bb-ec38-4760-8eef-276afe9ab549 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:20.247110 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5fff81bb-ec38-4760-8eef-276afe9ab549 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:20.256037 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5fff81bb-ec38-4760-8eef-276afe9ab549 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.317979 Feb 21 01:39:20.256930 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 991/2005] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:19 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:21.275326 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b484e272-4ab7-45cf-b760-ff72ed89aef3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:21.275982 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b484e272-4ab7-45cf-b760-ff72ed89aef3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:21.282138 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b484e272-4ab7-45cf-b760-ff72ed89aef3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:21.282582 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b484e272-4ab7-45cf-b760-ff72ed89aef3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:21.283355 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b484e272-4ab7-45cf-b760-ff72ed89aef3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:21.283787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b484e272-4ab7-45cf-b760-ff72ed89aef3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:21.347851 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b484e272-4ab7-45cf-b760-ff72ed89aef3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:21.355748 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b484e272-4ab7-45cf-b760-ff72ed89aef3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084082 Feb 21 01:39:21.356349 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1015/2006] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:21 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:39:22.372313 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-026d07df-7ad2-4d83-bf98-b77bad41b63d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:22.373220 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-026d07df-7ad2-4d83-bf98-b77bad41b63d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:22.379655 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-026d07df-7ad2-4d83-bf98-b77bad41b63d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:22.380148 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-026d07df-7ad2-4d83-bf98-b77bad41b63d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:22.380941 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-026d07df-7ad2-4d83-bf98-b77bad41b63d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:22.381377 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-026d07df-7ad2-4d83-bf98-b77bad41b63d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:22.441036 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-026d07df-7ad2-4d83-bf98-b77bad41b63d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:22.448705 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-026d07df-7ad2-4d83-bf98-b77bad41b63d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080089 Feb 21 01:39:22.449266 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 992/2007] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:22 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:23.464690 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9d6f6bb7-a79f-48dc-b227-ab344d6c3fac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:23.465291 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9d6f6bb7-a79f-48dc-b227-ab344d6c3fac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:23.471621 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d6f6bb7-a79f-48dc-b227-ab344d6c3fac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:23.472089 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d6f6bb7-a79f-48dc-b227-ab344d6c3fac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:23.472856 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d6f6bb7-a79f-48dc-b227-ab344d6c3fac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:23.473278 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d6f6bb7-a79f-48dc-b227-ab344d6c3fac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:23.531896 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9d6f6bb7-a79f-48dc-b227-ab344d6c3fac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:23.539404 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9d6f6bb7-a79f-48dc-b227-ab344d6c3fac tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078369 Feb 21 01:39:23.539980 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1016/2008] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:23 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:24.108999 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:39:24.109220 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:39:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:39:24.556198 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f5f9d868-001a-44be-bf25-bce3f2fdd96c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:24.556806 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f5f9d868-001a-44be-bf25-bce3f2fdd96c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:24.563093 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f5f9d868-001a-44be-bf25-bce3f2fdd96c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:24.563533 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f5f9d868-001a-44be-bf25-bce3f2fdd96c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:24.564358 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f5f9d868-001a-44be-bf25-bce3f2fdd96c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:24.564791 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f5f9d868-001a-44be-bf25-bce3f2fdd96c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:24.624740 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f5f9d868-001a-44be-bf25-bce3f2fdd96c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:24.632440 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f5f9d868-001a-44be-bf25-bce3f2fdd96c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079917 Feb 21 01:39:24.632993 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 993/2009] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:24 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:25.649303 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2567a8c2-6f40-4640-a530-dbc9162c63f3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:25.649863 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2567a8c2-6f40-4640-a530-dbc9162c63f3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:25.656052 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2567a8c2-6f40-4640-a530-dbc9162c63f3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:25.656525 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2567a8c2-6f40-4640-a530-dbc9162c63f3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:25.657311 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2567a8c2-6f40-4640-a530-dbc9162c63f3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:25.657728 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2567a8c2-6f40-4640-a530-dbc9162c63f3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:25.717455 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2567a8c2-6f40-4640-a530-dbc9162c63f3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:25.725930 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2567a8c2-6f40-4640-a530-dbc9162c63f3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080342 Feb 21 01:39:25.726485 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1017/2010] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:25 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:26.742465 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-539e1a5e-164e-4b65-928b-9f7dcf839e8b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:26.743077 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-539e1a5e-164e-4b65-928b-9f7dcf839e8b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:26.749305 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-539e1a5e-164e-4b65-928b-9f7dcf839e8b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:26.749751 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-539e1a5e-164e-4b65-928b-9f7dcf839e8b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:26.750582 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-539e1a5e-164e-4b65-928b-9f7dcf839e8b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:26.751011 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-539e1a5e-164e-4b65-928b-9f7dcf839e8b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:26.810922 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-539e1a5e-164e-4b65-928b-9f7dcf839e8b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:26.819339 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-539e1a5e-164e-4b65-928b-9f7dcf839e8b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080594 Feb 21 01:39:26.819910 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 994/2011] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:26 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:27.836079 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-bb217679-b33f-4fcd-8bad-dfa09a215161 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:27.836674 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-bb217679-b33f-4fcd-8bad-dfa09a215161 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:27.842904 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bb217679-b33f-4fcd-8bad-dfa09a215161 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:27.843353 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bb217679-b33f-4fcd-8bad-dfa09a215161 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:27.844154 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bb217679-b33f-4fcd-8bad-dfa09a215161 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:27.844593 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bb217679-b33f-4fcd-8bad-dfa09a215161 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:27.904723 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-bb217679-b33f-4fcd-8bad-dfa09a215161 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:27.913556 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-bb217679-b33f-4fcd-8bad-dfa09a215161 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081159 Feb 21 01:39:27.914113 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1018/2012] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:27 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:28.936151 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3e275b64-822a-44a6-ae1a-b39040a8c167 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:28.936768 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3e275b64-822a-44a6-ae1a-b39040a8c167 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:28.943106 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3e275b64-822a-44a6-ae1a-b39040a8c167 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:28.943555 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3e275b64-822a-44a6-ae1a-b39040a8c167 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:28.944391 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3e275b64-822a-44a6-ae1a-b39040a8c167 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:28.944828 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3e275b64-822a-44a6-ae1a-b39040a8c167 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:29.007424 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3e275b64-822a-44a6-ae1a-b39040a8c167 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:29.015138 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3e275b64-822a-44a6-ae1a-b39040a8c167 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082699 Feb 21 01:39:29.015694 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 995/2013] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:28 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:30.031697 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1a3f5869-4df8-4001-9370-b7ba739f3eae tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:30.032437 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1a3f5869-4df8-4001-9370-b7ba739f3eae tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:30.038570 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1a3f5869-4df8-4001-9370-b7ba739f3eae tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:30.039023 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1a3f5869-4df8-4001-9370-b7ba739f3eae tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:30.039809 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1a3f5869-4df8-4001-9370-b7ba739f3eae tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:30.040267 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1a3f5869-4df8-4001-9370-b7ba739f3eae tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:30.100088 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1a3f5869-4df8-4001-9370-b7ba739f3eae tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:30.107881 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1a3f5869-4df8-4001-9370-b7ba739f3eae tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079863 Feb 21 01:39:30.108431 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1019/2014] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:30 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:31.124803 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e9631423-7ae0-43fa-aee1-c0a715a52377 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:31.125408 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e9631423-7ae0-43fa-aee1-c0a715a52377 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:31.132267 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e9631423-7ae0-43fa-aee1-c0a715a52377 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:31.132709 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e9631423-7ae0-43fa-aee1-c0a715a52377 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:31.133478 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e9631423-7ae0-43fa-aee1-c0a715a52377 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:31.133904 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e9631423-7ae0-43fa-aee1-c0a715a52377 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:31.192275 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e9631423-7ae0-43fa-aee1-c0a715a52377 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:31.199776 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e9631423-7ae0-43fa-aee1-c0a715a52377 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078694 Feb 21 01:39:31.200355 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 996/2015] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:31 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:32.216544 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fb2db1e3-a50b-40ff-b4d7-3f42c5cb45c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:32.217166 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fb2db1e3-a50b-40ff-b4d7-3f42c5cb45c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:32.224509 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fb2db1e3-a50b-40ff-b4d7-3f42c5cb45c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:32.224968 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fb2db1e3-a50b-40ff-b4d7-3f42c5cb45c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:32.225753 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fb2db1e3-a50b-40ff-b4d7-3f42c5cb45c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:32.226191 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fb2db1e3-a50b-40ff-b4d7-3f42c5cb45c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:32.286881 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fb2db1e3-a50b-40ff-b4d7-3f42c5cb45c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:32.294661 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-fb2db1e3-a50b-40ff-b4d7-3f42c5cb45c5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081786 Feb 21 01:39:32.295221 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1020/2016] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:32 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:33.310850 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0084ca7d-dc98-4955-bee7-7c8cf1a9a584 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:33.311472 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0084ca7d-dc98-4955-bee7-7c8cf1a9a584 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:33.319012 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0084ca7d-dc98-4955-bee7-7c8cf1a9a584 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:33.319465 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0084ca7d-dc98-4955-bee7-7c8cf1a9a584 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:33.320291 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0084ca7d-dc98-4955-bee7-7c8cf1a9a584 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:33.320735 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0084ca7d-dc98-4955-bee7-7c8cf1a9a584 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:33.380598 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0084ca7d-dc98-4955-bee7-7c8cf1a9a584 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:33.388252 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0084ca7d-dc98-4955-bee7-7c8cf1a9a584 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081019 Feb 21 01:39:33.388808 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 997/2017] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:33 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:34.404619 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-452bc7ed-c761-47e1-8988-a896101f9f79 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:34.405232 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-452bc7ed-c761-47e1-8988-a896101f9f79 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:34.412881 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-452bc7ed-c761-47e1-8988-a896101f9f79 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:34.413337 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-452bc7ed-c761-47e1-8988-a896101f9f79 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:34.414243 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-452bc7ed-c761-47e1-8988-a896101f9f79 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:34.414678 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-452bc7ed-c761-47e1-8988-a896101f9f79 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:34.479743 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-452bc7ed-c761-47e1-8988-a896101f9f79 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:34.487658 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-452bc7ed-c761-47e1-8988-a896101f9f79 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.086726 Feb 21 01:39:34.488247 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1021/2018] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:34 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:35.504393 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d7e4e147-2d59-4f43-ad1e-79c2f18a5180 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:35.505002 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d7e4e147-2d59-4f43-ad1e-79c2f18a5180 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:35.510789 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d7e4e147-2d59-4f43-ad1e-79c2f18a5180 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:35.511237 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d7e4e147-2d59-4f43-ad1e-79c2f18a5180 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:35.512048 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d7e4e147-2d59-4f43-ad1e-79c2f18a5180 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:35.512481 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d7e4e147-2d59-4f43-ad1e-79c2f18a5180 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:35.571138 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d7e4e147-2d59-4f43-ad1e-79c2f18a5180 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:35.578820 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d7e4e147-2d59-4f43-ad1e-79c2f18a5180 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078443 Feb 21 01:39:35.579384 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 998/2019] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:35 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:36.595285 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-84de0ffc-be32-4471-a286-181798f78ffa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:36.596242 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-84de0ffc-be32-4471-a286-181798f78ffa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:36.602305 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84de0ffc-be32-4471-a286-181798f78ffa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:36.603048 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84de0ffc-be32-4471-a286-181798f78ffa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:36.603823 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84de0ffc-be32-4471-a286-181798f78ffa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:36.604304 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-84de0ffc-be32-4471-a286-181798f78ffa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:36.663057 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-84de0ffc-be32-4471-a286-181798f78ffa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:36.670674 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-84de0ffc-be32-4471-a286-181798f78ffa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079024 Feb 21 01:39:36.671233 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1022/2020] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:36 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:37.687732 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5b7624bf-6b0a-49a8-8ebe-b7b24979f59b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:37.688325 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5b7624bf-6b0a-49a8-8ebe-b7b24979f59b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:37.695024 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5b7624bf-6b0a-49a8-8ebe-b7b24979f59b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:37.695467 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5b7624bf-6b0a-49a8-8ebe-b7b24979f59b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:37.696260 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5b7624bf-6b0a-49a8-8ebe-b7b24979f59b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:37.696693 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5b7624bf-6b0a-49a8-8ebe-b7b24979f59b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:37.756250 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5b7624bf-6b0a-49a8-8ebe-b7b24979f59b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:37.764072 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5b7624bf-6b0a-49a8-8ebe-b7b24979f59b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080083 Feb 21 01:39:37.764636 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 999/2021] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:37 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:38.781115 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-92d950a7-32dd-4755-833e-3a762447b315 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:38.781716 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-92d950a7-32dd-4755-833e-3a762447b315 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:38.788407 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-92d950a7-32dd-4755-833e-3a762447b315 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:38.788852 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-92d950a7-32dd-4755-833e-3a762447b315 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:38.789616 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-92d950a7-32dd-4755-833e-3a762447b315 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:38.790039 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-92d950a7-32dd-4755-833e-3a762447b315 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:38.849672 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-92d950a7-32dd-4755-833e-3a762447b315 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:38.857604 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-92d950a7-32dd-4755-833e-3a762447b315 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080181 Feb 21 01:39:38.858161 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1023/2022] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:38 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:39.873344 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cc95a524-8612-44e1-9020-5a61c3ceb4bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:39.874002 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cc95a524-8612-44e1-9020-5a61c3ceb4bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:39.880890 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc95a524-8612-44e1-9020-5a61c3ceb4bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:39.881330 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc95a524-8612-44e1-9020-5a61c3ceb4bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:39.882104 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc95a524-8612-44e1-9020-5a61c3ceb4bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:39.882527 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc95a524-8612-44e1-9020-5a61c3ceb4bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:39.946381 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cc95a524-8612-44e1-9020-5a61c3ceb4bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:39.954020 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cc95a524-8612-44e1-9020-5a61c3ceb4bd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084429 Feb 21 01:39:39.954597 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1000/2023] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:39 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:40.970597 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2c92fa4f-ceab-4f1e-930a-1b1c21c71683 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:40.971355 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2c92fa4f-ceab-4f1e-930a-1b1c21c71683 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:40.977854 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2c92fa4f-ceab-4f1e-930a-1b1c21c71683 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:40.978300 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2c92fa4f-ceab-4f1e-930a-1b1c21c71683 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:40.979075 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2c92fa4f-ceab-4f1e-930a-1b1c21c71683 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:40.979502 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2c92fa4f-ceab-4f1e-930a-1b1c21c71683 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:41.038899 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2c92fa4f-ceab-4f1e-930a-1b1c21c71683 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:41.046492 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2c92fa4f-ceab-4f1e-930a-1b1c21c71683 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079614 Feb 21 01:39:41.047044 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1024/2024] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:40 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:42.063420 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d8a71e56-45f7-4ff9-a1d5-aa2b5a4ae55e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:42.064095 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d8a71e56-45f7-4ff9-a1d5-aa2b5a4ae55e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:42.070251 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d8a71e56-45f7-4ff9-a1d5-aa2b5a4ae55e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:42.070703 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d8a71e56-45f7-4ff9-a1d5-aa2b5a4ae55e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:42.071476 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d8a71e56-45f7-4ff9-a1d5-aa2b5a4ae55e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:42.071936 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d8a71e56-45f7-4ff9-a1d5-aa2b5a4ae55e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:42.131017 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d8a71e56-45f7-4ff9-a1d5-aa2b5a4ae55e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:42.139077 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d8a71e56-45f7-4ff9-a1d5-aa2b5a4ae55e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079304 Feb 21 01:39:42.139641 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1001/2025] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:42 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:43.156305 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fe2e772f-f2b9-4e8f-9885-d73264868b48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:43.156922 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fe2e772f-f2b9-4e8f-9885-d73264868b48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:43.164291 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fe2e772f-f2b9-4e8f-9885-d73264868b48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:43.164745 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fe2e772f-f2b9-4e8f-9885-d73264868b48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:43.165521 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fe2e772f-f2b9-4e8f-9885-d73264868b48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:43.165956 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fe2e772f-f2b9-4e8f-9885-d73264868b48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:43.226582 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fe2e772f-f2b9-4e8f-9885-d73264868b48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:43.234422 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-fe2e772f-f2b9-4e8f-9885-d73264868b48 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081774 Feb 21 01:39:43.234970 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1025/2026] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:43 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:44.252963 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-614ef95c-a0f8-4eda-bdde-f6b9fd76a110 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:44.253673 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-614ef95c-a0f8-4eda-bdde-f6b9fd76a110 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:44.259878 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-614ef95c-a0f8-4eda-bdde-f6b9fd76a110 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:44.260333 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-614ef95c-a0f8-4eda-bdde-f6b9fd76a110 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:44.261121 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-614ef95c-a0f8-4eda-bdde-f6b9fd76a110 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:44.261557 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-614ef95c-a0f8-4eda-bdde-f6b9fd76a110 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:44.323791 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-614ef95c-a0f8-4eda-bdde-f6b9fd76a110 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:44.331733 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-614ef95c-a0f8-4eda-bdde-f6b9fd76a110 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083529 Feb 21 01:39:44.332286 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1002/2027] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:44 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:45.349560 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1baa8ab5-545d-4d80-ac8c-6763c7e6bcf5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:45.350163 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1baa8ab5-545d-4d80-ac8c-6763c7e6bcf5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:45.356621 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1baa8ab5-545d-4d80-ac8c-6763c7e6bcf5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:45.357068 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1baa8ab5-545d-4d80-ac8c-6763c7e6bcf5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:45.357861 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1baa8ab5-545d-4d80-ac8c-6763c7e6bcf5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:45.358296 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1baa8ab5-545d-4d80-ac8c-6763c7e6bcf5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:45.417302 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1baa8ab5-545d-4d80-ac8c-6763c7e6bcf5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:45.425208 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1baa8ab5-545d-4d80-ac8c-6763c7e6bcf5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080806 Feb 21 01:39:45.425785 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1026/2028] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:45 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:46.441791 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f76c0d54-e512-4c88-bb37-265cd7f4fc78 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:46.442393 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f76c0d54-e512-4c88-bb37-265cd7f4fc78 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:46.448614 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f76c0d54-e512-4c88-bb37-265cd7f4fc78 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:46.449056 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f76c0d54-e512-4c88-bb37-265cd7f4fc78 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:46.449821 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f76c0d54-e512-4c88-bb37-265cd7f4fc78 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:46.450243 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f76c0d54-e512-4c88-bb37-265cd7f4fc78 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:46.508756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f76c0d54-e512-4c88-bb37-265cd7f4fc78 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:46.516379 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f76c0d54-e512-4c88-bb37-265cd7f4fc78 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078398 Feb 21 01:39:46.517470 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1003/2029] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:46 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:47.533620 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-0a951ddd-73d2-474a-9c3b-63939065d456 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:47.534214 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-0a951ddd-73d2-474a-9c3b-63939065d456 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:47.540889 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a951ddd-73d2-474a-9c3b-63939065d456 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:47.541327 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a951ddd-73d2-474a-9c3b-63939065d456 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:47.542092 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a951ddd-73d2-474a-9c3b-63939065d456 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:47.542519 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-0a951ddd-73d2-474a-9c3b-63939065d456 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:47.863145 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-0a951ddd-73d2-474a-9c3b-63939065d456 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:47.871486 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-0a951ddd-73d2-474a-9c3b-63939065d456 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.341972 Feb 21 01:39:47.872088 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1027/2030] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:47 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:48.888269 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-90211382-cda1-4ef3-8e31-a3117d0d9421 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:48.888858 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-90211382-cda1-4ef3-8e31-a3117d0d9421 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:48.895154 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-90211382-cda1-4ef3-8e31-a3117d0d9421 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:48.895600 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-90211382-cda1-4ef3-8e31-a3117d0d9421 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:48.896413 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-90211382-cda1-4ef3-8e31-a3117d0d9421 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:48.896840 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-90211382-cda1-4ef3-8e31-a3117d0d9421 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:48.958470 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-90211382-cda1-4ef3-8e31-a3117d0d9421 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:48.966083 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-90211382-cda1-4ef3-8e31-a3117d0d9421 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081551 Feb 21 01:39:48.966639 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1004/2031] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:48 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:49.982591 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4976899d-49b8-4381-b8e7-68bf9535cbfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:49.983227 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4976899d-49b8-4381-b8e7-68bf9535cbfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:49.990305 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4976899d-49b8-4381-b8e7-68bf9535cbfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:49.990790 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4976899d-49b8-4381-b8e7-68bf9535cbfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:49.991576 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4976899d-49b8-4381-b8e7-68bf9535cbfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:49.992052 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4976899d-49b8-4381-b8e7-68bf9535cbfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:50.052736 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4976899d-49b8-4381-b8e7-68bf9535cbfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:50.061300 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4976899d-49b8-4381-b8e7-68bf9535cbfe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082494 Feb 21 01:39:50.062338 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1028/2032] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:49 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:51.077913 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3a8e2113-64e2-4af8-b54a-f96bb6f192ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:51.078520 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3a8e2113-64e2-4af8-b54a-f96bb6f192ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:51.085428 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3a8e2113-64e2-4af8-b54a-f96bb6f192ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:51.085879 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3a8e2113-64e2-4af8-b54a-f96bb6f192ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:51.086669 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3a8e2113-64e2-4af8-b54a-f96bb6f192ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:51.087109 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3a8e2113-64e2-4af8-b54a-f96bb6f192ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:51.147234 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3a8e2113-64e2-4af8-b54a-f96bb6f192ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:51.154831 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3a8e2113-64e2-4af8-b54a-f96bb6f192ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080622 Feb 21 01:39:51.155386 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1005/2033] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:51 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:52.170774 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e68a8567-c316-441c-870c-d7b4dee2acf9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:52.171378 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e68a8567-c316-441c-870c-d7b4dee2acf9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:52.177638 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e68a8567-c316-441c-870c-d7b4dee2acf9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:52.178080 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e68a8567-c316-441c-870c-d7b4dee2acf9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:52.178843 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e68a8567-c316-441c-870c-d7b4dee2acf9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:52.179268 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e68a8567-c316-441c-870c-d7b4dee2acf9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:52.238497 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e68a8567-c316-441c-870c-d7b4dee2acf9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:52.246179 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e68a8567-c316-441c-870c-d7b4dee2acf9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079048 Feb 21 01:39:52.246730 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1029/2034] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:52 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:53.263900 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cfa14630-8541-4df3-b61b-08659c042baf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:53.264500 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cfa14630-8541-4df3-b61b-08659c042baf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:53.271204 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cfa14630-8541-4df3-b61b-08659c042baf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:53.271733 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cfa14630-8541-4df3-b61b-08659c042baf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:53.272531 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cfa14630-8541-4df3-b61b-08659c042baf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:53.272958 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cfa14630-8541-4df3-b61b-08659c042baf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:53.336335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cfa14630-8541-4df3-b61b-08659c042baf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:53.350798 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cfa14630-8541-4df3-b61b-08659c042baf tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.090531 Feb 21 01:39:53.351381 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1006/2035] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:53 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:54.367234 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-867ebbf1-79bd-4609-b88b-e743755e1340 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:54.367859 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-867ebbf1-79bd-4609-b88b-e743755e1340 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:54.373972 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-867ebbf1-79bd-4609-b88b-e743755e1340 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:54.374414 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-867ebbf1-79bd-4609-b88b-e743755e1340 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:54.375176 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-867ebbf1-79bd-4609-b88b-e743755e1340 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:54.375599 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-867ebbf1-79bd-4609-b88b-e743755e1340 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:54.433608 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-867ebbf1-79bd-4609-b88b-e743755e1340 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:54.441587 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-867ebbf1-79bd-4609-b88b-e743755e1340 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.077965 Feb 21 01:39:54.442134 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1030/2036] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:54 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:55.457729 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e9b50cb7-86b3-49f6-a58d-9bbc1b0075d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:55.458320 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e9b50cb7-86b3-49f6-a58d-9bbc1b0075d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:55.464607 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e9b50cb7-86b3-49f6-a58d-9bbc1b0075d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:55.465058 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e9b50cb7-86b3-49f6-a58d-9bbc1b0075d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:55.465836 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e9b50cb7-86b3-49f6-a58d-9bbc1b0075d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:55.466275 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e9b50cb7-86b3-49f6-a58d-9bbc1b0075d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:55.524946 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e9b50cb7-86b3-49f6-a58d-9bbc1b0075d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:55.532753 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e9b50cb7-86b3-49f6-a58d-9bbc1b0075d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078570 Feb 21 01:39:55.533481 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1007/2037] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:55 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:56.549372 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-cbe87aee-b801-4ff8-9788-2b1b62ec7585 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:56.549985 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-cbe87aee-b801-4ff8-9788-2b1b62ec7585 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:56.556246 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cbe87aee-b801-4ff8-9788-2b1b62ec7585 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:56.556695 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cbe87aee-b801-4ff8-9788-2b1b62ec7585 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:56.557475 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cbe87aee-b801-4ff8-9788-2b1b62ec7585 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:56.557914 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cbe87aee-b801-4ff8-9788-2b1b62ec7585 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:56.619182 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-cbe87aee-b801-4ff8-9788-2b1b62ec7585 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:56.627693 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-cbe87aee-b801-4ff8-9788-2b1b62ec7585 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082057 Feb 21 01:39:56.628277 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1031/2038] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:56 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:57.644724 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-90b30e55-e669-444e-ad4f-b6eb635eeeda tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:57.645297 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-90b30e55-e669-444e-ad4f-b6eb635eeeda tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:57.651494 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-90b30e55-e669-444e-ad4f-b6eb635eeeda tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:57.651987 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-90b30e55-e669-444e-ad4f-b6eb635eeeda tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:57.652792 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-90b30e55-e669-444e-ad4f-b6eb635eeeda tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:57.653232 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-90b30e55-e669-444e-ad4f-b6eb635eeeda tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:57.713106 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-90b30e55-e669-444e-ad4f-b6eb635eeeda tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:57.721472 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-90b30e55-e669-444e-ad4f-b6eb635eeeda tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081084 Feb 21 01:39:57.722049 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1008/2039] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:57 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:58.739243 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-beec637e-c468-4440-8996-8c43ab17495e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:58.740057 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-beec637e-c468-4440-8996-8c43ab17495e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:58.746392 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-beec637e-c468-4440-8996-8c43ab17495e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:58.746846 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-beec637e-c468-4440-8996-8c43ab17495e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:58.747631 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-beec637e-c468-4440-8996-8c43ab17495e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:58.748094 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-beec637e-c468-4440-8996-8c43ab17495e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:58.807584 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-beec637e-c468-4440-8996-8c43ab17495e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:58.815662 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-beec637e-c468-4440-8996-8c43ab17495e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081432 Feb 21 01:39:58.816304 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1032/2040] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:58 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:59.833227 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9c5588b0-300f-4f5c-a597-9f720fc8dfdb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:59.834081 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9c5588b0-300f-4f5c-a597-9f720fc8dfdb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:59.842406 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9c5588b0-300f-4f5c-a597-9f720fc8dfdb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:59.842860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9c5588b0-300f-4f5c-a597-9f720fc8dfdb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:59.843675 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9c5588b0-300f-4f5c-a597-9f720fc8dfdb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:59.844154 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9c5588b0-300f-4f5c-a597-9f720fc8dfdb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:59.904231 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9c5588b0-300f-4f5c-a597-9f720fc8dfdb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:59.912502 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9c5588b0-300f-4f5c-a597-9f720fc8dfdb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083696 Feb 21 01:39:59.913067 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1009/2041] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:59 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:00.929558 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ab13aa51-9604-41cd-bb39-18d10d65dc1d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:00.930182 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ab13aa51-9604-41cd-bb39-18d10d65dc1d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:00.936449 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ab13aa51-9604-41cd-bb39-18d10d65dc1d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:00.936897 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ab13aa51-9604-41cd-bb39-18d10d65dc1d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:00.937677 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ab13aa51-9604-41cd-bb39-18d10d65dc1d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:00.938109 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ab13aa51-9604-41cd-bb39-18d10d65dc1d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:00.997955 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ab13aa51-9604-41cd-bb39-18d10d65dc1d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:01.005714 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ab13aa51-9604-41cd-bb39-18d10d65dc1d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079844 Feb 21 01:40:01.006268 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1033/2042] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:00 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:02.022669 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-48d793ee-37c1-4124-a6db-52ca3d8738fb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:02.023321 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-48d793ee-37c1-4124-a6db-52ca3d8738fb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:02.029506 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-48d793ee-37c1-4124-a6db-52ca3d8738fb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:02.029947 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-48d793ee-37c1-4124-a6db-52ca3d8738fb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:02.030716 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-48d793ee-37c1-4124-a6db-52ca3d8738fb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:02.031141 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-48d793ee-37c1-4124-a6db-52ca3d8738fb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:02.100682 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-48d793ee-37c1-4124-a6db-52ca3d8738fb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:02.101461 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-48d793ee-37c1-4124-a6db-52ca3d8738fb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082489 Feb 21 01:40:02.102266 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1010/2043] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:02 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:03.195920 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7cc8b00a-0394-442f-8884-50486dbc7f07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:03.196534 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7cc8b00a-0394-442f-8884-50486dbc7f07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:03.202314 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7cc8b00a-0394-442f-8884-50486dbc7f07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:03.202760 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7cc8b00a-0394-442f-8884-50486dbc7f07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:03.203533 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7cc8b00a-0394-442f-8884-50486dbc7f07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:03.204000 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7cc8b00a-0394-442f-8884-50486dbc7f07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:03.266523 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7cc8b00a-0394-442f-8884-50486dbc7f07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:03.275140 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7cc8b00a-0394-442f-8884-50486dbc7f07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.160922 Feb 21 01:40:03.275696 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1034/2044] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:03 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:04.291606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-870b285d-fef6-4e06-9349-90cc4b8c6380 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:04.292264 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-870b285d-fef6-4e06-9349-90cc4b8c6380 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:04.298229 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-870b285d-fef6-4e06-9349-90cc4b8c6380 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:04.298689 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-870b285d-fef6-4e06-9349-90cc4b8c6380 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:04.299713 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-870b285d-fef6-4e06-9349-90cc4b8c6380 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:04.300191 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-870b285d-fef6-4e06-9349-90cc4b8c6380 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:04.360134 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-870b285d-fef6-4e06-9349-90cc4b8c6380 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:04.367993 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-870b285d-fef6-4e06-9349-90cc4b8c6380 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080078 Feb 21 01:40:04.368553 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1011/2045] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:04 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:05.384718 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c8ad230a-5d17-4752-b110-0af8714cc042 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:05.385331 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c8ad230a-5d17-4752-b110-0af8714cc042 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:05.391269 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c8ad230a-5d17-4752-b110-0af8714cc042 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:05.391720 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c8ad230a-5d17-4752-b110-0af8714cc042 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:05.392614 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c8ad230a-5d17-4752-b110-0af8714cc042 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:05.393212 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c8ad230a-5d17-4752-b110-0af8714cc042 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:05.604588 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c8ad230a-5d17-4752-b110-0af8714cc042 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:05.613070 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c8ad230a-5d17-4752-b110-0af8714cc042 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.232149 Feb 21 01:40:05.613570 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1035/2046] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:05 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:06.630115 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1a0ffe32-3481-433a-9cc1-f9bc894f1a7e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:06.630656 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1a0ffe32-3481-433a-9cc1-f9bc894f1a7e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:06.636944 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1a0ffe32-3481-433a-9cc1-f9bc894f1a7e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:06.637393 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1a0ffe32-3481-433a-9cc1-f9bc894f1a7e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:06.638176 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1a0ffe32-3481-433a-9cc1-f9bc894f1a7e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:06.638609 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1a0ffe32-3481-433a-9cc1-f9bc894f1a7e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:06.741579 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1a0ffe32-3481-433a-9cc1-f9bc894f1a7e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:06.749369 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1a0ffe32-3481-433a-9cc1-f9bc894f1a7e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.123744 Feb 21 01:40:06.749933 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1012/2047] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:06 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:07.765761 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-53a11669-625f-4a3e-9329-8eafa086956a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:07.766367 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-53a11669-625f-4a3e-9329-8eafa086956a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:07.772581 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-53a11669-625f-4a3e-9329-8eafa086956a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:07.773027 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-53a11669-625f-4a3e-9329-8eafa086956a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:07.773791 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-53a11669-625f-4a3e-9329-8eafa086956a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:07.774213 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-53a11669-625f-4a3e-9329-8eafa086956a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:07.834965 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-53a11669-625f-4a3e-9329-8eafa086956a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:07.842515 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-53a11669-625f-4a3e-9329-8eafa086956a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080355 Feb 21 01:40:07.843052 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1036/2048] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:07 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:08.859859 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4af0c81b-cc31-4c8c-ada6-11a12fc027ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:08.860457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4af0c81b-cc31-4c8c-ada6-11a12fc027ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:08.867133 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4af0c81b-cc31-4c8c-ada6-11a12fc027ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:08.867570 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4af0c81b-cc31-4c8c-ada6-11a12fc027ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:08.868363 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4af0c81b-cc31-4c8c-ada6-11a12fc027ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:08.868791 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4af0c81b-cc31-4c8c-ada6-11a12fc027ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:08.929710 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4af0c81b-cc31-4c8c-ada6-11a12fc027ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:08.937590 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4af0c81b-cc31-4c8c-ada6-11a12fc027ee tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081393 Feb 21 01:40:08.938158 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1013/2049] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:08 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:09.954272 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-150c3945-a159-427f-8c1b-06df2132c853 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:09.955584 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-150c3945-a159-427f-8c1b-06df2132c853 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:09.961781 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-150c3945-a159-427f-8c1b-06df2132c853 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:09.962231 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-150c3945-a159-427f-8c1b-06df2132c853 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:09.963008 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-150c3945-a159-427f-8c1b-06df2132c853 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:09.963441 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-150c3945-a159-427f-8c1b-06df2132c853 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:10.065448 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-150c3945-a159-427f-8c1b-06df2132c853 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:10.073189 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-150c3945-a159-427f-8c1b-06df2132c853 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.122576 Feb 21 01:40:10.073726 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1037/2050] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:09 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:11.090586 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-385f2a28-9d57-44bd-9c60-1590ca5c4b35 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:11.091200 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-385f2a28-9d57-44bd-9c60-1590ca5c4b35 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:11.097747 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-385f2a28-9d57-44bd-9c60-1590ca5c4b35 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:11.098213 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-385f2a28-9d57-44bd-9c60-1590ca5c4b35 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:11.098998 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-385f2a28-9d57-44bd-9c60-1590ca5c4b35 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:11.099439 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-385f2a28-9d57-44bd-9c60-1590ca5c4b35 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:11.159155 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-385f2a28-9d57-44bd-9c60-1590ca5c4b35 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:11.166809 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-385f2a28-9d57-44bd-9c60-1590ca5c4b35 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079879 Feb 21 01:40:11.167377 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1014/2051] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:11 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:12.184052 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-bc86452f-e10b-4477-9798-39967fcab8fa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:12.184658 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-bc86452f-e10b-4477-9798-39967fcab8fa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:12.191360 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bc86452f-e10b-4477-9798-39967fcab8fa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:12.191802 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bc86452f-e10b-4477-9798-39967fcab8fa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:12.192599 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bc86452f-e10b-4477-9798-39967fcab8fa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:12.193023 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bc86452f-e10b-4477-9798-39967fcab8fa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:12.251116 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-bc86452f-e10b-4477-9798-39967fcab8fa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:12.259228 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-bc86452f-e10b-4477-9798-39967fcab8fa tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078802 Feb 21 01:40:12.259765 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1038/2052] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:12 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:13.276415 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fd39da34-af9b-44e8-a61a-a2b6f41eff8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:13.277025 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fd39da34-af9b-44e8-a61a-a2b6f41eff8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:13.283500 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fd39da34-af9b-44e8-a61a-a2b6f41eff8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:13.284404 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fd39da34-af9b-44e8-a61a-a2b6f41eff8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:13.285207 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fd39da34-af9b-44e8-a61a-a2b6f41eff8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:13.285645 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fd39da34-af9b-44e8-a61a-a2b6f41eff8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:13.348154 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fd39da34-af9b-44e8-a61a-a2b6f41eff8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:13.356237 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fd39da34-af9b-44e8-a61a-a2b6f41eff8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083454 Feb 21 01:40:13.356810 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1015/2053] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:13 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:14.372498 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-06d3e8ee-7115-4a71-83f3-c809eb0ce147 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:14.373116 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-06d3e8ee-7115-4a71-83f3-c809eb0ce147 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:14.379633 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-06d3e8ee-7115-4a71-83f3-c809eb0ce147 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:14.380131 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-06d3e8ee-7115-4a71-83f3-c809eb0ce147 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:14.380916 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-06d3e8ee-7115-4a71-83f3-c809eb0ce147 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:14.381359 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-06d3e8ee-7115-4a71-83f3-c809eb0ce147 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:14.440689 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-06d3e8ee-7115-4a71-83f3-c809eb0ce147 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:14.448361 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-06d3e8ee-7115-4a71-83f3-c809eb0ce147 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079493 Feb 21 01:40:14.448913 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1039/2054] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:14 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:15.470209 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1da91bc1-54ed-4d6d-9ead-712979b9c430 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:15.470821 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1da91bc1-54ed-4d6d-9ead-712979b9c430 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:15.477485 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1da91bc1-54ed-4d6d-9ead-712979b9c430 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:15.477935 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1da91bc1-54ed-4d6d-9ead-712979b9c430 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:15.478715 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1da91bc1-54ed-4d6d-9ead-712979b9c430 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:15.479153 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1da91bc1-54ed-4d6d-9ead-712979b9c430 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:15.538676 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1da91bc1-54ed-4d6d-9ead-712979b9c430 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:15.546402 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1da91bc1-54ed-4d6d-9ead-712979b9c430 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079878 Feb 21 01:40:15.546965 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1016/2055] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:15 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:16.563283 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3dbb5aa1-c156-44ac-8b94-aafe6a84557a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:16.563946 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3dbb5aa1-c156-44ac-8b94-aafe6a84557a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:16.570416 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3dbb5aa1-c156-44ac-8b94-aafe6a84557a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:16.570866 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3dbb5aa1-c156-44ac-8b94-aafe6a84557a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:16.571640 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3dbb5aa1-c156-44ac-8b94-aafe6a84557a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:16.572110 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3dbb5aa1-c156-44ac-8b94-aafe6a84557a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:16.634185 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3dbb5aa1-c156-44ac-8b94-aafe6a84557a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:16.641909 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3dbb5aa1-c156-44ac-8b94-aafe6a84557a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082251 Feb 21 01:40:16.642456 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1040/2056] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:16 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:17.659202 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d00a8a7a-fd5f-4801-8204-3e4121e3416b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:17.659783 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d00a8a7a-fd5f-4801-8204-3e4121e3416b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:17.665981 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d00a8a7a-fd5f-4801-8204-3e4121e3416b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:17.666424 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d00a8a7a-fd5f-4801-8204-3e4121e3416b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:17.667198 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d00a8a7a-fd5f-4801-8204-3e4121e3416b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:17.667659 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d00a8a7a-fd5f-4801-8204-3e4121e3416b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:17.728099 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d00a8a7a-fd5f-4801-8204-3e4121e3416b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:17.735700 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d00a8a7a-fd5f-4801-8204-3e4121e3416b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080520 Feb 21 01:40:17.736289 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1017/2057] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:17 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:40:18.754524 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b9adc530-188c-4025-9c06-10c44dea8e7f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:18.755143 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b9adc530-188c-4025-9c06-10c44dea8e7f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:18.761469 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b9adc530-188c-4025-9c06-10c44dea8e7f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:18.761919 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b9adc530-188c-4025-9c06-10c44dea8e7f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:18.762704 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b9adc530-188c-4025-9c06-10c44dea8e7f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:18.763138 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b9adc530-188c-4025-9c06-10c44dea8e7f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:18.822759 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b9adc530-188c-4025-9c06-10c44dea8e7f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:18.830407 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b9adc530-188c-4025-9c06-10c44dea8e7f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080621 Feb 21 01:40:18.830955 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1041/2058] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:18 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:19.846254 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e65cde9d-093a-4150-bf3c-04e85c00c188 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:19.846865 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e65cde9d-093a-4150-bf3c-04e85c00c188 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:19.853318 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e65cde9d-093a-4150-bf3c-04e85c00c188 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:19.853762 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e65cde9d-093a-4150-bf3c-04e85c00c188 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:19.854533 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e65cde9d-093a-4150-bf3c-04e85c00c188 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:19.854960 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e65cde9d-093a-4150-bf3c-04e85c00c188 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:19.914172 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e65cde9d-093a-4150-bf3c-04e85c00c188 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:19.921872 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e65cde9d-093a-4150-bf3c-04e85c00c188 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079361 Feb 21 01:40:19.922435 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1018/2059] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:19 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:20.938103 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ba64f332-5923-46a5-8dbe-33841006733d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:20.938727 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ba64f332-5923-46a5-8dbe-33841006733d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:20.945052 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ba64f332-5923-46a5-8dbe-33841006733d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:20.945498 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ba64f332-5923-46a5-8dbe-33841006733d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:20.946266 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ba64f332-5923-46a5-8dbe-33841006733d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:20.946696 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ba64f332-5923-46a5-8dbe-33841006733d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:21.005407 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ba64f332-5923-46a5-8dbe-33841006733d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:21.013395 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ba64f332-5923-46a5-8dbe-33841006733d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078923 Feb 21 01:40:21.013953 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1042/2060] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:20 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:22.030139 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c9580411-2bdd-44f5-af0b-4372dcce42e7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:22.030733 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c9580411-2bdd-44f5-af0b-4372dcce42e7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:22.037488 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c9580411-2bdd-44f5-af0b-4372dcce42e7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:22.037938 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c9580411-2bdd-44f5-af0b-4372dcce42e7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:22.038723 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c9580411-2bdd-44f5-af0b-4372dcce42e7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:22.039160 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c9580411-2bdd-44f5-af0b-4372dcce42e7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:22.097573 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c9580411-2bdd-44f5-af0b-4372dcce42e7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:22.105643 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c9580411-2bdd-44f5-af0b-4372dcce42e7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079236 Feb 21 01:40:22.106216 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1019/2061] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:22 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:23.123491 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2219cbf8-5b11-4f95-b017-21bbae66fc07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:23.124292 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2219cbf8-5b11-4f95-b017-21bbae66fc07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:23.131150 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2219cbf8-5b11-4f95-b017-21bbae66fc07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:23.131599 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2219cbf8-5b11-4f95-b017-21bbae66fc07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:23.132420 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2219cbf8-5b11-4f95-b017-21bbae66fc07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:23.132858 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2219cbf8-5b11-4f95-b017-21bbae66fc07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:23.192224 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2219cbf8-5b11-4f95-b017-21bbae66fc07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:23.199781 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2219cbf8-5b11-4f95-b017-21bbae66fc07 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079933 Feb 21 01:40:23.200984 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1043/2062] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:23 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:24.216538 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-66e1a0e3-3800-4789-b744-e6d30421b594 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:24.217148 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-66e1a0e3-3800-4789-b744-e6d30421b594 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:24.223545 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-66e1a0e3-3800-4789-b744-e6d30421b594 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:24.224094 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-66e1a0e3-3800-4789-b744-e6d30421b594 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:24.224875 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-66e1a0e3-3800-4789-b744-e6d30421b594 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:24.225306 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-66e1a0e3-3800-4789-b744-e6d30421b594 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:24.288664 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-66e1a0e3-3800-4789-b744-e6d30421b594 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:24.296231 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-66e1a0e3-3800-4789-b744-e6d30421b594 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083304 Feb 21 01:40:24.296791 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1020/2063] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:24 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:25.311595 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4f0a5726-508c-48f6-b40d-91468677724e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:25.312248 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4f0a5726-508c-48f6-b40d-91468677724e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:25.319063 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f0a5726-508c-48f6-b40d-91468677724e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:25.319511 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f0a5726-508c-48f6-b40d-91468677724e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:25.320311 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f0a5726-508c-48f6-b40d-91468677724e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:25.320747 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4f0a5726-508c-48f6-b40d-91468677724e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:25.382335 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4f0a5726-508c-48f6-b40d-91468677724e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:25.390069 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4f0a5726-508c-48f6-b40d-91468677724e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082168 Feb 21 01:40:25.390616 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1044/2064] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:25 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:26.407323 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e5260f6b-b86d-4cb8-9ec0-0f161719e7d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:26.407954 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e5260f6b-b86d-4cb8-9ec0-0f161719e7d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:26.414322 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e5260f6b-b86d-4cb8-9ec0-0f161719e7d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:26.414759 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e5260f6b-b86d-4cb8-9ec0-0f161719e7d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:26.415526 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e5260f6b-b86d-4cb8-9ec0-0f161719e7d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:26.416016 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e5260f6b-b86d-4cb8-9ec0-0f161719e7d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:26.475296 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e5260f6b-b86d-4cb8-9ec0-0f161719e7d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:26.483201 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e5260f6b-b86d-4cb8-9ec0-0f161719e7d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079759 Feb 21 01:40:26.483756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1021/2065] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:26 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:27.499118 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fdb5f7f3-db93-4081-a6a7-8829b3583b0b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:27.499729 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fdb5f7f3-db93-4081-a6a7-8829b3583b0b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:27.506014 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fdb5f7f3-db93-4081-a6a7-8829b3583b0b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:27.506470 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fdb5f7f3-db93-4081-a6a7-8829b3583b0b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:27.507245 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fdb5f7f3-db93-4081-a6a7-8829b3583b0b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:27.507679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fdb5f7f3-db93-4081-a6a7-8829b3583b0b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:27.566144 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fdb5f7f3-db93-4081-a6a7-8829b3583b0b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:27.573717 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-fdb5f7f3-db93-4081-a6a7-8829b3583b0b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078308 Feb 21 01:40:27.574271 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1045/2066] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:27 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:28.590248 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f84abd7e-4709-4279-9d70-d833e7c29404 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:28.590858 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f84abd7e-4709-4279-9d70-d833e7c29404 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:28.597628 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f84abd7e-4709-4279-9d70-d833e7c29404 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:28.598075 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f84abd7e-4709-4279-9d70-d833e7c29404 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:28.598906 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f84abd7e-4709-4279-9d70-d833e7c29404 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:28.599443 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f84abd7e-4709-4279-9d70-d833e7c29404 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:28.657934 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f84abd7e-4709-4279-9d70-d833e7c29404 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:28.666004 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f84abd7e-4709-4279-9d70-d833e7c29404 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079483 Feb 21 01:40:28.666588 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1022/2067] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:28 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:29.683152 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c5f8f406-701d-4e94-8a01-bbd764f35ce8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:29.683705 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c5f8f406-701d-4e94-8a01-bbd764f35ce8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:29.690095 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c5f8f406-701d-4e94-8a01-bbd764f35ce8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:29.690548 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c5f8f406-701d-4e94-8a01-bbd764f35ce8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:29.691319 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c5f8f406-701d-4e94-8a01-bbd764f35ce8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:29.691751 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c5f8f406-701d-4e94-8a01-bbd764f35ce8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:29.751687 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c5f8f406-701d-4e94-8a01-bbd764f35ce8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:29.759332 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c5f8f406-701d-4e94-8a01-bbd764f35ce8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079900 Feb 21 01:40:29.759903 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1046/2068] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:29 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:30.777224 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0cb15014-f562-4783-b8a1-483dfbe8d156 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:30.777980 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0cb15014-f562-4783-b8a1-483dfbe8d156 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:30.786155 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0cb15014-f562-4783-b8a1-483dfbe8d156 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:30.786647 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0cb15014-f562-4783-b8a1-483dfbe8d156 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:30.787815 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0cb15014-f562-4783-b8a1-483dfbe8d156 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:30.788274 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0cb15014-f562-4783-b8a1-483dfbe8d156 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:30.850004 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0cb15014-f562-4783-b8a1-483dfbe8d156 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:30.858007 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0cb15014-f562-4783-b8a1-483dfbe8d156 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.085263 Feb 21 01:40:30.858563 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1023/2069] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:30 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:31.874679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7abfb396-bc28-46ff-b72c-e826c31997f3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:31.875296 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7abfb396-bc28-46ff-b72c-e826c31997f3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:31.882227 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7abfb396-bc28-46ff-b72c-e826c31997f3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:31.882682 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7abfb396-bc28-46ff-b72c-e826c31997f3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:31.883463 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7abfb396-bc28-46ff-b72c-e826c31997f3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:31.883926 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7abfb396-bc28-46ff-b72c-e826c31997f3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:31.945898 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7abfb396-bc28-46ff-b72c-e826c31997f3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:31.953632 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7abfb396-bc28-46ff-b72c-e826c31997f3 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082660 Feb 21 01:40:31.954185 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1047/2070] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:31 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:32.970349 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a5856b7d-2699-4521-a04d-5a19ce678c13 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:32.970995 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a5856b7d-2699-4521-a04d-5a19ce678c13 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:32.977802 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a5856b7d-2699-4521-a04d-5a19ce678c13 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:32.978252 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a5856b7d-2699-4521-a04d-5a19ce678c13 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:32.979034 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a5856b7d-2699-4521-a04d-5a19ce678c13 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:32.979470 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a5856b7d-2699-4521-a04d-5a19ce678c13 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:33.041857 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a5856b7d-2699-4521-a04d-5a19ce678c13 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:33.050000 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a5856b7d-2699-4521-a04d-5a19ce678c13 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083417 Feb 21 01:40:33.050546 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1024/2071] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:32 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:34.066370 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-20307b2d-3f60-4d3a-9b32-223b7f851542 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:34.066962 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-20307b2d-3f60-4d3a-9b32-223b7f851542 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:34.073195 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-20307b2d-3f60-4d3a-9b32-223b7f851542 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:34.073647 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-20307b2d-3f60-4d3a-9b32-223b7f851542 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:34.074423 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-20307b2d-3f60-4d3a-9b32-223b7f851542 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:34.074858 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-20307b2d-3f60-4d3a-9b32-223b7f851542 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:34.136051 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-20307b2d-3f60-4d3a-9b32-223b7f851542 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:34.143789 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-20307b2d-3f60-4d3a-9b32-223b7f851542 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081186 Feb 21 01:40:34.144444 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1048/2072] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:34 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:35.160342 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e124c47e-9810-4f57-9e77-9645145de6b5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:35.161004 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e124c47e-9810-4f57-9e77-9645145de6b5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:35.166941 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e124c47e-9810-4f57-9e77-9645145de6b5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:35.167387 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e124c47e-9810-4f57-9e77-9645145de6b5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:35.168195 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e124c47e-9810-4f57-9e77-9645145de6b5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:35.168635 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e124c47e-9810-4f57-9e77-9645145de6b5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:35.227511 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e124c47e-9810-4f57-9e77-9645145de6b5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:35.235191 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e124c47e-9810-4f57-9e77-9645145de6b5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078683 Feb 21 01:40:35.235751 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1025/2073] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:35 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:36.252969 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-73d0990e-b8ba-4d66-b3cd-3753ca689cbd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:36.253493 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-73d0990e-b8ba-4d66-b3cd-3753ca689cbd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:36.259230 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-73d0990e-b8ba-4d66-b3cd-3753ca689cbd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:36.259679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-73d0990e-b8ba-4d66-b3cd-3753ca689cbd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:36.260483 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-73d0990e-b8ba-4d66-b3cd-3753ca689cbd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:36.260918 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-73d0990e-b8ba-4d66-b3cd-3753ca689cbd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:36.319411 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-73d0990e-b8ba-4d66-b3cd-3753ca689cbd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:36.327115 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-73d0990e-b8ba-4d66-b3cd-3753ca689cbd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078589 Feb 21 01:40:36.327670 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1049/2074] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:36 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:37.344458 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-31fc77fe-d950-4d6d-b37f-98a335a75088 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:37.345068 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-31fc77fe-d950-4d6d-b37f-98a335a75088 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:37.351760 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31fc77fe-d950-4d6d-b37f-98a335a75088 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:37.352273 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31fc77fe-d950-4d6d-b37f-98a335a75088 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:37.353054 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31fc77fe-d950-4d6d-b37f-98a335a75088 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:37.353488 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31fc77fe-d950-4d6d-b37f-98a335a75088 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:37.414041 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-31fc77fe-d950-4d6d-b37f-98a335a75088 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:37.422310 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-31fc77fe-d950-4d6d-b37f-98a335a75088 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081679 Feb 21 01:40:37.422870 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1026/2075] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:37 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:38.438377 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d1773e05-d423-4ed5-bcb1-3c00600e9907 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:38.438994 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d1773e05-d423-4ed5-bcb1-3c00600e9907 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:38.446376 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d1773e05-d423-4ed5-bcb1-3c00600e9907 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:38.446830 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d1773e05-d423-4ed5-bcb1-3c00600e9907 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:38.447604 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d1773e05-d423-4ed5-bcb1-3c00600e9907 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:38.448080 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d1773e05-d423-4ed5-bcb1-3c00600e9907 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:38.509342 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d1773e05-d423-4ed5-bcb1-3c00600e9907 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:38.516943 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d1773e05-d423-4ed5-bcb1-3c00600e9907 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082233 Feb 21 01:40:38.518112 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1050/2076] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:38 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:39.534991 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-40fdc970-7f6b-4c67-92d0-ca0882b6f4db tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:39.535603 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-40fdc970-7f6b-4c67-92d0-ca0882b6f4db tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:39.541968 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-40fdc970-7f6b-4c67-92d0-ca0882b6f4db tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:39.542418 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-40fdc970-7f6b-4c67-92d0-ca0882b6f4db tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:39.543194 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-40fdc970-7f6b-4c67-92d0-ca0882b6f4db tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:39.543630 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-40fdc970-7f6b-4c67-92d0-ca0882b6f4db tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:39.604724 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-40fdc970-7f6b-4c67-92d0-ca0882b6f4db tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:39.613077 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-40fdc970-7f6b-4c67-92d0-ca0882b6f4db tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082616 Feb 21 01:40:39.613585 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1027/2077] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:39 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:40.629842 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3cf19c20-4717-48e3-a7eb-c731cfaef9d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:40.630470 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3cf19c20-4717-48e3-a7eb-c731cfaef9d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:40.636717 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3cf19c20-4717-48e3-a7eb-c731cfaef9d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:40.637165 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3cf19c20-4717-48e3-a7eb-c731cfaef9d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:40.637958 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3cf19c20-4717-48e3-a7eb-c731cfaef9d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:40.638385 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3cf19c20-4717-48e3-a7eb-c731cfaef9d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:40.697577 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3cf19c20-4717-48e3-a7eb-c731cfaef9d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:40.705962 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3cf19c20-4717-48e3-a7eb-c731cfaef9d0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080259 Feb 21 01:40:40.706527 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1051/2078] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:40 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:41.722753 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7e028234-89c8-471b-b7ce-fb2268e5665b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:41.723386 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7e028234-89c8-471b-b7ce-fb2268e5665b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:41.729932 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7e028234-89c8-471b-b7ce-fb2268e5665b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:41.730371 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7e028234-89c8-471b-b7ce-fb2268e5665b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:41.731136 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7e028234-89c8-471b-b7ce-fb2268e5665b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:41.731561 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7e028234-89c8-471b-b7ce-fb2268e5665b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:41.794517 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7e028234-89c8-471b-b7ce-fb2268e5665b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:41.803008 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7e028234-89c8-471b-b7ce-fb2268e5665b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084432 Feb 21 01:40:41.803568 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1028/2079] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:41 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:42.819789 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d289dd1c-74a9-4b0d-b68c-2208781069ea tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:42.820462 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d289dd1c-74a9-4b0d-b68c-2208781069ea tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:42.826739 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d289dd1c-74a9-4b0d-b68c-2208781069ea tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:42.827191 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d289dd1c-74a9-4b0d-b68c-2208781069ea tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:42.828008 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d289dd1c-74a9-4b0d-b68c-2208781069ea tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:42.828451 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d289dd1c-74a9-4b0d-b68c-2208781069ea tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:42.890608 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d289dd1c-74a9-4b0d-b68c-2208781069ea tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:42.898573 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d289dd1c-74a9-4b0d-b68c-2208781069ea tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082457 Feb 21 01:40:42.899130 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1052/2080] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:42 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:43.914874 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0da2d8a9-f29f-433d-bb25-fbd6609a7b7c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:43.915504 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0da2d8a9-f29f-433d-bb25-fbd6609a7b7c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:43.921738 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0da2d8a9-f29f-433d-bb25-fbd6609a7b7c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:43.922185 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0da2d8a9-f29f-433d-bb25-fbd6609a7b7c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:43.922962 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0da2d8a9-f29f-433d-bb25-fbd6609a7b7c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:43.923396 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0da2d8a9-f29f-433d-bb25-fbd6609a7b7c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:43.983950 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0da2d8a9-f29f-433d-bb25-fbd6609a7b7c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:43.992766 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0da2d8a9-f29f-433d-bb25-fbd6609a7b7c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081606 Feb 21 01:40:43.993326 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1029/2081] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:43 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:45.009270 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ca2ae6e2-b7a8-4172-b025-321c0749d3fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:45.009874 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ca2ae6e2-b7a8-4172-b025-321c0749d3fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:45.016165 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ca2ae6e2-b7a8-4172-b025-321c0749d3fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:45.016612 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ca2ae6e2-b7a8-4172-b025-321c0749d3fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:45.017702 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ca2ae6e2-b7a8-4172-b025-321c0749d3fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:45.017840 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ca2ae6e2-b7a8-4172-b025-321c0749d3fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:45.076903 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ca2ae6e2-b7a8-4172-b025-321c0749d3fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:45.084873 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ca2ae6e2-b7a8-4172-b025-321c0749d3fe tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079259 Feb 21 01:40:45.085427 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1053/2082] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:45 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:45.726901 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:40:45.727427 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:40:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:40:46.102125 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-15d83767-fee4-41c4-94ae-253411a560b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:46.102680 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-15d83767-fee4-41c4-94ae-253411a560b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:46.108998 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-15d83767-fee4-41c4-94ae-253411a560b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:46.109539 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-15d83767-fee4-41c4-94ae-253411a560b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:46.110668 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-15d83767-fee4-41c4-94ae-253411a560b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:46.111754 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-15d83767-fee4-41c4-94ae-253411a560b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:46.170958 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-15d83767-fee4-41c4-94ae-253411a560b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:46.179251 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-15d83767-fee4-41c4-94ae-253411a560b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081350 Feb 21 01:40:46.179810 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1030/2083] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:46 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:47.198374 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2f7fcad7-a79d-419d-b274-0e7ad4be8aba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:47.199025 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2f7fcad7-a79d-419d-b274-0e7ad4be8aba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:47.205455 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2f7fcad7-a79d-419d-b274-0e7ad4be8aba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:47.205908 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2f7fcad7-a79d-419d-b274-0e7ad4be8aba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:47.206687 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2f7fcad7-a79d-419d-b274-0e7ad4be8aba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:47.207118 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2f7fcad7-a79d-419d-b274-0e7ad4be8aba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:47.268478 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2f7fcad7-a79d-419d-b274-0e7ad4be8aba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:47.276161 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2f7fcad7-a79d-419d-b274-0e7ad4be8aba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081407 Feb 21 01:40:47.276748 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1054/2084] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:47 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:48.292199 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a9b4b571-5c98-4cf2-98b0-6b887336435f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:48.292819 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a9b4b571-5c98-4cf2-98b0-6b887336435f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:48.299556 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a9b4b571-5c98-4cf2-98b0-6b887336435f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:48.300030 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a9b4b571-5c98-4cf2-98b0-6b887336435f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:48.300826 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a9b4b571-5c98-4cf2-98b0-6b887336435f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:48.301267 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a9b4b571-5c98-4cf2-98b0-6b887336435f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:48.360587 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a9b4b571-5c98-4cf2-98b0-6b887336435f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:48.368852 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a9b4b571-5c98-4cf2-98b0-6b887336435f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080218 Feb 21 01:40:48.369345 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1031/2085] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:48 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:49.385760 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c4ef1cda-9ac7-4911-9d5c-a1de6db92cde tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:49.386372 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c4ef1cda-9ac7-4911-9d5c-a1de6db92cde tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:49.393329 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c4ef1cda-9ac7-4911-9d5c-a1de6db92cde tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:49.393777 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c4ef1cda-9ac7-4911-9d5c-a1de6db92cde tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:49.394557 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c4ef1cda-9ac7-4911-9d5c-a1de6db92cde tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:49.394995 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c4ef1cda-9ac7-4911-9d5c-a1de6db92cde tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:49.456419 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c4ef1cda-9ac7-4911-9d5c-a1de6db92cde tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:49.464077 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c4ef1cda-9ac7-4911-9d5c-a1de6db92cde tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081970 Feb 21 01:40:49.464637 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1055/2086] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:49 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:50.059577 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:40:50.060172 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:40:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:40:50.481111 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-48c55337-f6f7-4b2a-a98e-be87b6181585 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:50.481746 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-48c55337-f6f7-4b2a-a98e-be87b6181585 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:50.488207 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-48c55337-f6f7-4b2a-a98e-be87b6181585 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:50.488653 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-48c55337-f6f7-4b2a-a98e-be87b6181585 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:50.489421 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-48c55337-f6f7-4b2a-a98e-be87b6181585 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:50.489853 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-48c55337-f6f7-4b2a-a98e-be87b6181585 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:50.552245 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-48c55337-f6f7-4b2a-a98e-be87b6181585 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:50.560024 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-48c55337-f6f7-4b2a-a98e-be87b6181585 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082618 Feb 21 01:40:50.560580 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1032/2087] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:50 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:50.840030 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:40:50.840493 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:40:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:40:51.576788 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ea5b4dcb-0f2c-42a2-acac-9f63598fa893 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:51.577392 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ea5b4dcb-0f2c-42a2-acac-9f63598fa893 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:51.584359 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ea5b4dcb-0f2c-42a2-acac-9f63598fa893 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:51.584796 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ea5b4dcb-0f2c-42a2-acac-9f63598fa893 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:51.585563 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ea5b4dcb-0f2c-42a2-acac-9f63598fa893 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:51.585995 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ea5b4dcb-0f2c-42a2-acac-9f63598fa893 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:51.648946 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ea5b4dcb-0f2c-42a2-acac-9f63598fa893 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:51.656538 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ea5b4dcb-0f2c-42a2-acac-9f63598fa893 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083418 Feb 21 01:40:51.657100 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1056/2088] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:51 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:52.673960 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-97f1f19c-33a7-419b-a644-0870b4329518 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:52.674574 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-97f1f19c-33a7-419b-a644-0870b4329518 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:52.680701 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-97f1f19c-33a7-419b-a644-0870b4329518 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:52.681144 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-97f1f19c-33a7-419b-a644-0870b4329518 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:52.681903 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-97f1f19c-33a7-419b-a644-0870b4329518 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:52.682331 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-97f1f19c-33a7-419b-a644-0870b4329518 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:52.743215 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-97f1f19c-33a7-419b-a644-0870b4329518 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:52.750767 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-97f1f19c-33a7-419b-a644-0870b4329518 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081024 Feb 21 01:40:52.751427 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1033/2089] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:52 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:53.767108 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-68b44ef2-67cd-4d29-a5ee-36f27d2595c8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:53.767745 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-68b44ef2-67cd-4d29-a5ee-36f27d2595c8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:53.774016 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-68b44ef2-67cd-4d29-a5ee-36f27d2595c8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:53.774466 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-68b44ef2-67cd-4d29-a5ee-36f27d2595c8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:53.775288 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-68b44ef2-67cd-4d29-a5ee-36f27d2595c8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:53.775723 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-68b44ef2-67cd-4d29-a5ee-36f27d2595c8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:53.835106 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-68b44ef2-67cd-4d29-a5ee-36f27d2595c8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:53.843446 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-68b44ef2-67cd-4d29-a5ee-36f27d2595c8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080064 Feb 21 01:40:53.844021 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1057/2090] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:53 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:54.859964 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a7d3d9f5-044d-403d-83e9-b4d18132aa3b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:54.860620 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a7d3d9f5-044d-403d-83e9-b4d18132aa3b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:54.866723 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a7d3d9f5-044d-403d-83e9-b4d18132aa3b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:54.867160 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a7d3d9f5-044d-403d-83e9-b4d18132aa3b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:54.867942 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a7d3d9f5-044d-403d-83e9-b4d18132aa3b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:54.868368 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a7d3d9f5-044d-403d-83e9-b4d18132aa3b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:54.926990 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a7d3d9f5-044d-403d-83e9-b4d18132aa3b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:54.934544 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a7d3d9f5-044d-403d-83e9-b4d18132aa3b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078221 Feb 21 01:40:54.935087 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1034/2091] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:54 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:55.952446 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-bf0ac924-770c-43dd-b772-dc62dc45f159 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:55.953055 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-bf0ac924-770c-43dd-b772-dc62dc45f159 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:55.959950 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bf0ac924-770c-43dd-b772-dc62dc45f159 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:55.960401 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bf0ac924-770c-43dd-b772-dc62dc45f159 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:55.961172 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bf0ac924-770c-43dd-b772-dc62dc45f159 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:55.961600 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bf0ac924-770c-43dd-b772-dc62dc45f159 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:56.028576 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-bf0ac924-770c-43dd-b772-dc62dc45f159 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:56.036408 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-bf0ac924-770c-43dd-b772-dc62dc45f159 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.087635 Feb 21 01:40:56.036968 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1058/2092] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:55 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:57.052484 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1fac8ad4-8253-495b-976e-aaf55078710f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:57.053076 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1fac8ad4-8253-495b-976e-aaf55078710f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:57.059204 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1fac8ad4-8253-495b-976e-aaf55078710f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:57.059700 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1fac8ad4-8253-495b-976e-aaf55078710f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:57.060505 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1fac8ad4-8253-495b-976e-aaf55078710f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:57.060935 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1fac8ad4-8253-495b-976e-aaf55078710f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:57.120447 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1fac8ad4-8253-495b-976e-aaf55078710f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:57.128784 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1fac8ad4-8253-495b-976e-aaf55078710f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079972 Feb 21 01:40:57.129504 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1035/2093] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:57 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:58.145818 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7d3e20bc-c38e-4e7a-bb55-f941183614df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:58.146430 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7d3e20bc-c38e-4e7a-bb55-f941183614df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:58.152681 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7d3e20bc-c38e-4e7a-bb55-f941183614df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:58.153125 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7d3e20bc-c38e-4e7a-bb55-f941183614df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:58.153896 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7d3e20bc-c38e-4e7a-bb55-f941183614df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:58.154330 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7d3e20bc-c38e-4e7a-bb55-f941183614df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:58.213347 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7d3e20bc-c38e-4e7a-bb55-f941183614df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:58.221104 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7d3e20bc-c38e-4e7a-bb55-f941183614df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079694 Feb 21 01:40:58.221656 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1059/2094] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:58 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:59.238367 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-99e0cd1f-60eb-4b43-94fb-a89f79e3f158 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:59.238981 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-99e0cd1f-60eb-4b43-94fb-a89f79e3f158 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:59.245201 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-99e0cd1f-60eb-4b43-94fb-a89f79e3f158 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:59.245654 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-99e0cd1f-60eb-4b43-94fb-a89f79e3f158 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:59.246437 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-99e0cd1f-60eb-4b43-94fb-a89f79e3f158 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:59.246873 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-99e0cd1f-60eb-4b43-94fb-a89f79e3f158 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:59.308354 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-99e0cd1f-60eb-4b43-94fb-a89f79e3f158 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:59.320723 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-99e0cd1f-60eb-4b43-94fb-a89f79e3f158 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083495 Feb 21 01:40:59.321304 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1036/2095] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:59 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:00.337299 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-44753634-bb9f-4b78-acd4-a27d23ad9d57 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:00.337906 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-44753634-bb9f-4b78-acd4-a27d23ad9d57 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:00.344229 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-44753634-bb9f-4b78-acd4-a27d23ad9d57 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:00.344714 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-44753634-bb9f-4b78-acd4-a27d23ad9d57 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:00.345638 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-44753634-bb9f-4b78-acd4-a27d23ad9d57 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:00.346071 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-44753634-bb9f-4b78-acd4-a27d23ad9d57 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:00.408198 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-44753634-bb9f-4b78-acd4-a27d23ad9d57 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:00.416319 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-44753634-bb9f-4b78-acd4-a27d23ad9d57 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082632 Feb 21 01:41:00.416873 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1060/2096] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:00 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:01.433221 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-71a00540-a069-41c8-968d-8dbb256fd91e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:01.433986 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-71a00540-a069-41c8-968d-8dbb256fd91e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:01.440654 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-71a00540-a069-41c8-968d-8dbb256fd91e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:01.440987 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-71a00540-a069-41c8-968d-8dbb256fd91e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:01.441778 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-71a00540-a069-41c8-968d-8dbb256fd91e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:01.442218 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-71a00540-a069-41c8-968d-8dbb256fd91e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:01.531450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-71a00540-a069-41c8-968d-8dbb256fd91e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:01.531450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-71a00540-a069-41c8-968d-8dbb256fd91e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082232 Feb 21 01:41:01.531450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1037/2097] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:01 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:02.529588 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4343a04a-ebe3-4cb7-9193-f77f24851d56 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:02.530232 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4343a04a-ebe3-4cb7-9193-f77f24851d56 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:02.537082 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4343a04a-ebe3-4cb7-9193-f77f24851d56 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:02.537527 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4343a04a-ebe3-4cb7-9193-f77f24851d56 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:02.538304 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4343a04a-ebe3-4cb7-9193-f77f24851d56 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:02.538750 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4343a04a-ebe3-4cb7-9193-f77f24851d56 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:02.599435 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4343a04a-ebe3-4cb7-9193-f77f24851d56 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:02.607129 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4343a04a-ebe3-4cb7-9193-f77f24851d56 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081182 Feb 21 01:41:02.607680 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1061/2098] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:02 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:03.624200 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d505eeeb-343f-4f92-8704-5751fba4eac4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:03.624754 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d505eeeb-343f-4f92-8704-5751fba4eac4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:03.631950 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d505eeeb-343f-4f92-8704-5751fba4eac4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:03.632403 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d505eeeb-343f-4f92-8704-5751fba4eac4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:03.633183 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d505eeeb-343f-4f92-8704-5751fba4eac4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:03.633620 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d505eeeb-343f-4f92-8704-5751fba4eac4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:03.693620 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d505eeeb-343f-4f92-8704-5751fba4eac4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:03.701319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d505eeeb-343f-4f92-8704-5751fba4eac4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080831 Feb 21 01:41:03.701880 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1038/2099] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:03 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:04.718080 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-bc687099-5d3b-41e5-a9e5-68d4abc55fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:04.718676 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-bc687099-5d3b-41e5-a9e5-68d4abc55fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:04.725266 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bc687099-5d3b-41e5-a9e5-68d4abc55fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:04.725717 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bc687099-5d3b-41e5-a9e5-68d4abc55fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:04.726491 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bc687099-5d3b-41e5-a9e5-68d4abc55fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:04.726927 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bc687099-5d3b-41e5-a9e5-68d4abc55fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:04.785892 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-bc687099-5d3b-41e5-a9e5-68d4abc55fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:04.793600 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-bc687099-5d3b-41e5-a9e5-68d4abc55fb1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079289 Feb 21 01:41:04.794150 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1062/2100] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:04 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:05.809976 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-75bc65b6-1f75-4d1d-80e7-40e38b67d34d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:05.810616 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-75bc65b6-1f75-4d1d-80e7-40e38b67d34d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:05.817136 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-75bc65b6-1f75-4d1d-80e7-40e38b67d34d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:05.817589 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-75bc65b6-1f75-4d1d-80e7-40e38b67d34d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:05.818362 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-75bc65b6-1f75-4d1d-80e7-40e38b67d34d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:05.818810 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-75bc65b6-1f75-4d1d-80e7-40e38b67d34d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:05.878470 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-75bc65b6-1f75-4d1d-80e7-40e38b67d34d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:05.886175 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-75bc65b6-1f75-4d1d-80e7-40e38b67d34d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080070 Feb 21 01:41:05.886745 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1039/2101] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:05 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:06.902286 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3a22c2f7-b42c-4843-8a89-fb784434e0eb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:06.902839 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3a22c2f7-b42c-4843-8a89-fb784434e0eb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:06.909368 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3a22c2f7-b42c-4843-8a89-fb784434e0eb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:06.909813 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3a22c2f7-b42c-4843-8a89-fb784434e0eb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:06.910586 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3a22c2f7-b42c-4843-8a89-fb784434e0eb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:06.911018 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3a22c2f7-b42c-4843-8a89-fb784434e0eb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:06.970054 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3a22c2f7-b42c-4843-8a89-fb784434e0eb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:06.978006 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3a22c2f7-b42c-4843-8a89-fb784434e0eb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079460 Feb 21 01:41:06.978562 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1063/2102] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:06 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:07.994207 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b8875fbd-389e-4546-82d7-c63c4401e73c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:07.994850 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b8875fbd-389e-4546-82d7-c63c4401e73c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:08.001686 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b8875fbd-389e-4546-82d7-c63c4401e73c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:08.002431 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b8875fbd-389e-4546-82d7-c63c4401e73c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:08.003234 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b8875fbd-389e-4546-82d7-c63c4401e73c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:08.003655 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b8875fbd-389e-4546-82d7-c63c4401e73c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:08.067568 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b8875fbd-389e-4546-82d7-c63c4401e73c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:08.075270 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b8875fbd-389e-4546-82d7-c63c4401e73c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084718 Feb 21 01:41:08.075856 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1040/2103] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:07 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:09.092096 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9a886f0e-fd14-4af6-9b99-a61f8c68384b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:09.092723 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9a886f0e-fd14-4af6-9b99-a61f8c68384b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:09.099766 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9a886f0e-fd14-4af6-9b99-a61f8c68384b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:09.100250 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9a886f0e-fd14-4af6-9b99-a61f8c68384b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:09.101034 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9a886f0e-fd14-4af6-9b99-a61f8c68384b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:09.101470 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9a886f0e-fd14-4af6-9b99-a61f8c68384b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:09.163177 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9a886f0e-fd14-4af6-9b99-a61f8c68384b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:09.170976 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9a886f0e-fd14-4af6-9b99-a61f8c68384b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082495 Feb 21 01:41:09.171565 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1064/2104] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:09 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:10.187325 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4ffb4f2b-809d-41e6-962d-6b2a688a3802 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:10.188056 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4ffb4f2b-809d-41e6-962d-6b2a688a3802 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:10.194279 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ffb4f2b-809d-41e6-962d-6b2a688a3802 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:10.194728 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ffb4f2b-809d-41e6-962d-6b2a688a3802 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:10.195505 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ffb4f2b-809d-41e6-962d-6b2a688a3802 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:10.195971 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ffb4f2b-809d-41e6-962d-6b2a688a3802 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:10.254971 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4ffb4f2b-809d-41e6-962d-6b2a688a3802 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:10.262642 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4ffb4f2b-809d-41e6-962d-6b2a688a3802 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078957 Feb 21 01:41:10.263201 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1041/2105] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:10 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:11.279462 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-53bff7ec-b1ff-47f5-889a-b87655c79a35 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:11.280102 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-53bff7ec-b1ff-47f5-889a-b87655c79a35 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:11.286414 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-53bff7ec-b1ff-47f5-889a-b87655c79a35 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:11.286861 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-53bff7ec-b1ff-47f5-889a-b87655c79a35 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:11.287635 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-53bff7ec-b1ff-47f5-889a-b87655c79a35 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:11.288099 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-53bff7ec-b1ff-47f5-889a-b87655c79a35 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:11.346990 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-53bff7ec-b1ff-47f5-889a-b87655c79a35 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:11.354952 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-53bff7ec-b1ff-47f5-889a-b87655c79a35 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079166 Feb 21 01:41:11.355505 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1065/2106] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:11 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:12.372051 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-705b2ff5-b3f9-43b1-9083-7bffbe183a7e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:12.372640 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-705b2ff5-b3f9-43b1-9083-7bffbe183a7e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:12.379535 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-705b2ff5-b3f9-43b1-9083-7bffbe183a7e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:12.380029 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-705b2ff5-b3f9-43b1-9083-7bffbe183a7e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:12.380807 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-705b2ff5-b3f9-43b1-9083-7bffbe183a7e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:12.381242 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-705b2ff5-b3f9-43b1-9083-7bffbe183a7e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:12.441296 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-705b2ff5-b3f9-43b1-9083-7bffbe183a7e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:12.449110 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-705b2ff5-b3f9-43b1-9083-7bffbe183a7e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080772 Feb 21 01:41:12.449713 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1042/2107] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:12 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:13.466407 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a9281375-6b3c-418c-8c0e-0bd374ada530 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:13.467019 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a9281375-6b3c-418c-8c0e-0bd374ada530 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:13.474301 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a9281375-6b3c-418c-8c0e-0bd374ada530 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:13.474748 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a9281375-6b3c-418c-8c0e-0bd374ada530 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:13.475520 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a9281375-6b3c-418c-8c0e-0bd374ada530 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:13.475982 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a9281375-6b3c-418c-8c0e-0bd374ada530 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:13.534707 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a9281375-6b3c-418c-8c0e-0bd374ada530 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:13.542395 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a9281375-6b3c-418c-8c0e-0bd374ada530 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079647 Feb 21 01:41:13.542946 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1066/2108] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:13 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:14.559118 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-25e9581b-e6c2-48ee-ac7f-75cff6583414 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:14.559729 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-25e9581b-e6c2-48ee-ac7f-75cff6583414 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:14.566116 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-25e9581b-e6c2-48ee-ac7f-75cff6583414 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:14.566556 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-25e9581b-e6c2-48ee-ac7f-75cff6583414 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:14.567327 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-25e9581b-e6c2-48ee-ac7f-75cff6583414 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:14.567756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-25e9581b-e6c2-48ee-ac7f-75cff6583414 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:14.627946 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-25e9581b-e6c2-48ee-ac7f-75cff6583414 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:14.635609 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-25e9581b-e6c2-48ee-ac7f-75cff6583414 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080209 Feb 21 01:41:14.636195 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1043/2109] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:14 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:15.652075 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-cd0b94fc-c2bd-4684-9492-3a731d58285a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:15.652663 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-cd0b94fc-c2bd-4684-9492-3a731d58285a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:15.658902 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cd0b94fc-c2bd-4684-9492-3a731d58285a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:15.659345 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cd0b94fc-c2bd-4684-9492-3a731d58285a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:15.660131 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cd0b94fc-c2bd-4684-9492-3a731d58285a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:15.660558 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cd0b94fc-c2bd-4684-9492-3a731d58285a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:15.719313 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-cd0b94fc-c2bd-4684-9492-3a731d58285a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:15.727046 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-cd0b94fc-c2bd-4684-9492-3a731d58285a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078710 Feb 21 01:41:15.727593 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1067/2110] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:15 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:16.744069 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a75c3027-491d-4bcf-bcfd-b1fa6c93192a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:16.744681 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a75c3027-491d-4bcf-bcfd-b1fa6c93192a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:16.751927 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a75c3027-491d-4bcf-bcfd-b1fa6c93192a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:16.752377 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a75c3027-491d-4bcf-bcfd-b1fa6c93192a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:16.753161 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a75c3027-491d-4bcf-bcfd-b1fa6c93192a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:16.753593 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a75c3027-491d-4bcf-bcfd-b1fa6c93192a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:16.815537 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a75c3027-491d-4bcf-bcfd-b1fa6c93192a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:16.823294 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a75c3027-491d-4bcf-bcfd-b1fa6c93192a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082947 Feb 21 01:41:16.823872 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1044/2111] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:16 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:17.839993 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-de95c99a-fe40-4e08-8b88-eaff36fd0f8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:17.840597 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-de95c99a-fe40-4e08-8b88-eaff36fd0f8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:17.847428 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-de95c99a-fe40-4e08-8b88-eaff36fd0f8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:17.847890 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-de95c99a-fe40-4e08-8b88-eaff36fd0f8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:17.848923 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-de95c99a-fe40-4e08-8b88-eaff36fd0f8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:17.849349 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-de95c99a-fe40-4e08-8b88-eaff36fd0f8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:17.912763 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-de95c99a-fe40-4e08-8b88-eaff36fd0f8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:17.920848 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-de95c99a-fe40-4e08-8b88-eaff36fd0f8d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084515 Feb 21 01:41:17.921416 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1068/2112] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:17 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:18.937423 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-68de8268-ef6f-4853-8a1a-c6726b15402f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:18.938128 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-68de8268-ef6f-4853-8a1a-c6726b15402f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:18.944566 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68de8268-ef6f-4853-8a1a-c6726b15402f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:18.945016 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68de8268-ef6f-4853-8a1a-c6726b15402f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:18.945785 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68de8268-ef6f-4853-8a1a-c6726b15402f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:18.946216 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-68de8268-ef6f-4853-8a1a-c6726b15402f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:19.006077 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-68de8268-ef6f-4853-8a1a-c6726b15402f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:19.013916 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-68de8268-ef6f-4853-8a1a-c6726b15402f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080132 Feb 21 01:41:19.014483 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1045/2113] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:18 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:20.030564 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-59681759-4aab-4a7a-9fd9-7dc6d1a6df44 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:20.031171 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-59681759-4aab-4a7a-9fd9-7dc6d1a6df44 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:20.037520 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-59681759-4aab-4a7a-9fd9-7dc6d1a6df44 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:20.037971 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-59681759-4aab-4a7a-9fd9-7dc6d1a6df44 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:20.038746 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-59681759-4aab-4a7a-9fd9-7dc6d1a6df44 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:20.039180 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-59681759-4aab-4a7a-9fd9-7dc6d1a6df44 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:20.098656 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-59681759-4aab-4a7a-9fd9-7dc6d1a6df44 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:20.106511 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-59681759-4aab-4a7a-9fd9-7dc6d1a6df44 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079646 Feb 21 01:41:20.107064 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1069/2114] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:20 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:21.123600 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-eefa3fcb-39c0-44e1-8b71-af9927a0cdb0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:21.124308 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-eefa3fcb-39c0-44e1-8b71-af9927a0cdb0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:21.131132 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eefa3fcb-39c0-44e1-8b71-af9927a0cdb0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:21.131574 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eefa3fcb-39c0-44e1-8b71-af9927a0cdb0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:21.132389 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eefa3fcb-39c0-44e1-8b71-af9927a0cdb0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:21.132859 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eefa3fcb-39c0-44e1-8b71-af9927a0cdb0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:21.191726 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-eefa3fcb-39c0-44e1-8b71-af9927a0cdb0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:21.199422 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-eefa3fcb-39c0-44e1-8b71-af9927a0cdb0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079605 Feb 21 01:41:21.200004 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1046/2115] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:21 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:22.215722 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-967d1272-a7d9-4110-aa51-b0dc76588708 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:22.216390 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-967d1272-a7d9-4110-aa51-b0dc76588708 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:22.223804 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-967d1272-a7d9-4110-aa51-b0dc76588708 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:22.224328 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-967d1272-a7d9-4110-aa51-b0dc76588708 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:22.225122 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-967d1272-a7d9-4110-aa51-b0dc76588708 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:22.225555 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-967d1272-a7d9-4110-aa51-b0dc76588708 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:22.285995 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-967d1272-a7d9-4110-aa51-b0dc76588708 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:22.293816 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-967d1272-a7d9-4110-aa51-b0dc76588708 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081707 Feb 21 01:41:22.294374 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1070/2116] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:22 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:23.310272 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-280b25d3-6492-4e42-8532-77b6760942a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:23.310885 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-280b25d3-6492-4e42-8532-77b6760942a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:23.317828 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-280b25d3-6492-4e42-8532-77b6760942a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:23.318272 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-280b25d3-6492-4e42-8532-77b6760942a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:23.319050 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-280b25d3-6492-4e42-8532-77b6760942a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:23.319474 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-280b25d3-6492-4e42-8532-77b6760942a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:23.381124 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-280b25d3-6492-4e42-8532-77b6760942a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:23.388804 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-280b25d3-6492-4e42-8532-77b6760942a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082165 Feb 21 01:41:23.389366 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1047/2117] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:23 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:24.405850 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3342a4f8-0667-4786-bf3a-52f1973ced0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:24.406406 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3342a4f8-0667-4786-bf3a-52f1973ced0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:24.413182 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3342a4f8-0667-4786-bf3a-52f1973ced0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:24.413630 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3342a4f8-0667-4786-bf3a-52f1973ced0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:24.414418 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3342a4f8-0667-4786-bf3a-52f1973ced0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:24.414855 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3342a4f8-0667-4786-bf3a-52f1973ced0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:24.475474 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3342a4f8-0667-4786-bf3a-52f1973ced0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:24.483331 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3342a4f8-0667-4786-bf3a-52f1973ced0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081182 Feb 21 01:41:24.483913 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1071/2118] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:24 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:25.500445 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cdeec720-c202-417e-a358-a0215c6ae2df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:25.501171 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cdeec720-c202-417e-a358-a0215c6ae2df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:25.507314 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cdeec720-c202-417e-a358-a0215c6ae2df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:25.507784 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cdeec720-c202-417e-a358-a0215c6ae2df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:25.508591 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cdeec720-c202-417e-a358-a0215c6ae2df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:25.509026 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cdeec720-c202-417e-a358-a0215c6ae2df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:25.571495 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cdeec720-c202-417e-a358-a0215c6ae2df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:25.579982 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cdeec720-c202-417e-a358-a0215c6ae2df tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083433 Feb 21 01:41:25.580547 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1048/2119] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:25 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:26.596861 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-dcceecf0-6fd6-4492-bc87-da13d16a479e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:26.597473 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-dcceecf0-6fd6-4492-bc87-da13d16a479e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:26.604006 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dcceecf0-6fd6-4492-bc87-da13d16a479e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:26.604460 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dcceecf0-6fd6-4492-bc87-da13d16a479e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:26.605234 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dcceecf0-6fd6-4492-bc87-da13d16a479e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:26.605670 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dcceecf0-6fd6-4492-bc87-da13d16a479e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:26.664079 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-dcceecf0-6fd6-4492-bc87-da13d16a479e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:26.671639 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-dcceecf0-6fd6-4492-bc87-da13d16a479e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079011 Feb 21 01:41:26.672954 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1072/2120] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:26 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:27.689422 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-67791bc9-8bc5-40ab-a1fa-4f4b35349d46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:27.690070 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-67791bc9-8bc5-40ab-a1fa-4f4b35349d46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:27.696519 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-67791bc9-8bc5-40ab-a1fa-4f4b35349d46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:27.696973 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-67791bc9-8bc5-40ab-a1fa-4f4b35349d46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:27.697754 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-67791bc9-8bc5-40ab-a1fa-4f4b35349d46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:27.698190 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-67791bc9-8bc5-40ab-a1fa-4f4b35349d46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:27.758009 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-67791bc9-8bc5-40ab-a1fa-4f4b35349d46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:27.765648 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-67791bc9-8bc5-40ab-a1fa-4f4b35349d46 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080646 Feb 21 01:41:27.766206 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1049/2121] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:27 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:28.782349 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d8effdc0-3aeb-4b3b-8b51-7e6bc0f51c1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:28.782955 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d8effdc0-3aeb-4b3b-8b51-7e6bc0f51c1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:28.789169 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d8effdc0-3aeb-4b3b-8b51-7e6bc0f51c1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:28.789614 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d8effdc0-3aeb-4b3b-8b51-7e6bc0f51c1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:28.790378 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d8effdc0-3aeb-4b3b-8b51-7e6bc0f51c1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:28.790812 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d8effdc0-3aeb-4b3b-8b51-7e6bc0f51c1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:28.849388 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d8effdc0-3aeb-4b3b-8b51-7e6bc0f51c1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:28.857137 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d8effdc0-3aeb-4b3b-8b51-7e6bc0f51c1f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078530 Feb 21 01:41:28.857699 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1073/2122] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:28 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:29.873247 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5fbb209d-fe48-41e6-8a36-59885bdba4f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:29.873886 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5fbb209d-fe48-41e6-8a36-59885bdba4f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:29.880625 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5fbb209d-fe48-41e6-8a36-59885bdba4f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:29.881114 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5fbb209d-fe48-41e6-8a36-59885bdba4f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:29.881932 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5fbb209d-fe48-41e6-8a36-59885bdba4f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:29.882364 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5fbb209d-fe48-41e6-8a36-59885bdba4f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:29.942723 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5fbb209d-fe48-41e6-8a36-59885bdba4f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:29.950383 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5fbb209d-fe48-41e6-8a36-59885bdba4f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080912 Feb 21 01:41:29.950951 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1050/2123] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:29 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:30.967359 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-caf1f694-a399-4435-9810-9f9f53158b7c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:30.967997 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-caf1f694-a399-4435-9810-9f9f53158b7c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:30.975313 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-caf1f694-a399-4435-9810-9f9f53158b7c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:30.975769 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-caf1f694-a399-4435-9810-9f9f53158b7c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:30.976574 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-caf1f694-a399-4435-9810-9f9f53158b7c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:30.977014 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-caf1f694-a399-4435-9810-9f9f53158b7c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:31.046423 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-caf1f694-a399-4435-9810-9f9f53158b7c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:31.054835 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-caf1f694-a399-4435-9810-9f9f53158b7c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.091124 Feb 21 01:41:31.055384 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1074/2124] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:30 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:32.072774 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-81312bee-ac29-4b47-a68c-b84b48188bc5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:32.073336 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-81312bee-ac29-4b47-a68c-b84b48188bc5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:32.080375 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-81312bee-ac29-4b47-a68c-b84b48188bc5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:32.080831 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-81312bee-ac29-4b47-a68c-b84b48188bc5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:32.081638 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-81312bee-ac29-4b47-a68c-b84b48188bc5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:32.082084 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-81312bee-ac29-4b47-a68c-b84b48188bc5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:32.144460 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-81312bee-ac29-4b47-a68c-b84b48188bc5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:32.152730 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-81312bee-ac29-4b47-a68c-b84b48188bc5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084811 Feb 21 01:41:32.153288 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1051/2125] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:32 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:33.170090 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-942973c9-d2b2-476d-bc1b-eb245fd80c32 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:33.170758 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-942973c9-d2b2-476d-bc1b-eb245fd80c32 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:33.177012 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-942973c9-d2b2-476d-bc1b-eb245fd80c32 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:33.177469 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-942973c9-d2b2-476d-bc1b-eb245fd80c32 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:33.178254 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-942973c9-d2b2-476d-bc1b-eb245fd80c32 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:33.178694 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-942973c9-d2b2-476d-bc1b-eb245fd80c32 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:33.242233 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-942973c9-d2b2-476d-bc1b-eb245fd80c32 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:33.249762 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-942973c9-d2b2-476d-bc1b-eb245fd80c32 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083323 Feb 21 01:41:33.250320 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1075/2126] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:33 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:34.267153 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-eb79301e-a0c0-4f98-aedc-dc4db0a37e2c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:34.267762 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-eb79301e-a0c0-4f98-aedc-dc4db0a37e2c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:34.274025 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eb79301e-a0c0-4f98-aedc-dc4db0a37e2c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:34.274448 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eb79301e-a0c0-4f98-aedc-dc4db0a37e2c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:34.275209 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eb79301e-a0c0-4f98-aedc-dc4db0a37e2c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:34.275636 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-eb79301e-a0c0-4f98-aedc-dc4db0a37e2c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:34.337604 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-eb79301e-a0c0-4f98-aedc-dc4db0a37e2c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:34.345879 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-eb79301e-a0c0-4f98-aedc-dc4db0a37e2c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082987 Feb 21 01:41:34.346434 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1052/2127] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:34 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:35.363140 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d428b5e3-8fca-4490-bddc-9efcb5f0a077 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:35.363755 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d428b5e3-8fca-4490-bddc-9efcb5f0a077 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:35.369686 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d428b5e3-8fca-4490-bddc-9efcb5f0a077 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:35.370134 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d428b5e3-8fca-4490-bddc-9efcb5f0a077 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:35.370906 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d428b5e3-8fca-4490-bddc-9efcb5f0a077 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:35.371336 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d428b5e3-8fca-4490-bddc-9efcb5f0a077 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:35.430266 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d428b5e3-8fca-4490-bddc-9efcb5f0a077 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:35.438058 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d428b5e3-8fca-4490-bddc-9efcb5f0a077 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079322 Feb 21 01:41:35.439244 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1076/2128] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:35 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:36.454808 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a56528da-9f3b-4ade-896a-d12ba3de1ad7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:36.455418 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a56528da-9f3b-4ade-896a-d12ba3de1ad7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:36.461719 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a56528da-9f3b-4ade-896a-d12ba3de1ad7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:36.462162 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a56528da-9f3b-4ade-896a-d12ba3de1ad7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:36.462939 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a56528da-9f3b-4ade-896a-d12ba3de1ad7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:36.463370 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a56528da-9f3b-4ade-896a-d12ba3de1ad7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:36.524307 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a56528da-9f3b-4ade-896a-d12ba3de1ad7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:36.532750 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a56528da-9f3b-4ade-896a-d12ba3de1ad7 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081437 Feb 21 01:41:36.533519 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1053/2129] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:36 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:37.549863 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ddf0102a-906e-46a9-8e3d-545d6ca2e370 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:37.550470 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ddf0102a-906e-46a9-8e3d-545d6ca2e370 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:37.556613 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ddf0102a-906e-46a9-8e3d-545d6ca2e370 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:37.557055 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ddf0102a-906e-46a9-8e3d-545d6ca2e370 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:37.557818 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ddf0102a-906e-46a9-8e3d-545d6ca2e370 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:37.558256 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ddf0102a-906e-46a9-8e3d-545d6ca2e370 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:37.619805 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ddf0102a-906e-46a9-8e3d-545d6ca2e370 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:37.627990 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ddf0102a-906e-46a9-8e3d-545d6ca2e370 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082463 Feb 21 01:41:37.628542 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1077/2130] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:37 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:38.645262 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-10452427-0870-4a90-88bc-f8a52af7bebd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:38.645852 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-10452427-0870-4a90-88bc-f8a52af7bebd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:38.652082 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-10452427-0870-4a90-88bc-f8a52af7bebd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:38.652540 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-10452427-0870-4a90-88bc-f8a52af7bebd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:38.653319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-10452427-0870-4a90-88bc-f8a52af7bebd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:38.653754 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-10452427-0870-4a90-88bc-f8a52af7bebd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:38.712554 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-10452427-0870-4a90-88bc-f8a52af7bebd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:38.720248 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-10452427-0870-4a90-88bc-f8a52af7bebd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079515 Feb 21 01:41:38.720803 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1054/2131] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:38 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:39.736763 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5c6fa99b-4c80-403f-8507-9c6ac7816057 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:39.737369 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5c6fa99b-4c80-403f-8507-9c6ac7816057 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:39.743803 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5c6fa99b-4c80-403f-8507-9c6ac7816057 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:39.744281 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5c6fa99b-4c80-403f-8507-9c6ac7816057 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:39.745043 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5c6fa99b-4c80-403f-8507-9c6ac7816057 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:39.745468 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5c6fa99b-4c80-403f-8507-9c6ac7816057 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:39.804651 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5c6fa99b-4c80-403f-8507-9c6ac7816057 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:39.812231 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5c6fa99b-4c80-403f-8507-9c6ac7816057 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079201 Feb 21 01:41:39.813727 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1078/2132] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:39 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:40.829066 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d7306396-8d75-44ad-8706-67dd8fc934a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:40.829663 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d7306396-8d75-44ad-8706-67dd8fc934a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:40.835964 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d7306396-8d75-44ad-8706-67dd8fc934a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:40.836408 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d7306396-8d75-44ad-8706-67dd8fc934a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:40.837171 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d7306396-8d75-44ad-8706-67dd8fc934a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:40.837600 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d7306396-8d75-44ad-8706-67dd8fc934a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:40.896751 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d7306396-8d75-44ad-8706-67dd8fc934a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:40.904331 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d7306396-8d75-44ad-8706-67dd8fc934a5 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079029 Feb 21 01:41:40.904880 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1055/2133] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:40 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:41.921402 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7dccd32e-00e3-483c-b024-8de17966fa0a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:41.922739 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7dccd32e-00e3-483c-b024-8de17966fa0a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:41.928964 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7dccd32e-00e3-483c-b024-8de17966fa0a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:41.929415 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7dccd32e-00e3-483c-b024-8de17966fa0a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:41.930205 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7dccd32e-00e3-483c-b024-8de17966fa0a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:41.930641 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7dccd32e-00e3-483c-b024-8de17966fa0a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:41.990768 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7dccd32e-00e3-483c-b024-8de17966fa0a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:41.998476 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7dccd32e-00e3-483c-b024-8de17966fa0a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080758 Feb 21 01:41:41.999031 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1079/2134] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:41 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:43.015444 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-30aae0cf-a803-4bcb-aca5-ffbc15451fc0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:43.016820 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-30aae0cf-a803-4bcb-aca5-ffbc15451fc0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:43.022955 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-30aae0cf-a803-4bcb-aca5-ffbc15451fc0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:43.023404 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-30aae0cf-a803-4bcb-aca5-ffbc15451fc0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:43.024199 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-30aae0cf-a803-4bcb-aca5-ffbc15451fc0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:43.024630 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-30aae0cf-a803-4bcb-aca5-ffbc15451fc0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:43.085126 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-30aae0cf-a803-4bcb-aca5-ffbc15451fc0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:43.092793 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-30aae0cf-a803-4bcb-aca5-ffbc15451fc0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081038 Feb 21 01:41:43.093346 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1056/2135] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:43 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:44.110496 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-34e2ab36-3c6a-4ae0-95f6-2b555e94e550 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:44.111089 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-34e2ab36-3c6a-4ae0-95f6-2b555e94e550 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:44.117386 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-34e2ab36-3c6a-4ae0-95f6-2b555e94e550 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:44.117843 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-34e2ab36-3c6a-4ae0-95f6-2b555e94e550 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:44.118622 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-34e2ab36-3c6a-4ae0-95f6-2b555e94e550 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:44.119060 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-34e2ab36-3c6a-4ae0-95f6-2b555e94e550 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:44.183371 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-34e2ab36-3c6a-4ae0-95f6-2b555e94e550 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:44.191117 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-34e2ab36-3c6a-4ae0-95f6-2b555e94e550 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084713 Feb 21 01:41:44.191670 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1080/2136] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:44 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:45.207384 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c6e8ca47-9f18-49ef-9670-e190c9a92728 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:45.208040 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c6e8ca47-9f18-49ef-9670-e190c9a92728 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:45.214214 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c6e8ca47-9f18-49ef-9670-e190c9a92728 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:45.214651 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c6e8ca47-9f18-49ef-9670-e190c9a92728 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:45.215411 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c6e8ca47-9f18-49ef-9670-e190c9a92728 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:45.215857 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c6e8ca47-9f18-49ef-9670-e190c9a92728 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:45.274915 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c6e8ca47-9f18-49ef-9670-e190c9a92728 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:45.282507 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c6e8ca47-9f18-49ef-9670-e190c9a92728 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079594 Feb 21 01:41:45.283226 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1057/2137] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:45 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:46.299516 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1dbaa8e8-01ae-4521-855c-8fb3f11f1ff2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:46.300526 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1dbaa8e8-01ae-4521-855c-8fb3f11f1ff2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:46.306909 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1dbaa8e8-01ae-4521-855c-8fb3f11f1ff2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:46.307365 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1dbaa8e8-01ae-4521-855c-8fb3f11f1ff2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:46.308212 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1dbaa8e8-01ae-4521-855c-8fb3f11f1ff2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:46.308653 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1dbaa8e8-01ae-4521-855c-8fb3f11f1ff2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:46.371006 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1dbaa8e8-01ae-4521-855c-8fb3f11f1ff2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:46.379307 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1dbaa8e8-01ae-4521-855c-8fb3f11f1ff2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084026 Feb 21 01:41:46.379893 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1081/2138] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:46 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:47.395899 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f0a70532-dd4f-48f5-aead-3ca4414d011c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:47.396516 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f0a70532-dd4f-48f5-aead-3ca4414d011c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:47.402844 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f0a70532-dd4f-48f5-aead-3ca4414d011c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:47.403325 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f0a70532-dd4f-48f5-aead-3ca4414d011c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:47.404126 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f0a70532-dd4f-48f5-aead-3ca4414d011c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:47.404571 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f0a70532-dd4f-48f5-aead-3ca4414d011c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:47.465543 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f0a70532-dd4f-48f5-aead-3ca4414d011c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:47.474027 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f0a70532-dd4f-48f5-aead-3ca4414d011c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082063 Feb 21 01:41:47.474610 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1058/2139] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:47 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:48.490447 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-924739fb-d82f-44a8-b8b8-9c8ee28cc8db tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:48.491065 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-924739fb-d82f-44a8-b8b8-9c8ee28cc8db tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:48.497288 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-924739fb-d82f-44a8-b8b8-9c8ee28cc8db tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:48.497739 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-924739fb-d82f-44a8-b8b8-9c8ee28cc8db tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:48.498518 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-924739fb-d82f-44a8-b8b8-9c8ee28cc8db tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:48.498956 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-924739fb-d82f-44a8-b8b8-9c8ee28cc8db tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:48.558689 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-924739fb-d82f-44a8-b8b8-9c8ee28cc8db tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:48.567017 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-924739fb-d82f-44a8-b8b8-9c8ee28cc8db tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081109 Feb 21 01:41:48.567559 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1082/2140] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:48 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:49.583619 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4f11ab02-0f45-4947-989f-48678cecce08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:49.584270 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4f11ab02-0f45-4947-989f-48678cecce08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:49.590530 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4f11ab02-0f45-4947-989f-48678cecce08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:49.590980 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4f11ab02-0f45-4947-989f-48678cecce08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:49.591764 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4f11ab02-0f45-4947-989f-48678cecce08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:49.592224 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4f11ab02-0f45-4947-989f-48678cecce08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:49.653424 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4f11ab02-0f45-4947-989f-48678cecce08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:49.662086 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4f11ab02-0f45-4947-989f-48678cecce08 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082561 Feb 21 01:41:49.662653 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1059/2141] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:49 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:50.679076 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8e27baf6-0540-4406-83c6-3ac1bac512f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:50.679686 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8e27baf6-0540-4406-83c6-3ac1bac512f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:50.685970 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8e27baf6-0540-4406-83c6-3ac1bac512f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:50.686455 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8e27baf6-0540-4406-83c6-3ac1bac512f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:50.687226 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8e27baf6-0540-4406-83c6-3ac1bac512f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:50.687659 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8e27baf6-0540-4406-83c6-3ac1bac512f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:50.746554 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8e27baf6-0540-4406-83c6-3ac1bac512f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:50.754224 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8e27baf6-0540-4406-83c6-3ac1bac512f1 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078784 Feb 21 01:41:50.754779 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1083/2142] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:50 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:51.771091 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-15c6e9e8-3bcb-4390-b498-d2d85485e127 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:51.771733 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-15c6e9e8-3bcb-4390-b498-d2d85485e127 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:51.777926 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-15c6e9e8-3bcb-4390-b498-d2d85485e127 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:51.778368 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-15c6e9e8-3bcb-4390-b498-d2d85485e127 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:51.779138 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-15c6e9e8-3bcb-4390-b498-d2d85485e127 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:51.779567 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-15c6e9e8-3bcb-4390-b498-d2d85485e127 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:51.842428 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-15c6e9e8-3bcb-4390-b498-d2d85485e127 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:51.851012 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-15c6e9e8-3bcb-4390-b498-d2d85485e127 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083653 Feb 21 01:41:51.851570 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1060/2143] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:51 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:52.867608 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ba3fcc6e-628e-4470-b408-e47b01f0139d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:52.868248 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ba3fcc6e-628e-4470-b408-e47b01f0139d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:52.874630 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ba3fcc6e-628e-4470-b408-e47b01f0139d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:52.875083 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ba3fcc6e-628e-4470-b408-e47b01f0139d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:52.875937 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ba3fcc6e-628e-4470-b408-e47b01f0139d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:52.876448 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ba3fcc6e-628e-4470-b408-e47b01f0139d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:52.935814 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ba3fcc6e-628e-4470-b408-e47b01f0139d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:52.943509 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ba3fcc6e-628e-4470-b408-e47b01f0139d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079613 Feb 21 01:41:52.944096 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1084/2144] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:52 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:53.960052 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d16dbf8e-74ed-4ecf-93d6-d515488d9bab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:53.960679 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d16dbf8e-74ed-4ecf-93d6-d515488d9bab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:53.966847 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d16dbf8e-74ed-4ecf-93d6-d515488d9bab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:53.967294 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d16dbf8e-74ed-4ecf-93d6-d515488d9bab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:53.968091 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d16dbf8e-74ed-4ecf-93d6-d515488d9bab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:53.968530 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d16dbf8e-74ed-4ecf-93d6-d515488d9bab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:54.028274 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d16dbf8e-74ed-4ecf-93d6-d515488d9bab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:54.036504 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d16dbf8e-74ed-4ecf-93d6-d515488d9bab tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080357 Feb 21 01:41:54.037066 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1061/2145] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:53 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:55.053012 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-27f75c82-c30c-4b91-b355-0e07f42263ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:55.053637 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-27f75c82-c30c-4b91-b355-0e07f42263ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:55.059856 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-27f75c82-c30c-4b91-b355-0e07f42263ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:55.060321 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-27f75c82-c30c-4b91-b355-0e07f42263ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:55.061108 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-27f75c82-c30c-4b91-b355-0e07f42263ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:55.061543 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-27f75c82-c30c-4b91-b355-0e07f42263ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:55.121480 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-27f75c82-c30c-4b91-b355-0e07f42263ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:55.129717 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-27f75c82-c30c-4b91-b355-0e07f42263ff tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080416 Feb 21 01:41:55.130279 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1085/2146] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:55 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:56.146843 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cac2924f-e83c-4305-9671-f7df003c3a64 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:56.147451 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cac2924f-e83c-4305-9671-f7df003c3a64 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:56.153672 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cac2924f-e83c-4305-9671-f7df003c3a64 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:56.154115 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cac2924f-e83c-4305-9671-f7df003c3a64 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:56.154878 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cac2924f-e83c-4305-9671-f7df003c3a64 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:56.155305 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cac2924f-e83c-4305-9671-f7df003c3a64 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:56.215011 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cac2924f-e83c-4305-9671-f7df003c3a64 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:56.223610 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cac2924f-e83c-4305-9671-f7df003c3a64 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080690 Feb 21 01:41:56.224194 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1062/2147] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:56 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:57.240406 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5f6f6fec-a1a7-439a-9427-131ebde0824c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:57.241030 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5f6f6fec-a1a7-439a-9427-131ebde0824c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:57.247283 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5f6f6fec-a1a7-439a-9427-131ebde0824c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:57.247746 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5f6f6fec-a1a7-439a-9427-131ebde0824c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:57.248564 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5f6f6fec-a1a7-439a-9427-131ebde0824c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:57.249004 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5f6f6fec-a1a7-439a-9427-131ebde0824c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:57.315761 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5f6f6fec-a1a7-439a-9427-131ebde0824c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:57.323544 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5f6f6fec-a1a7-439a-9427-131ebde0824c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.086812 Feb 21 01:41:57.324144 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1086/2148] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:57 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:58.339967 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6e9c6149-8a0f-4a52-866d-bbf09c69fdc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:58.340574 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6e9c6149-8a0f-4a52-866d-bbf09c69fdc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:58.347600 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6e9c6149-8a0f-4a52-866d-bbf09c69fdc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:58.348067 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6e9c6149-8a0f-4a52-866d-bbf09c69fdc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:58.348841 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6e9c6149-8a0f-4a52-866d-bbf09c69fdc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:58.349274 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6e9c6149-8a0f-4a52-866d-bbf09c69fdc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:58.412756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6e9c6149-8a0f-4a52-866d-bbf09c69fdc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:58.420628 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6e9c6149-8a0f-4a52-866d-bbf09c69fdc8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084399 Feb 21 01:41:58.421189 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1063/2149] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:58 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:59.437608 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e5656129-27fc-420e-aadb-f4bde4069118 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:59.438287 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e5656129-27fc-420e-aadb-f4bde4069118 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:59.444753 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e5656129-27fc-420e-aadb-f4bde4069118 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:59.445207 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e5656129-27fc-420e-aadb-f4bde4069118 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:59.445994 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e5656129-27fc-420e-aadb-f4bde4069118 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:59.446429 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e5656129-27fc-420e-aadb-f4bde4069118 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:59.507825 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e5656129-27fc-420e-aadb-f4bde4069118 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:59.518492 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e5656129-27fc-420e-aadb-f4bde4069118 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081671 Feb 21 01:41:59.518492 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1087/2150] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:59 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:00.532318 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b99e0732-4c3c-4ae2-ad39-a5d798d363c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:00.532989 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b99e0732-4c3c-4ae2-ad39-a5d798d363c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:00.539162 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b99e0732-4c3c-4ae2-ad39-a5d798d363c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:00.539617 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b99e0732-4c3c-4ae2-ad39-a5d798d363c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:00.540430 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b99e0732-4c3c-4ae2-ad39-a5d798d363c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:00.540869 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b99e0732-4c3c-4ae2-ad39-a5d798d363c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:00.603792 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b99e0732-4c3c-4ae2-ad39-a5d798d363c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:00.612524 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b99e0732-4c3c-4ae2-ad39-a5d798d363c4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084094 Feb 21 01:42:00.613085 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1064/2151] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:00 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:01.629391 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-12cbdf59-47f4-4193-ae38-72e175e42580 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:01.629975 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-12cbdf59-47f4-4193-ae38-72e175e42580 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:01.636242 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-12cbdf59-47f4-4193-ae38-72e175e42580 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:01.636692 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-12cbdf59-47f4-4193-ae38-72e175e42580 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:01.637503 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-12cbdf59-47f4-4193-ae38-72e175e42580 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:01.637938 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-12cbdf59-47f4-4193-ae38-72e175e42580 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:01.698603 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-12cbdf59-47f4-4193-ae38-72e175e42580 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:01.707150 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-12cbdf59-47f4-4193-ae38-72e175e42580 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082469 Feb 21 01:42:01.707706 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1088/2152] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:01 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:02.724442 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2b463a52-f709-48e1-9d7d-1696c60c9776 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:02.725077 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2b463a52-f709-48e1-9d7d-1696c60c9776 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:02.731229 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b463a52-f709-48e1-9d7d-1696c60c9776 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:02.731679 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b463a52-f709-48e1-9d7d-1696c60c9776 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:02.732476 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b463a52-f709-48e1-9d7d-1696c60c9776 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:02.732906 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2b463a52-f709-48e1-9d7d-1696c60c9776 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:02.793624 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2b463a52-f709-48e1-9d7d-1696c60c9776 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:02.801549 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2b463a52-f709-48e1-9d7d-1696c60c9776 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081052 Feb 21 01:42:02.802132 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1065/2153] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:02 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:03.202764 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:42:03.203539 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:42:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:42:03.818293 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-19121284-c8a4-4b2e-b3ad-892569d6e956 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:03.818829 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-19121284-c8a4-4b2e-b3ad-892569d6e956 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:03.825047 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-19121284-c8a4-4b2e-b3ad-892569d6e956 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:03.825500 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-19121284-c8a4-4b2e-b3ad-892569d6e956 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:03.826271 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-19121284-c8a4-4b2e-b3ad-892569d6e956 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:03.826704 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-19121284-c8a4-4b2e-b3ad-892569d6e956 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:03.887532 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-19121284-c8a4-4b2e-b3ad-892569d6e956 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:03.895330 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-19121284-c8a4-4b2e-b3ad-892569d6e956 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081032 Feb 21 01:42:03.895896 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1089/2154] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:03 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:04.912740 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-98e0f706-fbcf-4d66-82c2-6d1c5eb33926 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:04.913361 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-98e0f706-fbcf-4d66-82c2-6d1c5eb33926 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:04.919320 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-98e0f706-fbcf-4d66-82c2-6d1c5eb33926 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:04.919770 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-98e0f706-fbcf-4d66-82c2-6d1c5eb33926 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:04.920573 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-98e0f706-fbcf-4d66-82c2-6d1c5eb33926 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:04.921010 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-98e0f706-fbcf-4d66-82c2-6d1c5eb33926 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:04.983898 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-98e0f706-fbcf-4d66-82c2-6d1c5eb33926 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:04.992018 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-98e0f706-fbcf-4d66-82c2-6d1c5eb33926 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083433 Feb 21 01:42:04.992575 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1066/2155] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:04 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:06.008350 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c095500e-e33a-4c8f-8d04-68a7e2a12074 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:06.008973 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c095500e-e33a-4c8f-8d04-68a7e2a12074 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:06.015046 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c095500e-e33a-4c8f-8d04-68a7e2a12074 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:06.015494 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c095500e-e33a-4c8f-8d04-68a7e2a12074 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:06.016291 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c095500e-e33a-4c8f-8d04-68a7e2a12074 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:06.016719 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c095500e-e33a-4c8f-8d04-68a7e2a12074 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:06.075417 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c095500e-e33a-4c8f-8d04-68a7e2a12074 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:06.083631 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c095500e-e33a-4c8f-8d04-68a7e2a12074 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078918 Feb 21 01:42:06.084368 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1090/2156] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:06 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:07.100459 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-60ebe663-62d4-496e-b89f-7fa927629550 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:07.101056 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-60ebe663-62d4-496e-b89f-7fa927629550 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:07.107185 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-60ebe663-62d4-496e-b89f-7fa927629550 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:07.107626 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-60ebe663-62d4-496e-b89f-7fa927629550 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:07.108423 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-60ebe663-62d4-496e-b89f-7fa927629550 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:07.108845 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-60ebe663-62d4-496e-b89f-7fa927629550 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:07.167496 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-60ebe663-62d4-496e-b89f-7fa927629550 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:07.175666 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-60ebe663-62d4-496e-b89f-7fa927629550 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078884 Feb 21 01:42:07.176254 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1067/2157] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:07 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:42:08.192612 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-99870197-7d05-4586-98fb-2f9360acec05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:08.193223 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-99870197-7d05-4586-98fb-2f9360acec05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:08.199030 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-99870197-7d05-4586-98fb-2f9360acec05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:08.199480 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-99870197-7d05-4586-98fb-2f9360acec05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:08.200284 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-99870197-7d05-4586-98fb-2f9360acec05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:08.200719 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-99870197-7d05-4586-98fb-2f9360acec05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:08.259941 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-99870197-7d05-4586-98fb-2f9360acec05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:08.268516 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-99870197-7d05-4586-98fb-2f9360acec05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080082 Feb 21 01:42:08.269042 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1091/2158] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:08 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:09.285434 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c1497007-58c2-4a9b-8f7c-d9761b0222b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:09.286045 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c1497007-58c2-4a9b-8f7c-d9761b0222b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:09.292240 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c1497007-58c2-4a9b-8f7c-d9761b0222b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:09.292688 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c1497007-58c2-4a9b-8f7c-d9761b0222b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:09.293456 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c1497007-58c2-4a9b-8f7c-d9761b0222b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:09.293886 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c1497007-58c2-4a9b-8f7c-d9761b0222b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:09.356557 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c1497007-58c2-4a9b-8f7c-d9761b0222b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:09.365596 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c1497007-58c2-4a9b-8f7c-d9761b0222b8 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084439 Feb 21 01:42:09.366164 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1068/2159] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:09 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:10.382778 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-346a62c2-5171-4ea1-9a54-9f8295660617 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:10.383393 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-346a62c2-5171-4ea1-9a54-9f8295660617 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:10.389653 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-346a62c2-5171-4ea1-9a54-9f8295660617 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:10.390107 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-346a62c2-5171-4ea1-9a54-9f8295660617 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:10.390886 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-346a62c2-5171-4ea1-9a54-9f8295660617 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:10.391323 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-346a62c2-5171-4ea1-9a54-9f8295660617 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:10.454748 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-346a62c2-5171-4ea1-9a54-9f8295660617 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:10.462538 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-346a62c2-5171-4ea1-9a54-9f8295660617 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083438 Feb 21 01:42:10.463093 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1092/2160] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:10 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:11.480108 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d47df4fa-eced-4398-8091-db00db9e56c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:11.480716 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d47df4fa-eced-4398-8091-db00db9e56c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:11.487616 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d47df4fa-eced-4398-8091-db00db9e56c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:11.488096 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d47df4fa-eced-4398-8091-db00db9e56c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:11.488878 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d47df4fa-eced-4398-8091-db00db9e56c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:11.489341 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d47df4fa-eced-4398-8091-db00db9e56c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:11.548678 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d47df4fa-eced-4398-8091-db00db9e56c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:11.556350 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d47df4fa-eced-4398-8091-db00db9e56c6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080032 Feb 21 01:42:11.556906 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1069/2161] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:11 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:12.573331 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-cfd44491-a022-485d-90ee-1d3c1a4ae4d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:12.573945 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-cfd44491-a022-485d-90ee-1d3c1a4ae4d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:12.580265 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cfd44491-a022-485d-90ee-1d3c1a4ae4d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:12.580713 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cfd44491-a022-485d-90ee-1d3c1a4ae4d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:12.581487 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cfd44491-a022-485d-90ee-1d3c1a4ae4d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:12.581916 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cfd44491-a022-485d-90ee-1d3c1a4ae4d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:12.642618 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-cfd44491-a022-485d-90ee-1d3c1a4ae4d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:12.650231 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-cfd44491-a022-485d-90ee-1d3c1a4ae4d9 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080520 Feb 21 01:42:12.650779 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1093/2162] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:12 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:13.666757 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-40a1bc94-b0f5-463d-938a-83f47b1464e6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:13.667328 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-40a1bc94-b0f5-463d-938a-83f47b1464e6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:13.674283 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-40a1bc94-b0f5-463d-938a-83f47b1464e6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:13.674734 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-40a1bc94-b0f5-463d-938a-83f47b1464e6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:13.675510 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-40a1bc94-b0f5-463d-938a-83f47b1464e6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:13.675977 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-40a1bc94-b0f5-463d-938a-83f47b1464e6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:13.734155 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-40a1bc94-b0f5-463d-938a-83f47b1464e6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:13.746441 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-40a1bc94-b0f5-463d-938a-83f47b1464e6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083168 Feb 21 01:42:13.747424 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1070/2163] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:13 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:14.763582 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d754b13b-1e51-46fa-a7bf-82ac9fe15f05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:14.764343 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d754b13b-1e51-46fa-a7bf-82ac9fe15f05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:14.771695 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d754b13b-1e51-46fa-a7bf-82ac9fe15f05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:14.772423 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d754b13b-1e51-46fa-a7bf-82ac9fe15f05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:14.773217 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d754b13b-1e51-46fa-a7bf-82ac9fe15f05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:14.773657 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d754b13b-1e51-46fa-a7bf-82ac9fe15f05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:14.834547 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d754b13b-1e51-46fa-a7bf-82ac9fe15f05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:14.842205 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d754b13b-1e51-46fa-a7bf-82ac9fe15f05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082443 Feb 21 01:42:14.842758 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1094/2164] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:14 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:15.859561 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5c6368dc-76b5-47db-9500-9502e15b5035 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:15.860275 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5c6368dc-76b5-47db-9500-9502e15b5035 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:15.866509 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c6368dc-76b5-47db-9500-9502e15b5035 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:15.866956 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c6368dc-76b5-47db-9500-9502e15b5035 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:15.867736 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c6368dc-76b5-47db-9500-9502e15b5035 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:15.868192 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5c6368dc-76b5-47db-9500-9502e15b5035 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:15.928432 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5c6368dc-76b5-47db-9500-9502e15b5035 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:15.936133 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5c6368dc-76b5-47db-9500-9502e15b5035 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080206 Feb 21 01:42:15.936688 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1071/2165] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:15 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:16.952784 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d76dd7c8-4cf0-4cdb-8cbe-fb56c4092427 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:16.953404 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d76dd7c8-4cf0-4cdb-8cbe-fb56c4092427 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:16.960709 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d76dd7c8-4cf0-4cdb-8cbe-fb56c4092427 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:16.961162 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d76dd7c8-4cf0-4cdb-8cbe-fb56c4092427 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:16.961983 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d76dd7c8-4cf0-4cdb-8cbe-fb56c4092427 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:16.962424 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d76dd7c8-4cf0-4cdb-8cbe-fb56c4092427 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:17.024383 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d76dd7c8-4cf0-4cdb-8cbe-fb56c4092427 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:17.032801 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d76dd7c8-4cf0-4cdb-8cbe-fb56c4092427 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083225 Feb 21 01:42:17.033447 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1095/2166] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:16 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:18.049677 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-911f8038-cf23-443c-85c5-2b7d61bf6bba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:18.050290 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-911f8038-cf23-443c-85c5-2b7d61bf6bba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:18.056535 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-911f8038-cf23-443c-85c5-2b7d61bf6bba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:18.056996 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-911f8038-cf23-443c-85c5-2b7d61bf6bba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:18.057765 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-911f8038-cf23-443c-85c5-2b7d61bf6bba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:18.058207 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-911f8038-cf23-443c-85c5-2b7d61bf6bba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:18.120367 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-911f8038-cf23-443c-85c5-2b7d61bf6bba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:18.128047 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-911f8038-cf23-443c-85c5-2b7d61bf6bba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082584 Feb 21 01:42:18.128610 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1072/2167] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:18 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:19.144562 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c0065b6c-5d37-4712-9d4a-70a9a50b97af tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:19.145163 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c0065b6c-5d37-4712-9d4a-70a9a50b97af tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:19.151339 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c0065b6c-5d37-4712-9d4a-70a9a50b97af tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:19.151787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c0065b6c-5d37-4712-9d4a-70a9a50b97af tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:19.152597 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c0065b6c-5d37-4712-9d4a-70a9a50b97af tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:19.153038 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c0065b6c-5d37-4712-9d4a-70a9a50b97af tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:19.212373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c0065b6c-5d37-4712-9d4a-70a9a50b97af tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:19.220145 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c0065b6c-5d37-4712-9d4a-70a9a50b97af tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079459 Feb 21 01:42:19.220961 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1096/2168] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:19 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:20.237404 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-85a139a9-8fcc-47c8-8479-841379d20f4d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:20.238015 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-85a139a9-8fcc-47c8-8479-841379d20f4d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:20.244385 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-85a139a9-8fcc-47c8-8479-841379d20f4d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:20.244839 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-85a139a9-8fcc-47c8-8479-841379d20f4d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:20.245620 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-85a139a9-8fcc-47c8-8479-841379d20f4d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:20.246056 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-85a139a9-8fcc-47c8-8479-841379d20f4d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:20.306734 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-85a139a9-8fcc-47c8-8479-841379d20f4d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:20.315344 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-85a139a9-8fcc-47c8-8479-841379d20f4d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082146 Feb 21 01:42:20.315924 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1073/2169] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:20 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:21.331195 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-246428f1-bf32-41ea-a82e-d43fdecb05b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:21.331815 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-246428f1-bf32-41ea-a82e-d43fdecb05b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:21.338039 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-246428f1-bf32-41ea-a82e-d43fdecb05b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:21.338490 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-246428f1-bf32-41ea-a82e-d43fdecb05b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:21.339269 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-246428f1-bf32-41ea-a82e-d43fdecb05b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:21.339729 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-246428f1-bf32-41ea-a82e-d43fdecb05b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:21.399632 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-246428f1-bf32-41ea-a82e-d43fdecb05b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:21.407887 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-246428f1-bf32-41ea-a82e-d43fdecb05b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080592 Feb 21 01:42:21.408481 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1097/2170] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:21 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:22.425144 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-78ec9ff5-1922-47e9-9a3f-4eb301c87755 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:22.425704 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-78ec9ff5-1922-47e9-9a3f-4eb301c87755 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:22.431823 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-78ec9ff5-1922-47e9-9a3f-4eb301c87755 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:22.432293 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-78ec9ff5-1922-47e9-9a3f-4eb301c87755 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:22.433055 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-78ec9ff5-1922-47e9-9a3f-4eb301c87755 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:22.433478 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-78ec9ff5-1922-47e9-9a3f-4eb301c87755 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:22.493123 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-78ec9ff5-1922-47e9-9a3f-4eb301c87755 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:22.501357 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-78ec9ff5-1922-47e9-9a3f-4eb301c87755 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079914 Feb 21 01:42:22.502025 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1074/2171] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:22 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:23.517935 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2e47bb21-f634-4ac3-aab7-6e8acb409566 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:23.518550 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2e47bb21-f634-4ac3-aab7-6e8acb409566 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:23.524871 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e47bb21-f634-4ac3-aab7-6e8acb409566 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:23.525323 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e47bb21-f634-4ac3-aab7-6e8acb409566 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:23.526100 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e47bb21-f634-4ac3-aab7-6e8acb409566 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:23.526538 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e47bb21-f634-4ac3-aab7-6e8acb409566 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:23.590514 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2e47bb21-f634-4ac3-aab7-6e8acb409566 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:23.599124 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2e47bb21-f634-4ac3-aab7-6e8acb409566 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.085409 Feb 21 01:42:23.599678 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1098/2172] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:23 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:24.616355 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-276036b2-e7f3-49b1-bdfe-4b94a24ddc05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:24.616967 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-276036b2-e7f3-49b1-bdfe-4b94a24ddc05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:24.623249 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-276036b2-e7f3-49b1-bdfe-4b94a24ddc05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:24.623698 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-276036b2-e7f3-49b1-bdfe-4b94a24ddc05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:24.624507 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-276036b2-e7f3-49b1-bdfe-4b94a24ddc05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:24.624937 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-276036b2-e7f3-49b1-bdfe-4b94a24ddc05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:24.685111 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-276036b2-e7f3-49b1-bdfe-4b94a24ddc05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:24.693714 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-276036b2-e7f3-49b1-bdfe-4b94a24ddc05 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081058 Feb 21 01:42:24.694274 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1075/2173] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:24 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:25.710520 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c4804c8a-59f0-461d-845e-c1d0ec0a1342 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:25.711079 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c4804c8a-59f0-461d-845e-c1d0ec0a1342 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:25.717271 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c4804c8a-59f0-461d-845e-c1d0ec0a1342 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:25.717714 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c4804c8a-59f0-461d-845e-c1d0ec0a1342 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:25.718484 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c4804c8a-59f0-461d-845e-c1d0ec0a1342 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:25.718934 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c4804c8a-59f0-461d-845e-c1d0ec0a1342 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:25.777987 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c4804c8a-59f0-461d-845e-c1d0ec0a1342 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:25.785774 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c4804c8a-59f0-461d-845e-c1d0ec0a1342 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078987 Feb 21 01:42:25.786345 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1099/2174] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:25 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:26.802787 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-81e199b5-ee5a-42cb-bc5c-cc577e914925 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:26.803380 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-81e199b5-ee5a-42cb-bc5c-cc577e914925 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:26.809572 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-81e199b5-ee5a-42cb-bc5c-cc577e914925 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:26.810022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-81e199b5-ee5a-42cb-bc5c-cc577e914925 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:26.810818 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-81e199b5-ee5a-42cb-bc5c-cc577e914925 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:26.811249 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-81e199b5-ee5a-42cb-bc5c-cc577e914925 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:26.872597 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-81e199b5-ee5a-42cb-bc5c-cc577e914925 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:26.881442 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-81e199b5-ee5a-42cb-bc5c-cc577e914925 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082303 Feb 21 01:42:26.881999 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1076/2175] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:26 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:27.897676 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-aad6be85-814f-4755-87d8-3384f3b6c957 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:27.898300 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-aad6be85-814f-4755-87d8-3384f3b6c957 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:27.904533 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aad6be85-814f-4755-87d8-3384f3b6c957 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:27.904983 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aad6be85-814f-4755-87d8-3384f3b6c957 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:27.905764 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aad6be85-814f-4755-87d8-3384f3b6c957 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:27.906204 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aad6be85-814f-4755-87d8-3384f3b6c957 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:27.965369 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-aad6be85-814f-4755-87d8-3384f3b6c957 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:27.973538 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-aad6be85-814f-4755-87d8-3384f3b6c957 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079496 Feb 21 01:42:27.974098 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1100/2176] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:27 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:28.990351 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-52ab88c6-ea77-44ea-85ee-092b834dcb0b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:28.990971 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-52ab88c6-ea77-44ea-85ee-092b834dcb0b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:28.997306 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-52ab88c6-ea77-44ea-85ee-092b834dcb0b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:28.997756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-52ab88c6-ea77-44ea-85ee-092b834dcb0b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:28.998531 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-52ab88c6-ea77-44ea-85ee-092b834dcb0b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:28.998970 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-52ab88c6-ea77-44ea-85ee-092b834dcb0b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:29.058211 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-52ab88c6-ea77-44ea-85ee-092b834dcb0b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:29.066235 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-52ab88c6-ea77-44ea-85ee-092b834dcb0b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079605 Feb 21 01:42:29.066803 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1077/2177] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:28 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:30.082669 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e52149d5-6037-4be2-857b-eebfab3c7f58 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:30.083288 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e52149d5-6037-4be2-857b-eebfab3c7f58 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:30.089551 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e52149d5-6037-4be2-857b-eebfab3c7f58 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:30.090011 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e52149d5-6037-4be2-857b-eebfab3c7f58 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:30.090787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e52149d5-6037-4be2-857b-eebfab3c7f58 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:30.091225 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e52149d5-6037-4be2-857b-eebfab3c7f58 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:30.152234 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e52149d5-6037-4be2-857b-eebfab3c7f58 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:30.160902 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e52149d5-6037-4be2-857b-eebfab3c7f58 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082074 Feb 21 01:42:30.161459 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1101/2178] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:30 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:31.177707 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7b4a8f5c-7d66-4129-b2cb-25a027f2912c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:31.178315 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7b4a8f5c-7d66-4129-b2cb-25a027f2912c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:31.188155 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7b4a8f5c-7d66-4129-b2cb-25a027f2912c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:31.188560 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7b4a8f5c-7d66-4129-b2cb-25a027f2912c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:31.189356 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7b4a8f5c-7d66-4129-b2cb-25a027f2912c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:31.189894 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7b4a8f5c-7d66-4129-b2cb-25a027f2912c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:31.248283 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7b4a8f5c-7d66-4129-b2cb-25a027f2912c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:31.256595 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7b4a8f5c-7d66-4129-b2cb-25a027f2912c tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082577 Feb 21 01:42:31.257155 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1078/2179] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:31 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:32.273090 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-eb596f65-981a-4054-b8ca-5d2a3d79ca0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:32.273707 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-eb596f65-981a-4054-b8ca-5d2a3d79ca0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:32.280003 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eb596f65-981a-4054-b8ca-5d2a3d79ca0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:32.280458 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eb596f65-981a-4054-b8ca-5d2a3d79ca0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:32.281767 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eb596f65-981a-4054-b8ca-5d2a3d79ca0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:32.282207 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eb596f65-981a-4054-b8ca-5d2a3d79ca0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:32.340086 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-eb596f65-981a-4054-b8ca-5d2a3d79ca0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:32.349044 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-eb596f65-981a-4054-b8ca-5d2a3d79ca0d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079676 Feb 21 01:42:32.349599 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1102/2180] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:32 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:33.365770 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4a899d29-0128-496a-84be-94a13e050603 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:33.366405 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4a899d29-0128-496a-84be-94a13e050603 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:33.372654 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4a899d29-0128-496a-84be-94a13e050603 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:33.373094 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4a899d29-0128-496a-84be-94a13e050603 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:33.373852 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4a899d29-0128-496a-84be-94a13e050603 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:33.374283 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4a899d29-0128-496a-84be-94a13e050603 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:33.436439 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4a899d29-0128-496a-84be-94a13e050603 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:33.444942 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4a899d29-0128-496a-84be-94a13e050603 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082828 Feb 21 01:42:33.445496 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1079/2181] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:33 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:34.462004 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a9bbbb94-fd2f-4335-a852-d4ad90677e59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:34.462562 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a9bbbb94-fd2f-4335-a852-d4ad90677e59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:34.469570 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a9bbbb94-fd2f-4335-a852-d4ad90677e59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:34.470326 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a9bbbb94-fd2f-4335-a852-d4ad90677e59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:34.471091 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a9bbbb94-fd2f-4335-a852-d4ad90677e59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:34.471530 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a9bbbb94-fd2f-4335-a852-d4ad90677e59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:34.531598 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a9bbbb94-fd2f-4335-a852-d4ad90677e59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:34.539276 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a9bbbb94-fd2f-4335-a852-d4ad90677e59 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081071 Feb 21 01:42:34.539847 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1103/2182] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:34 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:35.555848 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c2e50517-be12-4801-ab4a-61f6ea7564cd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:35.556507 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c2e50517-be12-4801-ab4a-61f6ea7564cd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:35.562465 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c2e50517-be12-4801-ab4a-61f6ea7564cd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:35.562911 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c2e50517-be12-4801-ab4a-61f6ea7564cd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:35.563679 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c2e50517-be12-4801-ab4a-61f6ea7564cd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:35.564138 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c2e50517-be12-4801-ab4a-61f6ea7564cd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:35.625430 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c2e50517-be12-4801-ab4a-61f6ea7564cd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:35.633194 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c2e50517-be12-4801-ab4a-61f6ea7564cd tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081116 Feb 21 01:42:35.633754 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1080/2183] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:35 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:36.650571 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9d7c834d-3f13-41a1-9e4d-695eadbe051b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:36.651147 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-9d7c834d-3f13-41a1-9e4d-695eadbe051b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:36.657003 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d7c834d-3f13-41a1-9e4d-695eadbe051b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:36.658075 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d7c834d-3f13-41a1-9e4d-695eadbe051b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:36.659032 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d7c834d-3f13-41a1-9e4d-695eadbe051b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:36.659536 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-9d7c834d-3f13-41a1-9e4d-695eadbe051b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:36.723447 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-9d7c834d-3f13-41a1-9e4d-695eadbe051b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:36.731373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9d7c834d-3f13-41a1-9e4d-695eadbe051b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084821 Feb 21 01:42:36.734018 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1104/2184] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:36 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:37.747858 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8c3025a0-0035-41b8-8245-190ad2115eb6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:37.748463 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8c3025a0-0035-41b8-8245-190ad2115eb6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:37.754806 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8c3025a0-0035-41b8-8245-190ad2115eb6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:37.755259 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8c3025a0-0035-41b8-8245-190ad2115eb6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:37.756064 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8c3025a0-0035-41b8-8245-190ad2115eb6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:37.756503 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8c3025a0-0035-41b8-8245-190ad2115eb6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:37.816559 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8c3025a0-0035-41b8-8245-190ad2115eb6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:37.824289 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8c3025a0-0035-41b8-8245-190ad2115eb6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080076 Feb 21 01:42:37.824846 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1081/2185] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:37 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:38.840451 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8931aba2-0d58-41c7-b1c2-61d60eb449ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:38.841063 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8931aba2-0d58-41c7-b1c2-61d60eb449ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:38.847677 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8931aba2-0d58-41c7-b1c2-61d60eb449ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:38.848161 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8931aba2-0d58-41c7-b1c2-61d60eb449ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:38.848942 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8931aba2-0d58-41c7-b1c2-61d60eb449ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:38.849377 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8931aba2-0d58-41c7-b1c2-61d60eb449ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:38.909023 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8931aba2-0d58-41c7-b1c2-61d60eb449ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:38.916800 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8931aba2-0d58-41c7-b1c2-61d60eb449ba tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079979 Feb 21 01:42:38.917363 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1105/2186] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:38 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:39.933729 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f7f5ba6a-6512-44fe-aef1-c22e34187eec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:39.934315 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f7f5ba6a-6512-44fe-aef1-c22e34187eec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:39.941102 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f7f5ba6a-6512-44fe-aef1-c22e34187eec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:39.941549 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f7f5ba6a-6512-44fe-aef1-c22e34187eec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:39.942312 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f7f5ba6a-6512-44fe-aef1-c22e34187eec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:39.942738 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f7f5ba6a-6512-44fe-aef1-c22e34187eec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:40.001455 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f7f5ba6a-6512-44fe-aef1-c22e34187eec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:40.009175 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f7f5ba6a-6512-44fe-aef1-c22e34187eec tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079225 Feb 21 01:42:40.009727 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1082/2187] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:39 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:41.026213 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e6eed9d2-bad3-4ddd-b3d5-b753edd3d6b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:41.026825 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e6eed9d2-bad3-4ddd-b3d5-b753edd3d6b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:41.033246 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e6eed9d2-bad3-4ddd-b3d5-b753edd3d6b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:41.033692 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e6eed9d2-bad3-4ddd-b3d5-b753edd3d6b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:41.034462 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e6eed9d2-bad3-4ddd-b3d5-b753edd3d6b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:41.034919 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e6eed9d2-bad3-4ddd-b3d5-b753edd3d6b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:41.093739 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e6eed9d2-bad3-4ddd-b3d5-b753edd3d6b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:41.101679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e6eed9d2-bad3-4ddd-b3d5-b753edd3d6b6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079168 Feb 21 01:42:41.102233 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1106/2188] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:41 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:42.118250 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-11e57ffa-1c69-4e5d-af6c-95a06cdc48c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:42.118852 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-11e57ffa-1c69-4e5d-af6c-95a06cdc48c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:42.125092 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-11e57ffa-1c69-4e5d-af6c-95a06cdc48c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:42.125544 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-11e57ffa-1c69-4e5d-af6c-95a06cdc48c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:42.126859 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-11e57ffa-1c69-4e5d-af6c-95a06cdc48c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:42.127292 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-11e57ffa-1c69-4e5d-af6c-95a06cdc48c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:42.188654 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-11e57ffa-1c69-4e5d-af6c-95a06cdc48c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:42.196352 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-11e57ffa-1c69-4e5d-af6c-95a06cdc48c2 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081801 Feb 21 01:42:42.196904 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1083/2189] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:42 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:43.213383 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2d295b40-ee5a-4a55-b2d0-ed34f03d780a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:43.213981 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2d295b40-ee5a-4a55-b2d0-ed34f03d780a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:43.220619 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2d295b40-ee5a-4a55-b2d0-ed34f03d780a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:43.221074 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2d295b40-ee5a-4a55-b2d0-ed34f03d780a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:43.221857 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2d295b40-ee5a-4a55-b2d0-ed34f03d780a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:43.222292 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2d295b40-ee5a-4a55-b2d0-ed34f03d780a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:43.281019 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2d295b40-ee5a-4a55-b2d0-ed34f03d780a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:43.288901 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2d295b40-ee5a-4a55-b2d0-ed34f03d780a tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079095 Feb 21 01:42:43.289466 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1107/2190] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:43 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:44.117644 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:42:44.117925 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:42:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:42:44.305263 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3879e34d-387c-44a9-bf9f-05eb9ea64819 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:44.305849 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3879e34d-387c-44a9-bf9f-05eb9ea64819 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:44.312117 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3879e34d-387c-44a9-bf9f-05eb9ea64819 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:44.312566 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3879e34d-387c-44a9-bf9f-05eb9ea64819 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:44.313828 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3879e34d-387c-44a9-bf9f-05eb9ea64819 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:44.314255 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3879e34d-387c-44a9-bf9f-05eb9ea64819 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:44.376498 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3879e34d-387c-44a9-bf9f-05eb9ea64819 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:44.384123 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3879e34d-387c-44a9-bf9f-05eb9ea64819 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082485 Feb 21 01:42:44.384691 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1084/2191] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:44 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:45.401354 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-db12d354-8ca7-4f6c-a766-c3b93d7edd66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:45.401964 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-db12d354-8ca7-4f6c-a766-c3b93d7edd66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:45.408885 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db12d354-8ca7-4f6c-a766-c3b93d7edd66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:45.409337 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db12d354-8ca7-4f6c-a766-c3b93d7edd66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:45.410117 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db12d354-8ca7-4f6c-a766-c3b93d7edd66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:45.410551 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-db12d354-8ca7-4f6c-a766-c3b93d7edd66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:45.470683 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-db12d354-8ca7-4f6c-a766-c3b93d7edd66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:45.478364 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-db12d354-8ca7-4f6c-a766-c3b93d7edd66 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080739 Feb 21 01:42:45.478921 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1108/2192] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:45 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:46.494297 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a32e2178-1918-45a2-b173-f141ee8076f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:46.494934 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a32e2178-1918-45a2-b173-f141ee8076f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:46.501290 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a32e2178-1918-45a2-b173-f141ee8076f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:46.501729 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a32e2178-1918-45a2-b173-f141ee8076f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:46.502496 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a32e2178-1918-45a2-b173-f141ee8076f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:46.502919 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a32e2178-1918-45a2-b173-f141ee8076f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:46.561399 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a32e2178-1918-45a2-b173-f141ee8076f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:46.569167 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a32e2178-1918-45a2-b173-f141ee8076f6 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078562 Feb 21 01:42:46.569722 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1085/2193] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:46 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:47.586018 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a9b8bae3-dea6-427d-8810-1ab0fa122ef4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:47.586631 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a9b8bae3-dea6-427d-8810-1ab0fa122ef4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:47.592933 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a9b8bae3-dea6-427d-8810-1ab0fa122ef4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:47.593384 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a9b8bae3-dea6-427d-8810-1ab0fa122ef4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:47.594714 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a9b8bae3-dea6-427d-8810-1ab0fa122ef4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:47.595155 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a9b8bae3-dea6-427d-8810-1ab0fa122ef4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:47.653654 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a9b8bae3-dea6-427d-8810-1ab0fa122ef4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:47.661492 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a9b8bae3-dea6-427d-8810-1ab0fa122ef4 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079186 Feb 21 01:42:47.662046 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1109/2194] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:47 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:48.678408 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c0e838c2-3528-4baa-ad1a-e8e48155bf5e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:48.679025 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c0e838c2-3528-4baa-ad1a-e8e48155bf5e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:48.685345 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c0e838c2-3528-4baa-ad1a-e8e48155bf5e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:48.685802 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c0e838c2-3528-4baa-ad1a-e8e48155bf5e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:48.686720 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c0e838c2-3528-4baa-ad1a-e8e48155bf5e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:48.687156 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c0e838c2-3528-4baa-ad1a-e8e48155bf5e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:48.748908 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c0e838c2-3528-4baa-ad1a-e8e48155bf5e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:48.757505 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c0e838c2-3528-4baa-ad1a-e8e48155bf5e tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082848 Feb 21 01:42:48.758178 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1086/2195] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:48 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:49.774952 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-954ccd90-9794-4dd9-b366-706f01082a3d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:49.775564 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-954ccd90-9794-4dd9-b366-706f01082a3d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:49.782490 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-954ccd90-9794-4dd9-b366-706f01082a3d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:49.782943 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-954ccd90-9794-4dd9-b366-706f01082a3d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:49.783721 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-954ccd90-9794-4dd9-b366-706f01082a3d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:49.784196 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-954ccd90-9794-4dd9-b366-706f01082a3d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:49.847533 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-954ccd90-9794-4dd9-b366-706f01082a3d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:49.855274 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-954ccd90-9794-4dd9-b366-706f01082a3d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084044 Feb 21 01:42:49.855855 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1110/2196] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:49 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:50.871814 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-91db4315-50a4-464b-8b98-737c9698e934 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:50.872431 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-91db4315-50a4-464b-8b98-737c9698e934 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:50.879465 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-91db4315-50a4-464b-8b98-737c9698e934 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:50.879948 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-91db4315-50a4-464b-8b98-737c9698e934 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:50.880729 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-91db4315-50a4-464b-8b98-737c9698e934 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:50.881160 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-91db4315-50a4-464b-8b98-737c9698e934 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:50.940185 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-91db4315-50a4-464b-8b98-737c9698e934 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:50.947809 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-91db4315-50a4-464b-8b98-737c9698e934 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079696 Feb 21 01:42:50.948390 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1087/2197] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:50 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:51.964218 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-95a5557f-affa-4bce-8e92-9120be1f4167 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:51.964830 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-95a5557f-affa-4bce-8e92-9120be1f4167 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:51.971399 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-95a5557f-affa-4bce-8e92-9120be1f4167 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:51.971859 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-95a5557f-affa-4bce-8e92-9120be1f4167 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:51.972646 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-95a5557f-affa-4bce-8e92-9120be1f4167 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:51.973081 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-95a5557f-affa-4bce-8e92-9120be1f4167 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:52.033061 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-95a5557f-affa-4bce-8e92-9120be1f4167 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:52.040814 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-95a5557f-affa-4bce-8e92-9120be1f4167 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.080297 Feb 21 01:42:52.041374 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1111/2198] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:51 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:53.057447 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8b36baf6-4aff-4b3b-b3a8-f1e371717ef0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:53.058130 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8b36baf6-4aff-4b3b-b3a8-f1e371717ef0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:53.064594 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8b36baf6-4aff-4b3b-b3a8-f1e371717ef0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:53.065049 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8b36baf6-4aff-4b3b-b3a8-f1e371717ef0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:53.065871 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8b36baf6-4aff-4b3b-b3a8-f1e371717ef0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:53.066309 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8b36baf6-4aff-4b3b-b3a8-f1e371717ef0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:53.128047 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8b36baf6-4aff-4b3b-b3a8-f1e371717ef0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:53.135677 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8b36baf6-4aff-4b3b-b3a8-f1e371717ef0 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.081923 Feb 21 01:42:53.136265 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1088/2199] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:53 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:54.152545 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-102791c0-5e2c-460a-a312-c6517e08b9bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:54.153137 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-102791c0-5e2c-460a-a312-c6517e08b9bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:54.159541 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-102791c0-5e2c-460a-a312-c6517e08b9bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:54.160026 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-102791c0-5e2c-460a-a312-c6517e08b9bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:54.160805 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-102791c0-5e2c-460a-a312-c6517e08b9bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:54.161238 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-102791c0-5e2c-460a-a312-c6517e08b9bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:54.220327 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-102791c0-5e2c-460a-a312-c6517e08b9bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:54.227935 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-102791c0-5e2c-460a-a312-c6517e08b9bc tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.078979 Feb 21 01:42:54.228504 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1112/2200] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:54 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:55.244379 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0856c48d-e12d-4fc4-acf1-e71b148b8762 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:55.244994 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0856c48d-e12d-4fc4-acf1-e71b148b8762 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:55.251668 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0856c48d-e12d-4fc4-acf1-e71b148b8762 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:55.252149 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0856c48d-e12d-4fc4-acf1-e71b148b8762 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:55.252929 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0856c48d-e12d-4fc4-acf1-e71b148b8762 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:55.253367 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0856c48d-e12d-4fc4-acf1-e71b148b8762 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:55.312605 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0856c48d-e12d-4fc4-acf1-e71b148b8762 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:55.320400 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0856c48d-e12d-4fc4-acf1-e71b148b8762 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079692 Feb 21 01:42:55.320964 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1089/2201] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:55 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:56.337698 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7cca86b0-366f-4dd8-b521-492fe27166bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:56.338302 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7cca86b0-366f-4dd8-b521-492fe27166bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:56.344788 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7cca86b0-366f-4dd8-b521-492fe27166bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:56.345224 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7cca86b0-366f-4dd8-b521-492fe27166bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:56.345985 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7cca86b0-366f-4dd8-b521-492fe27166bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:56.346412 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7cca86b0-366f-4dd8-b521-492fe27166bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:56.405649 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7cca86b0-366f-4dd8-b521-492fe27166bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:56.413729 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7cca86b0-366f-4dd8-b521-492fe27166bb tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.079836 Feb 21 01:42:56.414282 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1113/2202] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:56 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:57.430354 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-51e830e1-fde4-4ebf-bf63-4f67df487088 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:57.430980 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-51e830e1-fde4-4ebf-bf63-4f67df487088 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:57.437423 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51e830e1-fde4-4ebf-bf63-4f67df487088 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:57.438427 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51e830e1-fde4-4ebf-bf63-4f67df487088 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:57.439201 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51e830e1-fde4-4ebf-bf63-4f67df487088 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:57.439630 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-51e830e1-fde4-4ebf-bf63-4f67df487088 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:57.502200 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-51e830e1-fde4-4ebf-bf63-4f67df487088 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:57.510120 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-51e830e1-fde4-4ebf-bf63-4f67df487088 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083452 Feb 21 01:42:57.510724 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1090/2203] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:57 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:58.526482 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-939bd8f6-8d47-4245-98b7-453e4723660f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:58.527074 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-939bd8f6-8d47-4245-98b7-453e4723660f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:58.533614 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-939bd8f6-8d47-4245-98b7-453e4723660f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:58.534062 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-939bd8f6-8d47-4245-98b7-453e4723660f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:58.534837 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-939bd8f6-8d47-4245-98b7-453e4723660f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:58.535272 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-939bd8f6-8d47-4245-98b7-453e4723660f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:58.597685 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-939bd8f6-8d47-4245-98b7-453e4723660f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:58.605369 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-939bd8f6-8d47-4245-98b7-453e4723660f tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082532 Feb 21 01:42:58.605927 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1114/2204] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:58 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:59.622655 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b508463a-647a-4ad3-a653-3ac1801e041b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:59.623417 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b508463a-647a-4ad3-a653-3ac1801e041b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:59.631787 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b508463a-647a-4ad3-a653-3ac1801e041b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:59.632259 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b508463a-647a-4ad3-a653-3ac1801e041b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:59.633037 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b508463a-647a-4ad3-a653-3ac1801e041b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:59.633467 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b508463a-647a-4ad3-a653-3ac1801e041b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:59.693741 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b508463a-647a-4ad3-a653-3ac1801e041b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:59.701447 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b508463a-647a-4ad3-a653-3ac1801e041b tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083316 Feb 21 01:42:59.702009 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1091/2205] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:59 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:00.718252 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f1865c25-22f9-44e0-8391-b4ebb2a7af2d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:00.720299 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f1865c25-22f9-44e0-8391-b4ebb2a7af2d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:00.726552 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f1865c25-22f9-44e0-8391-b4ebb2a7af2d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:00.727006 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f1865c25-22f9-44e0-8391-b4ebb2a7af2d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:00.727790 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f1865c25-22f9-44e0-8391-b4ebb2a7af2d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:00.728257 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f1865c25-22f9-44e0-8391-b4ebb2a7af2d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:00.789101 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f1865c25-22f9-44e0-8391-b4ebb2a7af2d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:00.797594 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f1865c25-22f9-44e0-8391-b4ebb2a7af2d tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082168 Feb 21 01:43:00.798157 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1115/2206] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:00 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:01.814775 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-13602a08-7774-4aa5-a1cd-8fcaf3330726 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:01.815409 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-13602a08-7774-4aa5-a1cd-8fcaf3330726 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:01.821695 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-13602a08-7774-4aa5-a1cd-8fcaf3330726 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:01.822138 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-13602a08-7774-4aa5-a1cd-8fcaf3330726 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:01.822912 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-13602a08-7774-4aa5-a1cd-8fcaf3330726 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:01.823344 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-13602a08-7774-4aa5-a1cd-8fcaf3330726 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:01.887768 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-13602a08-7774-4aa5-a1cd-8fcaf3330726 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:01.895637 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-13602a08-7774-4aa5-a1cd-8fcaf3330726 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.085198 Feb 21 01:43:01.896220 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1092/2207] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:01 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:02.912289 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-45b9b9cd-925a-4176-a020-1982dc39b231 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:02.912998 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-45b9b9cd-925a-4176-a020-1982dc39b231 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:02.919094 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-45b9b9cd-925a-4176-a020-1982dc39b231 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:02.919540 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-45b9b9cd-925a-4176-a020-1982dc39b231 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:02.920334 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-45b9b9cd-925a-4176-a020-1982dc39b231 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:02.920761 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-45b9b9cd-925a-4176-a020-1982dc39b231 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:02.983375 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-45b9b9cd-925a-4176-a020-1982dc39b231 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:02.991340 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-45b9b9cd-925a-4176-a020-1982dc39b231 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.083009 Feb 21 01:43:02.991910 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1116/2208] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:02 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:04.007341 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-76b86f5c-d814-4aee-a4c5-dc5e770fcbef tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:04.008007 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-76b86f5c-d814-4aee-a4c5-dc5e770fcbef tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:04.014181 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-76b86f5c-d814-4aee-a4c5-dc5e770fcbef tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:04.014625 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-76b86f5c-d814-4aee-a4c5-dc5e770fcbef tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:04.015452 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-76b86f5c-d814-4aee-a4c5-dc5e770fcbef tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:04.016084 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-76b86f5c-d814-4aee-a4c5-dc5e770fcbef tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:04.082021 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-76b86f5c-d814-4aee-a4c5-dc5e770fcbef tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:04.088175 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-76b86f5c-d814-4aee-a4c5-dc5e770fcbef tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.084438 Feb 21 01:43:04.088738 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1093/2209] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:04 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:05.104790 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a7f86de3-821b-42b0-b9e8-864c730d0000 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:05.105407 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a7f86de3-821b-42b0-b9e8-864c730d0000 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] [instance: 9c2b10b2-e67d-4479-9f7a-0ce69607b1ab] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:05.112786 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a7f86de3-821b-42b0-b9e8-864c730d0000 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:05.113239 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a7f86de3-821b-42b0-b9e8-864c730d0000 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:05.114065 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a7f86de3-821b-42b0-b9e8-864c730d0000 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:05.114505 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a7f86de3-821b-42b0-b9e8-864c730d0000 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:05.176156 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a7f86de3-821b-42b0-b9e8-864c730d0000 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8287f43e83034c0a80ee051456d502c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5cb0164f98741baba94fcc1b7709e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:05.183815 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a7f86de3-821b-42b0-b9e8-864c730d0000 tempest-ServerRescueNegativeTestJSON-374302779 tempest-ServerRescueNegativeTestJSON-374302779-project] 10.222.0.91 "GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab" status: 200 len: 1352 microversion: 2.1 time: 0.082751 Feb 21 01:43:05.184395 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1117/2210] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:05 2022] GET /compute/v2.1/servers/9c2b10b2-e67d-4479-9f7a-0ce69607b1ab => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:43:13.032188 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-032a9ed1-7f89-4a74-a6ba-3d1972aa2088 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1455962432", "imageRef": "9b96cc67-20b9-414f-8afb-039ff7953adc", "flavorRef": "452", "networks": [{"uuid": "ce8dae1f-c1c8-4a29-a9ef-ffb95022435c"}]}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:13.097365 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.network.neutron [None req-032a9ed1-7f89-4a74-a6ba-3d1972aa2088 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] validate_networks() for [('ce8dae1f-c1c8-4a29-a9ef-ffb95022435c', None, None, None, None, None)] {{(pid=117138) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:43:13.610066 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-032a9ed1-7f89-4a74-a6ba-3d1972aa2088 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Flavor limits 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:43:13.611011 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-032a9ed1-7f89-4a74-a6ba-3d1972aa2088 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Image limits 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:43:13.611664 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-032a9ed1-7f89-4a74-a6ba-3d1972aa2088 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Flavor pref 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:43:13.612276 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-032a9ed1-7f89-4a74-a6ba-3d1972aa2088 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Image pref 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:43:13.612965 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-032a9ed1-7f89-4a74-a6ba-3d1972aa2088 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:43:13.640404 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-032a9ed1-7f89-4a74-a6ba-3d1972aa2088 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:13.643411 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-032a9ed1-7f89-4a74-a6ba-3d1972aa2088 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:13.645282 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-032a9ed1-7f89-4a74-a6ba-3d1972aa2088 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:13.645971 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-032a9ed1-7f89-4a74-a6ba-3d1972aa2088 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:13.671198 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-032a9ed1-7f89-4a74-a6ba-3d1972aa2088 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Getting quotas for project f92cb7cf852c4790bb51e02de8b46c41. Resources: {'ram', 'cores', 'instances'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:43:13.675911 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-032a9ed1-7f89-4a74-a6ba-3d1972aa2088 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Getting quotas for user eef05bfef54c43ca8d0099ee98986766 and project f92cb7cf852c4790bb51e02de8b46c41. Resources: {'ram', 'cores', 'instances'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:43:13.688734 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-032a9ed1-7f89-4a74-a6ba-3d1972aa2088 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Going to run 1 instances... {{(pid=117138) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:43:13.691317 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-032a9ed1-7f89-4a74-a6ba-3d1972aa2088 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 1bf16190-01f9-45de-ab56-02f712ebe585] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b96cc67-20b9-414f-8afb-039ff7953adc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117138) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:43:13.849774 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-032a9ed1-7f89-4a74-a6ba-3d1972aa2088 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.821728 Feb 21 01:43:13.850760 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1094/2211] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Feb 21 01:43:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 21 01:43:13.861545 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-60e75c0a-c6f2-4b0d-b174-dcd06dad8d3b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:13.862715 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-60e75c0a-c6f2-4b0d-b174-dcd06dad8d3b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 1bf16190-01f9-45de-ab56-02f712ebe585] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:13.960843 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-60e75c0a-c6f2-4b0d-b174-dcd06dad8d3b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:13.967485 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-60e75c0a-c6f2-4b0d-b174-dcd06dad8d3b tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585" status: 200 len: 1219 microversion: 2.1 time: 0.110448 Feb 21 01:43:13.970410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1118/2212] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:13 2022] GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585 => generated 1219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:14.992948 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-de4f23d2-d765-4594-9b0a-95636bea79bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:14.993569 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-de4f23d2-d765-4594-9b0a-95636bea79bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 1bf16190-01f9-45de-ab56-02f712ebe585] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:15.006129 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-de4f23d2-d765-4594-9b0a-95636bea79bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:15.006834 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-de4f23d2-d765-4594-9b0a-95636bea79bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:15.012223 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-de4f23d2-d765-4594-9b0a-95636bea79bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:15.012223 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-de4f23d2-d765-4594-9b0a-95636bea79bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:15.110667 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-de4f23d2-d765-4594-9b0a-95636bea79bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:15.121306 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-de4f23d2-d765-4594-9b0a-95636bea79bb tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585" status: 200 len: 1223 microversion: 2.1 time: 0.136794 Feb 21 01:43:15.131453 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1095/2213] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:14 2022] GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585 => generated 1223 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:16.143427 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-316e7ecc-eb36-4412-a502-72b7bf96dfa1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:16.146955 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-316e7ecc-eb36-4412-a502-72b7bf96dfa1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 1bf16190-01f9-45de-ab56-02f712ebe585] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:16.156519 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-316e7ecc-eb36-4412-a502-72b7bf96dfa1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:16.157299 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-316e7ecc-eb36-4412-a502-72b7bf96dfa1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:16.158610 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-316e7ecc-eb36-4412-a502-72b7bf96dfa1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:16.159246 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-316e7ecc-eb36-4412-a502-72b7bf96dfa1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:16.265446 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-316e7ecc-eb36-4412-a502-72b7bf96dfa1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:16.275484 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-316e7ecc-eb36-4412-a502-72b7bf96dfa1 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585" status: 200 len: 1279 microversion: 2.1 time: 0.140725 Feb 21 01:43:16.277464 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1119/2214] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:16 2022] GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585 => generated 1279 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:16.561191 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-46bb8d90-2ae3-4396-825c-a31b99b7a141 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Action: 'create', calling method: .version_select at 0x7f4ace645820>, body: {"keypair": {"name": "tempest-keypair-594803392"}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:16.592484 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-46bb8d90-2ae3-4396-825c-a31b99b7a141 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Getting quotas for project 40d1276aa84a48ab830165304f9d6f74. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:43:16.607474 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-46bb8d90-2ae3-4396-825c-a31b99b7a141 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Getting quotas for user 7ae637d5f7f941d8b3b3264c786faddc and project 40d1276aa84a48ab830165304f9d6f74. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:43:16.905414 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-46bb8d90-2ae3-4396-825c-a31b99b7a141 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Getting quotas for project 40d1276aa84a48ab830165304f9d6f74. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:43:16.909874 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-46bb8d90-2ae3-4396-825c-a31b99b7a141 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Getting quotas for user 7ae637d5f7f941d8b3b3264c786faddc and project 40d1276aa84a48ab830165304f9d6f74. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:43:16.925362 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-46bb8d90-2ae3-4396-825c-a31b99b7a141 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.695672 Feb 21 01:43:16.926454 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1096/2215] 10.222.0.91 () {60 vars in 1157 bytes} [Mon Feb 21 01:43:16 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:17.293348 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-829078d9-93e7-4aaa-b4ad-373ed81e7c69 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:17.294082 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-829078d9-93e7-4aaa-b4ad-373ed81e7c69 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 1bf16190-01f9-45de-ab56-02f712ebe585] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:17.308136 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-829078d9-93e7-4aaa-b4ad-373ed81e7c69 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:17.309840 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-829078d9-93e7-4aaa-b4ad-373ed81e7c69 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:17.310723 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-829078d9-93e7-4aaa-b4ad-373ed81e7c69 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:17.311530 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-829078d9-93e7-4aaa-b4ad-373ed81e7c69 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:17.473137 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-829078d9-93e7-4aaa-b4ad-373ed81e7c69 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:17.481937 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-829078d9-93e7-4aaa-b4ad-373ed81e7c69 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585" status: 200 len: 1319 microversion: 2.1 time: 0.192988 Feb 21 01:43:17.482560 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1120/2216] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:17 2022] GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:18.505212 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5c8960e0-3269-440a-85c0-48e606be1dc6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:18.505848 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5c8960e0-3269-440a-85c0-48e606be1dc6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 1bf16190-01f9-45de-ab56-02f712ebe585] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:18.526986 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5c8960e0-3269-440a-85c0-48e606be1dc6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:18.534576 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5c8960e0-3269-440a-85c0-48e606be1dc6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:18.534576 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5c8960e0-3269-440a-85c0-48e606be1dc6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:18.534576 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5c8960e0-3269-440a-85c0-48e606be1dc6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:18.743945 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-5f9cdd51-1226-429b-b480-5df05a5dbfc6 req-8515b664-8348-49f3-9c4c-e354c7ca64d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bf16190-01f9-45de-ab56-02f712ebe585", "tag": "5cfb0b4c-e01e-43a5-ab07-132927c559da"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:18.745666 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:43:18.745666 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:43:18.755715 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-5f9cdd51-1226-429b-b480-5df05a5dbfc6 req-8515b664-8348-49f3-9c4c-e354c7ca64d0 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:18.756244 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-5f9cdd51-1226-429b-b480-5df05a5dbfc6 req-8515b664-8348-49f3-9c4c-e354c7ca64d0 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:18.756397 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5c8960e0-3269-440a-85c0-48e606be1dc6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:18.764240 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5c8960e0-3269-440a-85c0-48e606be1dc6 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585" status: 200 len: 1319 microversion: 2.1 time: 0.267914 Feb 21 01:43:18.768867 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-5f9cdd51-1226-429b-b480-5df05a5dbfc6 req-8515b664-8348-49f3-9c4c-e354c7ca64d0 service nova] Creating event network-changed:5cfb0b4c-e01e-43a5-ab07-132927c559da for instance 1bf16190-01f9-45de-ab56-02f712ebe585 on hv-cinder-81322 Feb 21 01:43:18.777759 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-5f9cdd51-1226-429b-b480-5df05a5dbfc6 req-8515b664-8348-49f3-9c4c-e354c7ca64d0 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.332790 Feb 21 01:43:18.777759 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1097/2217] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:43:18.778025 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1121/2218] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:18 2022] GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:19.784608 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4eea2971-e14f-4924-8d9a-8f1d5289a198 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:19.785433 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4eea2971-e14f-4924-8d9a-8f1d5289a198 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 1bf16190-01f9-45de-ab56-02f712ebe585] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:19.801487 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4eea2971-e14f-4924-8d9a-8f1d5289a198 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:19.803731 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4eea2971-e14f-4924-8d9a-8f1d5289a198 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:19.804643 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4eea2971-e14f-4924-8d9a-8f1d5289a198 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:19.805095 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4eea2971-e14f-4924-8d9a-8f1d5289a198 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:20.244843 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4eea2971-e14f-4924-8d9a-8f1d5289a198 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:20.255391 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4eea2971-e14f-4924-8d9a-8f1d5289a198 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585" status: 200 len: 1319 microversion: 2.1 time: 0.477688 Feb 21 01:43:20.268034 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1098/2219] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:19 2022] GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585 => generated 1319 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:20.722400 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d07017da-aa37-46b3-a991-6dc84cc9feff tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2103600080", "imageRef": "9b96cc67-20b9-414f-8afb-039ff7953adc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "502ec082-3367-4d95-ab18-937c106fa174"}], "security_groups": [{"name": "tempest-securitygroup--1305710969"}], "key_name": "tempest-keypair-594803392", "user_data": "}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:20.822665 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.network.neutron [None req-d07017da-aa37-46b3-a991-6dc84cc9feff tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] validate_networks() for [('502ec082-3367-4d95-ab18-937c106fa174', None, None, None, None, None)] {{(pid=117139) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:43:21.276480 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ccd62096-2dc5-4035-a097-e6241953e351 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:21.277241 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ccd62096-2dc5-4035-a097-e6241953e351 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 1bf16190-01f9-45de-ab56-02f712ebe585] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:21.283386 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ccd62096-2dc5-4035-a097-e6241953e351 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:21.283941 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ccd62096-2dc5-4035-a097-e6241953e351 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:21.284791 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ccd62096-2dc5-4035-a097-e6241953e351 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:21.285295 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-ccd62096-2dc5-4035-a097-e6241953e351 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:21.303052 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-d07017da-aa37-46b3-a991-6dc84cc9feff tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Flavor limits 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:43:21.303473 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-d07017da-aa37-46b3-a991-6dc84cc9feff tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Image limits 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:43:21.303976 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-d07017da-aa37-46b3-a991-6dc84cc9feff tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Flavor pref 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:43:21.304387 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-d07017da-aa37-46b3-a991-6dc84cc9feff tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Image pref 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:43:21.304798 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-d07017da-aa37-46b3-a991-6dc84cc9feff tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:43:21.313849 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d07017da-aa37-46b3-a991-6dc84cc9feff tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:21.314294 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d07017da-aa37-46b3-a991-6dc84cc9feff tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:21.315102 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d07017da-aa37-46b3-a991-6dc84cc9feff tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:21.315536 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d07017da-aa37-46b3-a991-6dc84cc9feff tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:21.334618 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.quota [None req-d07017da-aa37-46b3-a991-6dc84cc9feff tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Getting quotas for project 40d1276aa84a48ab830165304f9d6f74. Resources: {'ram', 'cores', 'instances'} {{(pid=117139) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:43:21.338514 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.quota [None req-d07017da-aa37-46b3-a991-6dc84cc9feff tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Getting quotas for user 7ae637d5f7f941d8b3b3264c786faddc and project 40d1276aa84a48ab830165304f9d6f74. Resources: {'ram', 'cores', 'instances'} {{(pid=117139) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:43:21.350496 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d07017da-aa37-46b3-a991-6dc84cc9feff tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Going to run 1 instances... {{(pid=117139) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:43:21.352880 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d07017da-aa37-46b3-a991-6dc84cc9feff tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b96cc67-20b9-414f-8afb-039ff7953adc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117139) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:43:21.434497 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ccd62096-2dc5-4035-a097-e6241953e351 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:21.442860 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ccd62096-2dc5-4035-a097-e6241953e351 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585" status: 200 len: 1319 microversion: 2.1 time: 0.169896 Feb 21 01:43:21.443434 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1099/2220] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:21 2022] GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:43:21.513183 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d07017da-aa37-46b3-a991-6dc84cc9feff tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.795726 Feb 21 01:43:21.513828 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1122/2221] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Feb 21 01:43:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:43:21.523883 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-79e6d1f3-7d5d-4d47-bd09-3742fcaa734a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:21.524503 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-79e6d1f3-7d5d-4d47-bd09-3742fcaa734a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:21.588128 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-79e6d1f3-7d5d-4d47-bd09-3742fcaa734a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:21.595614 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-79e6d1f3-7d5d-4d47-bd09-3742fcaa734a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1237 microversion: 2.1 time: 0.075492 Feb 21 01:43:21.605053 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1100/2222] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:21 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:22.460350 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f3c7b56c-9cc5-4895-9bc0-1d13e565cc1d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:22.461225 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f3c7b56c-9cc5-4895-9bc0-1d13e565cc1d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 1bf16190-01f9-45de-ab56-02f712ebe585] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:22.471986 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f3c7b56c-9cc5-4895-9bc0-1d13e565cc1d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:22.472793 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f3c7b56c-9cc5-4895-9bc0-1d13e565cc1d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:22.473932 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f3c7b56c-9cc5-4895-9bc0-1d13e565cc1d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:22.474654 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f3c7b56c-9cc5-4895-9bc0-1d13e565cc1d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:22.612998 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f6d1fdee-aa69-49a2-b0a7-5b2f10326d2f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:22.613723 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f6d1fdee-aa69-49a2-b0a7-5b2f10326d2f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:22.620610 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f6d1fdee-aa69-49a2-b0a7-5b2f10326d2f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:22.621157 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f6d1fdee-aa69-49a2-b0a7-5b2f10326d2f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:22.622062 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f6d1fdee-aa69-49a2-b0a7-5b2f10326d2f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:22.622708 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f6d1fdee-aa69-49a2-b0a7-5b2f10326d2f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:22.622933 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f3c7b56c-9cc5-4895-9bc0-1d13e565cc1d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:22.631641 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f3c7b56c-9cc5-4895-9bc0-1d13e565cc1d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585" status: 200 len: 1319 microversion: 2.1 time: 0.175184 Feb 21 01:43:22.632237 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1123/2223] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:22 2022] GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:22.685761 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f6d1fdee-aa69-49a2-b0a7-5b2f10326d2f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:22.693783 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f6d1fdee-aa69-49a2-b0a7-5b2f10326d2f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1241 microversion: 2.1 time: 0.085069 Feb 21 01:43:22.694350 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1101/2224] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:22 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:43:23.649649 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-208e283d-d9da-4dd0-83ef-e491fe98bd9e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:23.650325 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-208e283d-d9da-4dd0-83ef-e491fe98bd9e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 1bf16190-01f9-45de-ab56-02f712ebe585] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:23.657235 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-208e283d-d9da-4dd0-83ef-e491fe98bd9e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:23.657895 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-208e283d-d9da-4dd0-83ef-e491fe98bd9e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:23.658898 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-208e283d-d9da-4dd0-83ef-e491fe98bd9e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:23.659490 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-208e283d-d9da-4dd0-83ef-e491fe98bd9e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:23.711399 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-638e6f92-8d53-409b-b027-942b108d397b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:23.712044 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-638e6f92-8d53-409b-b027-942b108d397b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:23.719627 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-638e6f92-8d53-409b-b027-942b108d397b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:23.720149 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-638e6f92-8d53-409b-b027-942b108d397b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:23.720938 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-638e6f92-8d53-409b-b027-942b108d397b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:23.721371 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-638e6f92-8d53-409b-b027-942b108d397b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:23.806015 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-208e283d-d9da-4dd0-83ef-e491fe98bd9e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:23.817005 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-208e283d-d9da-4dd0-83ef-e491fe98bd9e tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585" status: 200 len: 1319 microversion: 2.1 time: 0.170855 Feb 21 01:43:23.818188 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1124/2225] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:23 2022] GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:23.818335 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-638e6f92-8d53-409b-b027-942b108d397b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:23.825782 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-638e6f92-8d53-409b-b027-942b108d397b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1297 microversion: 2.1 time: 0.118331 Feb 21 01:43:23.835455 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1102/2226] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:23 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1297 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:24.798022 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-94be5c36-efad-48ae-94aa-bc35bf4694d3 req-2855d224-091a-4586-a86d-6d58a57fc718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bf16190-01f9-45de-ab56-02f712ebe585", "name": "network-vif-plugged", "status": "completed", "tag": "5cfb0b4c-e01e-43a5-ab07-132927c559da"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:24.800462 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:43:24.800462 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:43:24.808148 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-94be5c36-efad-48ae-94aa-bc35bf4694d3 req-2855d224-091a-4586-a86d-6d58a57fc718 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:24.808595 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-94be5c36-efad-48ae-94aa-bc35bf4694d3 req-2855d224-091a-4586-a86d-6d58a57fc718 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:24.820658 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-94be5c36-efad-48ae-94aa-bc35bf4694d3 req-2855d224-091a-4586-a86d-6d58a57fc718 service nova] Creating event network-vif-plugged:5cfb0b4c-e01e-43a5-ab07-132927c559da for instance 1bf16190-01f9-45de-ab56-02f712ebe585 on hv-cinder-81322 Feb 21 01:43:24.826679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-94be5c36-efad-48ae-94aa-bc35bf4694d3 req-2855d224-091a-4586-a86d-6d58a57fc718 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199931 Feb 21 01:43:24.827580 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1125/2227] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:43:24.840282 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-775afe5d-cb8e-44d2-aae6-3e4dd74a012d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:24.840282 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-775afe5d-cb8e-44d2-aae6-3e4dd74a012d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 1bf16190-01f9-45de-ab56-02f712ebe585] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:24.845964 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-775afe5d-cb8e-44d2-aae6-3e4dd74a012d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:24.849892 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d5c861fb-4712-4e87-aaf8-b3d4cfe2f979 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:24.850453 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-775afe5d-cb8e-44d2-aae6-3e4dd74a012d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:24.851365 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-775afe5d-cb8e-44d2-aae6-3e4dd74a012d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:24.851811 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-775afe5d-cb8e-44d2-aae6-3e4dd74a012d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:24.855068 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d5c861fb-4712-4e87-aaf8-b3d4cfe2f979 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:24.862345 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d5c861fb-4712-4e87-aaf8-b3d4cfe2f979 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:24.862801 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d5c861fb-4712-4e87-aaf8-b3d4cfe2f979 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:24.863598 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d5c861fb-4712-4e87-aaf8-b3d4cfe2f979 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:24.864094 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d5c861fb-4712-4e87-aaf8-b3d4cfe2f979 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:25.026017 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d5c861fb-4712-4e87-aaf8-b3d4cfe2f979 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:25.034953 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d5c861fb-4712-4e87-aaf8-b3d4cfe2f979 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1363 microversion: 2.1 time: 0.192519 Feb 21 01:43:25.035738 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1126/2228] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:24 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:25.370584 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-775afe5d-cb8e-44d2-aae6-3e4dd74a012d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:25.378421 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-775afe5d-cb8e-44d2-aae6-3e4dd74a012d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585" status: 200 len: 1319 microversion: 2.1 time: 0.548148 Feb 21 01:43:25.379379 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1103/2229] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:24 2022] GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585 => generated 1319 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:25.815079 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-3d014733-7b8d-4af7-99ef-3fa61bdba19a req-c91c738d-9c9b-4341-8928-cc9a37bba26c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a3ff359-a1b9-40d7-abfc-e029467821c0", "tag": "c923cc2b-497f-4943-9395-abe6369e159f"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:25.816621 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:43:25.816621 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:43:25.824527 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-3d014733-7b8d-4af7-99ef-3fa61bdba19a req-c91c738d-9c9b-4341-8928-cc9a37bba26c service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:25.825238 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-3d014733-7b8d-4af7-99ef-3fa61bdba19a req-c91c738d-9c9b-4341-8928-cc9a37bba26c service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:25.836848 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-3d014733-7b8d-4af7-99ef-3fa61bdba19a req-c91c738d-9c9b-4341-8928-cc9a37bba26c service nova] Creating event network-changed:c923cc2b-497f-4943-9395-abe6369e159f for instance 5a3ff359-a1b9-40d7-abfc-e029467821c0 on hv-cinder-81322 Feb 21 01:43:25.842813 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-3d014733-7b8d-4af7-99ef-3fa61bdba19a req-c91c738d-9c9b-4341-8928-cc9a37bba26c service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031861 Feb 21 01:43:25.843497 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1127/2230] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:43:26.060602 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3809ce8f-6711-44cd-a710-22a66dd886ed tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:26.061209 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3809ce8f-6711-44cd-a710-22a66dd886ed tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:26.068657 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3809ce8f-6711-44cd-a710-22a66dd886ed tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:26.069313 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3809ce8f-6711-44cd-a710-22a66dd886ed tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:26.070096 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3809ce8f-6711-44cd-a710-22a66dd886ed tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:26.070531 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3809ce8f-6711-44cd-a710-22a66dd886ed tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:26.268178 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3809ce8f-6711-44cd-a710-22a66dd886ed tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:26.279403 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3809ce8f-6711-44cd-a710-22a66dd886ed tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1363 microversion: 2.1 time: 0.222631 Feb 21 01:43:26.280111 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1104/2231] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:26 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:26.397888 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-18ac21d7-fe81-4b4f-b698-073d657615be tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:26.398668 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-18ac21d7-fe81-4b4f-b698-073d657615be tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 1bf16190-01f9-45de-ab56-02f712ebe585] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:26.405659 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-18ac21d7-fe81-4b4f-b698-073d657615be tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:26.405659 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-18ac21d7-fe81-4b4f-b698-073d657615be tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:26.411647 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-18ac21d7-fe81-4b4f-b698-073d657615be tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:26.411647 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-18ac21d7-fe81-4b4f-b698-073d657615be tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:26.548100 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-18ac21d7-fe81-4b4f-b698-073d657615be tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:26.555872 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-18ac21d7-fe81-4b4f-b698-073d657615be tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585" status: 200 len: 1509 microversion: 2.1 time: 0.162141 Feb 21 01:43:26.557026 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1128/2232] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:26 2022] GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:26.572740 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b5068957-ca2e-4b7d-bf88-d4e7cc6b48b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4221bbb5-254b-4dd2-bce1-184cd676746b", "device": "/dev/sdb"}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:26.573887 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b5068957-ca2e-4b7d-bf88-d4e7cc6b48b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 1bf16190-01f9-45de-ab56-02f712ebe585] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:26.580251 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b5068957-ca2e-4b7d-bf88-d4e7cc6b48b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:26.580738 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b5068957-ca2e-4b7d-bf88-d4e7cc6b48b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:26.585673 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b5068957-ca2e-4b7d-bf88-d4e7cc6b48b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:26.585673 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b5068957-ca2e-4b7d-bf88-d4e7cc6b48b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:27.295933 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3b46f477-8c00-4a76-8f44-2774e97cc00c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:27.297188 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3b46f477-8c00-4a76-8f44-2774e97cc00c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:27.303619 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b46f477-8c00-4a76-8f44-2774e97cc00c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:27.304132 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b46f477-8c00-4a76-8f44-2774e97cc00c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:27.304921 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b46f477-8c00-4a76-8f44-2774e97cc00c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:27.305355 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b46f477-8c00-4a76-8f44-2774e97cc00c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:27.414211 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b5068957-ca2e-4b7d-bf88-d4e7cc6b48b9 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "POST /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.845071 Feb 21 01:43:27.414847 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1105/2233] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Feb 21 01:43:26 2022] POST /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585/os-volume_attachments => generated 194 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:43:27.444882 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3b46f477-8c00-4a76-8f44-2774e97cc00c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:27.452114 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3b46f477-8c00-4a76-8f44-2774e97cc00c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1363 microversion: 2.1 time: 0.159853 Feb 21 01:43:27.452693 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1129/2234] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:27 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:43:28.470122 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c705f94f-9d9e-4b00-8eba-bc847825427d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:28.471057 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c705f94f-9d9e-4b00-8eba-bc847825427d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:28.477735 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c705f94f-9d9e-4b00-8eba-bc847825427d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:28.478200 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c705f94f-9d9e-4b00-8eba-bc847825427d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:28.479047 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c705f94f-9d9e-4b00-8eba-bc847825427d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:28.479507 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c705f94f-9d9e-4b00-8eba-bc847825427d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:28.623984 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c705f94f-9d9e-4b00-8eba-bc847825427d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:28.631684 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c705f94f-9d9e-4b00-8eba-bc847825427d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1363 microversion: 2.1 time: 0.166640 Feb 21 01:43:28.632262 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1106/2235] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:28 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:29.648804 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e7b6418f-de19-403c-9d06-b651275366cd tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:29.649456 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e7b6418f-de19-403c-9d06-b651275366cd tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:29.656551 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7b6418f-de19-403c-9d06-b651275366cd tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:29.657073 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7b6418f-de19-403c-9d06-b651275366cd tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:29.657846 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7b6418f-de19-403c-9d06-b651275366cd tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:29.658282 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7b6418f-de19-403c-9d06-b651275366cd tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:29.793428 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e7b6418f-de19-403c-9d06-b651275366cd tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:29.800912 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e7b6418f-de19-403c-9d06-b651275366cd tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1363 microversion: 2.1 time: 0.155810 Feb 21 01:43:29.801464 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1130/2236] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:29 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:30.666824 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-247bea13-4c2b-4e15-a1bb-7a0fa12c2224 req-22433863-081b-4c05-8907-9a4b60866a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a3ff359-a1b9-40d7-abfc-e029467821c0", "name": "network-vif-plugged", "status": "completed", "tag": "c923cc2b-497f-4943-9395-abe6369e159f"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:30.667309 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:43:30.667309 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:43:30.674822 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-247bea13-4c2b-4e15-a1bb-7a0fa12c2224 req-22433863-081b-4c05-8907-9a4b60866a6b service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:30.675378 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-247bea13-4c2b-4e15-a1bb-7a0fa12c2224 req-22433863-081b-4c05-8907-9a4b60866a6b service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:30.686226 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-247bea13-4c2b-4e15-a1bb-7a0fa12c2224 req-22433863-081b-4c05-8907-9a4b60866a6b service nova] Creating event network-vif-plugged:c923cc2b-497f-4943-9395-abe6369e159f for instance 5a3ff359-a1b9-40d7-abfc-e029467821c0 on hv-cinder-81322 Feb 21 01:43:30.691820 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-247bea13-4c2b-4e15-a1bb-7a0fa12c2224 req-22433863-081b-4c05-8907-9a4b60866a6b service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030577 Feb 21 01:43:30.694476 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1107/2237] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:43:30.819422 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d8bc2f68-1f55-4078-894c-dad6b37d4e81 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:30.820078 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d8bc2f68-1f55-4078-894c-dad6b37d4e81 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:30.826046 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d8bc2f68-1f55-4078-894c-dad6b37d4e81 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:30.826846 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d8bc2f68-1f55-4078-894c-dad6b37d4e81 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:30.827628 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d8bc2f68-1f55-4078-894c-dad6b37d4e81 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:30.828669 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d8bc2f68-1f55-4078-894c-dad6b37d4e81 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:30.972602 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d8bc2f68-1f55-4078-894c-dad6b37d4e81 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:30.980652 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d8bc2f68-1f55-4078-894c-dad6b37d4e81 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1363 microversion: 2.1 time: 0.166102 Feb 21 01:43:30.981218 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1131/2238] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:30 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:31.999316 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-31cec5bf-9186-4d1a-ae88-7083121a1dc1 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:32.000568 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-31cec5bf-9186-4d1a-ae88-7083121a1dc1 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:32.007090 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31cec5bf-9186-4d1a-ae88-7083121a1dc1 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:32.007309 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31cec5bf-9186-4d1a-ae88-7083121a1dc1 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:32.008131 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31cec5bf-9186-4d1a-ae88-7083121a1dc1 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:32.008569 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-31cec5bf-9186-4d1a-ae88-7083121a1dc1 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:32.166926 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-31cec5bf-9186-4d1a-ae88-7083121a1dc1 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:32.174419 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-31cec5bf-9186-4d1a-ae88-7083121a1dc1 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1363 microversion: 2.1 time: 0.179462 Feb 21 01:43:32.174989 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1108/2239] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:31 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:33.192537 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-49ab0e62-8c0e-4471-bfd8-d7ed3262370b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:33.193154 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-49ab0e62-8c0e-4471-bfd8-d7ed3262370b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:33.198922 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49ab0e62-8c0e-4471-bfd8-d7ed3262370b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:33.202339 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49ab0e62-8c0e-4471-bfd8-d7ed3262370b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:33.202339 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49ab0e62-8c0e-4471-bfd8-d7ed3262370b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:33.202339 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-49ab0e62-8c0e-4471-bfd8-d7ed3262370b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:33.343432 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-49ab0e62-8c0e-4471-bfd8-d7ed3262370b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:33.350563 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-49ab0e62-8c0e-4471-bfd8-d7ed3262370b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1547 microversion: 2.1 time: 0.162630 Feb 21 01:43:33.351115 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1132/2240] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:33 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:33.366907 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7b9743bb-2d4e-4dc5-9539-d99eb4a017e7 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:33.367423 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7b9743bb-2d4e-4dc5-9539-d99eb4a017e7 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:33.373652 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7b9743bb-2d4e-4dc5-9539-d99eb4a017e7 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:33.374104 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7b9743bb-2d4e-4dc5-9539-d99eb4a017e7 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:33.375587 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7b9743bb-2d4e-4dc5-9539-d99eb4a017e7 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:33.376053 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7b9743bb-2d4e-4dc5-9539-d99eb4a017e7 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:33.458634 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7b9743bb-2d4e-4dc5-9539-d99eb4a017e7 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095373 Feb 21 01:43:33.459248 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1109/2241] 10.222.0.91 () {58 vars in 1274 bytes} [Mon Feb 21 01:43:33 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:43:34.522712 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ff5365a6-c5f8-4c65-b625-031da34a6ea6 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:34.523254 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ff5365a6-c5f8-4c65-b625-031da34a6ea6 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:34.525108 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-395ad8ab-e6a6-45b9-8350-99d4da9a883e req-1082f945-b33a-46fe-8f9a-f1f35eb9b80a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a3ff359-a1b9-40d7-abfc-e029467821c0", "tag": "c923cc2b-497f-4943-9395-abe6369e159f"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:34.526958 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:43:34.526958 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:43:34.529972 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ff5365a6-c5f8-4c65-b625-031da34a6ea6 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:34.530421 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ff5365a6-c5f8-4c65-b625-031da34a6ea6 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:34.532147 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ff5365a6-c5f8-4c65-b625-031da34a6ea6 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:34.532602 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ff5365a6-c5f8-4c65-b625-031da34a6ea6 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:34.536792 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-395ad8ab-e6a6-45b9-8350-99d4da9a883e req-1082f945-b33a-46fe-8f9a-f1f35eb9b80a service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:34.538120 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-395ad8ab-e6a6-45b9-8350-99d4da9a883e req-1082f945-b33a-46fe-8f9a-f1f35eb9b80a service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:34.552459 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-395ad8ab-e6a6-45b9-8350-99d4da9a883e req-1082f945-b33a-46fe-8f9a-f1f35eb9b80a service nova] Creating event network-changed:c923cc2b-497f-4943-9395-abe6369e159f for instance 5a3ff359-a1b9-40d7-abfc-e029467821c0 on hv-cinder-81322 Feb 21 01:43:34.556489 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ff5365a6-c5f8-4c65-b625-031da34a6ea6 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0/ips" status: 200 len: 104 microversion: 2.1 time: 0.038028 Feb 21 01:43:34.557318 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1133/2242] 10.222.0.91 () {58 vars in 1247 bytes} [Mon Feb 21 01:43:34 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0/ips => generated 104 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:43:34.563414 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-395ad8ab-e6a6-45b9-8350-99d4da9a883e req-1082f945-b33a-46fe-8f9a-f1f35eb9b80a service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037077 Feb 21 01:43:34.563414 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1110/2243] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:43:48.295898 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d2a84dab-c773-4d4e-a78f-eb1e97a2bd7d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:48.296519 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d2a84dab-c773-4d4e-a78f-eb1e97a2bd7d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 1bf16190-01f9-45de-ab56-02f712ebe585] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:48.304530 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d2a84dab-c773-4d4e-a78f-eb1e97a2bd7d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:48.304976 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d2a84dab-c773-4d4e-a78f-eb1e97a2bd7d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:48.305759 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d2a84dab-c773-4d4e-a78f-eb1e97a2bd7d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:48.306212 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d2a84dab-c773-4d4e-a78f-eb1e97a2bd7d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:48.383329 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.objects.instance [None req-d2a84dab-c773-4d4e-a78f-eb1e97a2bd7d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lazy-loading 'services' on Instance uuid 1bf16190-01f9-45de-ab56-02f712ebe585 {{(pid=117138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:43:48.612906 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d2a84dab-c773-4d4e-a78f-eb1e97a2bd7d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "DELETE /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585/os-volume_attachments/4221bbb5-254b-4dd2-bce1-184cd676746b" status: 202 len: 0 microversion: 2.1 time: 0.321172 Feb 21 01:43:48.615561 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1111/2244] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Feb 21 01:43:48 2022] DELETE /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585/os-volume_attachments/4221bbb5-254b-4dd2-bce1-184cd676746b => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:43:49.722167 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-316f254d-03e7-4001-bbf8-5520ed1b081d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:49.722716 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-316f254d-03e7-4001-bbf8-5520ed1b081d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 1bf16190-01f9-45de-ab56-02f712ebe585] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:49.728614 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-316f254d-03e7-4001-bbf8-5520ed1b081d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:49.729052 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-316f254d-03e7-4001-bbf8-5520ed1b081d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:49.729812 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-316f254d-03e7-4001-bbf8-5520ed1b081d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:49.730235 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-316f254d-03e7-4001-bbf8-5520ed1b081d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:49.753873 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-316f254d-03e7-4001-bbf8-5520ed1b081d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 1bf16190-01f9-45de-ab56-02f712ebe585] Going to try to terminate instance {{(pid=117139) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:43:50.067746 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-316f254d-03e7-4001-bbf8-5520ed1b081d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "DELETE /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585" status: 204 len: 0 microversion: 2.1 time: 0.349477 Feb 21 01:43:50.068383 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1134/2245] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Feb 21 01:43:49 2022] DELETE /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:43:50.077185 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-908d386d-470b-4b79-9089-0485a15d4495 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:50.077920 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-908d386d-470b-4b79-9089-0485a15d4495 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 1bf16190-01f9-45de-ab56-02f712ebe585] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:50.084945 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-908d386d-470b-4b79-9089-0485a15d4495 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:50.085402 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-908d386d-470b-4b79-9089-0485a15d4495 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:50.086191 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-908d386d-470b-4b79-9089-0485a15d4495 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:50.086630 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-908d386d-470b-4b79-9089-0485a15d4495 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:50.222075 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-908d386d-470b-4b79-9089-0485a15d4495 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:50.229435 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-908d386d-470b-4b79-9089-0485a15d4495 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585" status: 200 len: 1515 microversion: 2.1 time: 0.156676 Feb 21 01:43:50.229989 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1112/2246] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:50 2022] GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:51.247429 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-cd4d6448-77ba-46a3-ade8-3cedd17cc811 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:51.248144 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-cd4d6448-77ba-46a3-ade8-3cedd17cc811 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 1bf16190-01f9-45de-ab56-02f712ebe585] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:51.255609 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cd4d6448-77ba-46a3-ade8-3cedd17cc811 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:51.256097 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cd4d6448-77ba-46a3-ade8-3cedd17cc811 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:51.256984 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cd4d6448-77ba-46a3-ade8-3cedd17cc811 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:51.257417 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cd4d6448-77ba-46a3-ade8-3cedd17cc811 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:51.396975 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-cd4d6448-77ba-46a3-ade8-3cedd17cc811 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:51.404231 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-cd4d6448-77ba-46a3-ade8-3cedd17cc811 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585" status: 200 len: 1515 microversion: 2.1 time: 0.160821 Feb 21 01:43:51.404787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1135/2247] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:51 2022] GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:52.422374 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cbb59ab3-1b17-4eca-928a-fd9a2a083e6d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:52.422982 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cbb59ab3-1b17-4eca-928a-fd9a2a083e6d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 1bf16190-01f9-45de-ab56-02f712ebe585] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:52.429907 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cbb59ab3-1b17-4eca-928a-fd9a2a083e6d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:52.430348 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cbb59ab3-1b17-4eca-928a-fd9a2a083e6d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:52.431124 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cbb59ab3-1b17-4eca-928a-fd9a2a083e6d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:52.431551 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cbb59ab3-1b17-4eca-928a-fd9a2a083e6d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:52.572495 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-cbb59ab3-1b17-4eca-928a-fd9a2a083e6d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:52.580228 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cbb59ab3-1b17-4eca-928a-fd9a2a083e6d tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585" status: 200 len: 1515 microversion: 2.1 time: 0.161352 Feb 21 01:43:52.581035 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1113/2248] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:52 2022] GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:52.694396 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-9fdaaa9b-eedb-4c4d-b5b5-1835c206f90d req-126f0357-a42c-46ac-830f-5580c01492d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bf16190-01f9-45de-ab56-02f712ebe585", "name": "network-vif-deleted", "tag": "5cfb0b4c-e01e-43a5-ab07-132927c559da"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:52.699808 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:43:52.699808 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:43:52.704390 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-9fdaaa9b-eedb-4c4d-b5b5-1835c206f90d req-126f0357-a42c-46ac-830f-5580c01492d3 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:52.704866 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-9fdaaa9b-eedb-4c4d-b5b5-1835c206f90d req-126f0357-a42c-46ac-830f-5580c01492d3 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:52.715581 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-9fdaaa9b-eedb-4c4d-b5b5-1835c206f90d req-126f0357-a42c-46ac-830f-5580c01492d3 service nova] Creating event network-vif-deleted:5cfb0b4c-e01e-43a5-ab07-132927c559da for instance 1bf16190-01f9-45de-ab56-02f712ebe585 on hv-cinder-81322 Feb 21 01:43:52.721415 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-9fdaaa9b-eedb-4c4d-b5b5-1835c206f90d req-126f0357-a42c-46ac-830f-5580c01492d3 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030998 Feb 21 01:43:52.721997 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1136/2249] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:43:53.597590 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-bd0929b5-fb71-4d73-abc0-fb82933a1939 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:53.598976 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-bd0929b5-fb71-4d73-abc0-fb82933a1939 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 1bf16190-01f9-45de-ab56-02f712ebe585] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:53.605503 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bd0929b5-fb71-4d73-abc0-fb82933a1939 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:53.606188 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bd0929b5-fb71-4d73-abc0-fb82933a1939 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:53.607006 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bd0929b5-fb71-4d73-abc0-fb82933a1939 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:53.607423 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bd0929b5-fb71-4d73-abc0-fb82933a1939 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:53.647895 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bd0929b5-fb71-4d73-abc0-fb82933a1939 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:53.648365 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bd0929b5-fb71-4d73-abc0-fb82933a1939 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:53.648811 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.objects.instance [None req-bd0929b5-fb71-4d73-abc0-fb82933a1939 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lazy-loading 'fault' on Instance uuid 1bf16190-01f9-45de-ab56-02f712ebe585 {{(pid=117138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:43:53.694830 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-bd0929b5-fb71-4d73-abc0-fb82933a1939 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef05bfef54c43ca8d0099ee98986766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92cb7cf852c4790bb51e02de8b46c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:53.701429 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-bd0929b5-fb71-4d73-abc0-fb82933a1939 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585" status: 200 len: 1309 microversion: 2.1 time: 0.107744 Feb 21 01:43:53.701992 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1114/2250] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:53 2022] GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585 => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:54.719020 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8bff0a8c-8d1b-45f6-b5f7-4fe196690481 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:54.719716 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8bff0a8c-8d1b-45f6-b5f7-4fe196690481 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] [instance: 1bf16190-01f9-45de-ab56-02f712ebe585] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:54.727271 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8bff0a8c-8d1b-45f6-b5f7-4fe196690481 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:54.727738 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8bff0a8c-8d1b-45f6-b5f7-4fe196690481 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:54.728574 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8bff0a8c-8d1b-45f6-b5f7-4fe196690481 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:54.729006 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8bff0a8c-8d1b-45f6-b5f7-4fe196690481 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:54.743282 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-8bff0a8c-8d1b-45f6-b5f7-4fe196690481 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] HTTP exception thrown: Instance 1bf16190-01f9-45de-ab56-02f712ebe585 could not be found. Feb 21 01:43:54.743903 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8bff0a8c-8d1b-45f6-b5f7-4fe196690481 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] Returning 404 to user: Instance 1bf16190-01f9-45de-ab56-02f712ebe585 could not be found. {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:43:54.744736 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8bff0a8c-8d1b-45f6-b5f7-4fe196690481 tempest-VolumesSnapshotTestJSON-1291323275 tempest-VolumesSnapshotTestJSON-1291323275-project] 10.222.0.91 "GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585" status: 404 len: 111 microversion: 2.1 time: 0.030036 Feb 21 01:43:54.745273 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1137/2251] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:54 2022] GET /compute/v2.1/servers/1bf16190-01f9-45de-ab56-02f712ebe585 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:44:20.993214 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-57cf6849-ab40-4d4a-a0ae-da772950d7a1 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "204f0690-9c11-4e4d-95ad-2eeab6034144"}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:44:20.994317 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-57cf6849-ab40-4d4a-a0ae-da772950d7a1 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:21.000303 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-57cf6849-ab40-4d4a-a0ae-da772950d7a1 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:21.000759 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-57cf6849-ab40-4d4a-a0ae-da772950d7a1 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:21.001559 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-57cf6849-ab40-4d4a-a0ae-da772950d7a1 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:21.001994 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-57cf6849-ab40-4d4a-a0ae-da772950d7a1 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:21.713718 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-57cf6849-ab40-4d4a-a0ae-da772950d7a1 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "POST /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.724143 Feb 21 01:44:21.714322 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1115/2252] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Feb 21 01:44:20 2022] POST /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0/os-volume_attachments => generated 194 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:44:29.200644 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7f82cbdc-9c76-4d31-a797-c04ac781fff4 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:44:29.206878 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7f82cbdc-9c76-4d31-a797-c04ac781fff4 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:29.207322 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7f82cbdc-9c76-4d31-a797-c04ac781fff4 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:29.275122 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7f82cbdc-9c76-4d31-a797-c04ac781fff4 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Going to try to stop instance {{(pid=117139) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 21 01:44:29.497804 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7f82cbdc-9c76-4d31-a797-c04ac781fff4 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "POST /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0/action" status: 202 len: 0 microversion: 2.1 time: 0.301258 Feb 21 01:44:29.498691 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1138/2253] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Feb 21 01:44:29 2022] POST /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:44:29.508678 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-923f6bc4-7b63-43ba-adcd-4e186ab15821 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:29.509508 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-923f6bc4-7b63-43ba-adcd-4e186ab15821 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:29.515920 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-923f6bc4-7b63-43ba-adcd-4e186ab15821 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:29.516580 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-923f6bc4-7b63-43ba-adcd-4e186ab15821 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:29.517768 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-923f6bc4-7b63-43ba-adcd-4e186ab15821 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:29.518473 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-923f6bc4-7b63-43ba-adcd-4e186ab15821 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:29.717307 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-923f6bc4-7b63-43ba-adcd-4e186ab15821 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:29.726024 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-923f6bc4-7b63-43ba-adcd-4e186ab15821 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1721 microversion: 2.1 time: 0.222942 Feb 21 01:44:29.726592 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1116/2254] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:29 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:30.745726 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-497be9c7-2c5a-4e2d-98f5-5dda73e03538 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:30.746531 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-497be9c7-2c5a-4e2d-98f5-5dda73e03538 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:30.753499 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-497be9c7-2c5a-4e2d-98f5-5dda73e03538 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:30.754019 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-497be9c7-2c5a-4e2d-98f5-5dda73e03538 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:30.755149 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-497be9c7-2c5a-4e2d-98f5-5dda73e03538 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:30.755656 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-497be9c7-2c5a-4e2d-98f5-5dda73e03538 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:30.908199 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-497be9c7-2c5a-4e2d-98f5-5dda73e03538 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:30.919046 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-497be9c7-2c5a-4e2d-98f5-5dda73e03538 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1721 microversion: 2.1 time: 0.175145 Feb 21 01:44:30.919046 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1139/2255] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:30 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:31.934204 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-85dc2632-2e89-4b93-82da-2c6b94bb286b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:31.934811 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-85dc2632-2e89-4b93-82da-2c6b94bb286b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:31.940998 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-85dc2632-2e89-4b93-82da-2c6b94bb286b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:31.941446 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-85dc2632-2e89-4b93-82da-2c6b94bb286b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:31.942776 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-85dc2632-2e89-4b93-82da-2c6b94bb286b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:31.942776 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-85dc2632-2e89-4b93-82da-2c6b94bb286b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:32.087613 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-85dc2632-2e89-4b93-82da-2c6b94bb286b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:32.096541 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-85dc2632-2e89-4b93-82da-2c6b94bb286b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1721 microversion: 2.1 time: 0.166150 Feb 21 01:44:32.097540 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1117/2256] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:31 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:33.117039 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-30faa453-353a-49c9-aed8-5e04602aee73 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:33.118556 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-30faa453-353a-49c9-aed8-5e04602aee73 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:33.124616 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-30faa453-353a-49c9-aed8-5e04602aee73 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:33.125179 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-30faa453-353a-49c9-aed8-5e04602aee73 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:33.126342 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-30faa453-353a-49c9-aed8-5e04602aee73 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:33.126987 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-30faa453-353a-49c9-aed8-5e04602aee73 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:33.310048 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-30faa453-353a-49c9-aed8-5e04602aee73 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:33.319803 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-30faa453-353a-49c9-aed8-5e04602aee73 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1721 microversion: 2.1 time: 0.207404 Feb 21 01:44:33.320643 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1140/2257] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:33 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:34.337449 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e402a21d-d0ff-40b9-a0b9-8c5eefcc6711 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:34.338680 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e402a21d-d0ff-40b9-a0b9-8c5eefcc6711 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:34.346307 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e402a21d-d0ff-40b9-a0b9-8c5eefcc6711 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:34.346754 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e402a21d-d0ff-40b9-a0b9-8c5eefcc6711 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:34.347549 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e402a21d-d0ff-40b9-a0b9-8c5eefcc6711 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:34.348177 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e402a21d-d0ff-40b9-a0b9-8c5eefcc6711 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:34.655060 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e402a21d-d0ff-40b9-a0b9-8c5eefcc6711 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:34.665265 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e402a21d-d0ff-40b9-a0b9-8c5eefcc6711 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1721 microversion: 2.1 time: 0.332122 Feb 21 01:44:34.666383 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1118/2258] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:34 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1721 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:35.684683 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-725d9979-18e1-4238-ae11-800b1bbe9817 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:35.686364 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-725d9979-18e1-4238-ae11-800b1bbe9817 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:35.692597 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-725d9979-18e1-4238-ae11-800b1bbe9817 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:35.693055 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-725d9979-18e1-4238-ae11-800b1bbe9817 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:35.693836 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-725d9979-18e1-4238-ae11-800b1bbe9817 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:35.694269 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-725d9979-18e1-4238-ae11-800b1bbe9817 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:35.831411 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-725d9979-18e1-4238-ae11-800b1bbe9817 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:35.860394 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-725d9979-18e1-4238-ae11-800b1bbe9817 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1721 microversion: 2.1 time: 0.179298 Feb 21 01:44:35.865593 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1141/2259] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:35 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:36.879155 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4d786c4b-464c-4fd4-ab42-bde37c8e667e tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:36.881815 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4d786c4b-464c-4fd4-ab42-bde37c8e667e tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:36.890415 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4d786c4b-464c-4fd4-ab42-bde37c8e667e tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:36.893555 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4d786c4b-464c-4fd4-ab42-bde37c8e667e tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:36.893555 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4d786c4b-464c-4fd4-ab42-bde37c8e667e tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:36.893555 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4d786c4b-464c-4fd4-ab42-bde37c8e667e tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:37.135235 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4d786c4b-464c-4fd4-ab42-bde37c8e667e tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:37.143948 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4d786c4b-464c-4fd4-ab42-bde37c8e667e tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1721 microversion: 2.1 time: 0.269469 Feb 21 01:44:37.144516 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1119/2260] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:36 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1721 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:44:38.165940 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4c7b482b-4807-4ac3-96c8-c6ab01806fa8 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:38.167398 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4c7b482b-4807-4ac3-96c8-c6ab01806fa8 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:38.175941 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4c7b482b-4807-4ac3-96c8-c6ab01806fa8 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:38.177605 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4c7b482b-4807-4ac3-96c8-c6ab01806fa8 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:38.180002 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4c7b482b-4807-4ac3-96c8-c6ab01806fa8 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:38.180716 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4c7b482b-4807-4ac3-96c8-c6ab01806fa8 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:38.353295 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4c7b482b-4807-4ac3-96c8-c6ab01806fa8 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:38.362421 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4c7b482b-4807-4ac3-96c8-c6ab01806fa8 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1721 microversion: 2.1 time: 0.204500 Feb 21 01:44:38.368543 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1142/2261] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:38 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:39.393731 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6b92e920-b07f-4d2f-a914-e1567208aacb tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:39.395053 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6b92e920-b07f-4d2f-a914-e1567208aacb tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:39.419642 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b92e920-b07f-4d2f-a914-e1567208aacb tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:39.424192 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b92e920-b07f-4d2f-a914-e1567208aacb tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:39.424192 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b92e920-b07f-4d2f-a914-e1567208aacb tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:39.424192 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6b92e920-b07f-4d2f-a914-e1567208aacb tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:39.591387 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6b92e920-b07f-4d2f-a914-e1567208aacb tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:39.607225 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6b92e920-b07f-4d2f-a914-e1567208aacb tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1721 microversion: 2.1 time: 0.210557 Feb 21 01:44:39.608264 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1120/2262] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:39 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:40.625729 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-fe0404cd-2fe2-40cb-9a8a-7bb1b1c71b3c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:40.626389 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-fe0404cd-2fe2-40cb-9a8a-7bb1b1c71b3c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:40.639110 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fe0404cd-2fe2-40cb-9a8a-7bb1b1c71b3c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:40.639943 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fe0404cd-2fe2-40cb-9a8a-7bb1b1c71b3c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:40.641029 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fe0404cd-2fe2-40cb-9a8a-7bb1b1c71b3c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:40.641706 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-fe0404cd-2fe2-40cb-9a8a-7bb1b1c71b3c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:40.809257 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-fe0404cd-2fe2-40cb-9a8a-7bb1b1c71b3c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:40.826472 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-fe0404cd-2fe2-40cb-9a8a-7bb1b1c71b3c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1698 microversion: 2.1 time: 0.204116 Feb 21 01:44:40.827125 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1143/2263] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:40 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1698 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:40.843684 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-77322dc0-5031-4e20-a143-90ac7c362527 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:44:40.850400 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-77322dc0-5031-4e20-a143-90ac7c362527 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:40.851078 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-77322dc0-5031-4e20-a143-90ac7c362527 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:40.954756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-77322dc0-5031-4e20-a143-90ac7c362527 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Going to try to start instance {{(pid=117138) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 21 01:44:41.149174 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-77322dc0-5031-4e20-a143-90ac7c362527 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "POST /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0/action" status: 202 len: 0 microversion: 2.1 time: 0.307462 Feb 21 01:44:41.155196 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1121/2264] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Feb 21 01:44:40 2022] POST /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:44:41.159813 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e5b6d5d8-f02f-4a8b-b4b3-84c64ec25611 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:41.160387 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e5b6d5d8-f02f-4a8b-b4b3-84c64ec25611 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:41.171047 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e5b6d5d8-f02f-4a8b-b4b3-84c64ec25611 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:41.171047 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e5b6d5d8-f02f-4a8b-b4b3-84c64ec25611 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:41.172066 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e5b6d5d8-f02f-4a8b-b4b3-84c64ec25611 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:41.172220 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e5b6d5d8-f02f-4a8b-b4b3-84c64ec25611 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:41.382516 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e5b6d5d8-f02f-4a8b-b4b3-84c64ec25611 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:41.393907 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e5b6d5d8-f02f-4a8b-b4b3-84c64ec25611 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1707 microversion: 2.1 time: 0.237662 Feb 21 01:44:41.409594 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1144/2265] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:41 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1707 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:42.417407 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f919a807-2ea6-4814-8856-215d254a8953 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:42.418095 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f919a807-2ea6-4814-8856-215d254a8953 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:42.426120 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f919a807-2ea6-4814-8856-215d254a8953 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:42.427520 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f919a807-2ea6-4814-8856-215d254a8953 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:42.428593 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f919a807-2ea6-4814-8856-215d254a8953 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:42.429083 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f919a807-2ea6-4814-8856-215d254a8953 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:42.579634 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f919a807-2ea6-4814-8856-215d254a8953 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:42.591663 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f919a807-2ea6-4814-8856-215d254a8953 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1707 microversion: 2.1 time: 0.178811 Feb 21 01:44:42.592289 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1122/2266] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:42 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1707 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:44:43.612795 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-dc8b43c8-2cec-45db-9a6c-e6e2fcf6455d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:43.615047 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-dc8b43c8-2cec-45db-9a6c-e6e2fcf6455d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:43.625448 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dc8b43c8-2cec-45db-9a6c-e6e2fcf6455d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:43.626056 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dc8b43c8-2cec-45db-9a6c-e6e2fcf6455d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:43.626937 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dc8b43c8-2cec-45db-9a6c-e6e2fcf6455d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:43.627458 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dc8b43c8-2cec-45db-9a6c-e6e2fcf6455d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:43.804318 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-dc8b43c8-2cec-45db-9a6c-e6e2fcf6455d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:43.812707 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-dc8b43c8-2cec-45db-9a6c-e6e2fcf6455d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1711 microversion: 2.1 time: 0.206634 Feb 21 01:44:43.827457 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1145/2267] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:43 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1711 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:49.813048 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3b7e4202-4f77-4857-adf1-e6df674b6e30 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Action: 'create', calling method: .version_select at 0x7f4ace88bca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-650157832"}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:44:49.828316 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-3b7e4202-4f77-4857-adf1-e6df674b6e30 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Getting quotas for project caf92606a26e43e19b60a51e3eddad9d. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:44:49.832098 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-3b7e4202-4f77-4857-adf1-e6df674b6e30 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Getting quotas for user 0984cd81d2274ef1b480eec8584d780f and project caf92606a26e43e19b60a51e3eddad9d. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:44:50.147962 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-3b7e4202-4f77-4857-adf1-e6df674b6e30 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Getting quotas for project caf92606a26e43e19b60a51e3eddad9d. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:44:50.151801 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-3b7e4202-4f77-4857-adf1-e6df674b6e30 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Getting quotas for user 0984cd81d2274ef1b480eec8584d780f and project caf92606a26e43e19b60a51e3eddad9d. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:44:50.165001 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3b7e4202-4f77-4857-adf1-e6df674b6e30 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.355683 Feb 21 01:44:50.165595 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1123/2268] 10.222.0.91 () {60 vars in 1157 bytes} [Mon Feb 21 01:44:49 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:44:50.215489 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e7607b28-3d3d-4f70-a671-abf57aee0ca8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-976193529", "imageRef": "0fa2817b-b621-4c23-a32c-b07748bf8a87", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-650157832", "networks": [{"uuid": "5f028b62-f31f-4c9a-8a38-33dd12c2b35c"}]}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:44:50.264872 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.network.neutron [None req-e7607b28-3d3d-4f70-a671-abf57aee0ca8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] validate_networks() for [('5f028b62-f31f-4c9a-8a38-33dd12c2b35c', None, None, None, None, None)] {{(pid=117139) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:44:50.633727 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-e7607b28-3d3d-4f70-a671-abf57aee0ca8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Flavor limits 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:44:50.634145 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-e7607b28-3d3d-4f70-a671-abf57aee0ca8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Image limits 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:44:50.634613 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-e7607b28-3d3d-4f70-a671-abf57aee0ca8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Flavor pref 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:44:50.635014 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-e7607b28-3d3d-4f70-a671-abf57aee0ca8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Image pref 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:44:50.635422 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-e7607b28-3d3d-4f70-a671-abf57aee0ca8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:44:50.643918 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7607b28-3d3d-4f70-a671-abf57aee0ca8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:50.644360 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7607b28-3d3d-4f70-a671-abf57aee0ca8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:50.645154 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7607b28-3d3d-4f70-a671-abf57aee0ca8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:50.646117 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e7607b28-3d3d-4f70-a671-abf57aee0ca8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:50.665139 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.quota [None req-e7607b28-3d3d-4f70-a671-abf57aee0ca8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Getting quotas for project caf92606a26e43e19b60a51e3eddad9d. Resources: {'ram', 'cores', 'instances'} {{(pid=117139) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:44:50.676162 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.quota [None req-e7607b28-3d3d-4f70-a671-abf57aee0ca8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Getting quotas for user 0984cd81d2274ef1b480eec8584d780f and project caf92606a26e43e19b60a51e3eddad9d. Resources: {'ram', 'cores', 'instances'} {{(pid=117139) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:44:50.679478 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e7607b28-3d3d-4f70-a671-abf57aee0ca8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Going to run 1 instances... {{(pid=117139) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:44:50.681696 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e7607b28-3d3d-4f70-a671-abf57aee0ca8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0fa2817b-b621-4c23-a32c-b07748bf8a87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117139) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:44:50.809308 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e7607b28-3d3d-4f70-a671-abf57aee0ca8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597598 Feb 21 01:44:50.809955 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1146/2269] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Feb 21 01:44:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:44:50.820227 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8a6fd9f7-a9e3-42fa-8c35-aa4558cc726f tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:50.820841 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8a6fd9f7-a9e3-42fa-8c35-aa4558cc726f tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:50.877198 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8a6fd9f7-a9e3-42fa-8c35-aa4558cc726f tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:50.885202 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8a6fd9f7-a9e3-42fa-8c35-aa4558cc726f tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1257 microversion: 2.1 time: 0.069384 Feb 21 01:44:50.886063 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1124/2270] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:50 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1257 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:51.902741 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-51712def-cd18-4e71-b24b-31671f563057 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:51.903354 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-51712def-cd18-4e71-b24b-31671f563057 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:51.909881 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-51712def-cd18-4e71-b24b-31671f563057 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:51.912180 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-51712def-cd18-4e71-b24b-31671f563057 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:51.912180 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-51712def-cd18-4e71-b24b-31671f563057 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:51.912180 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-51712def-cd18-4e71-b24b-31671f563057 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:51.976476 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-51712def-cd18-4e71-b24b-31671f563057 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:51.983618 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-51712def-cd18-4e71-b24b-31671f563057 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1261 microversion: 2.1 time: 0.085010 Feb 21 01:44:51.984196 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1147/2271] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:51 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:53.000046 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4dd703c6-ca34-4938-9b89-b9b429324ed1 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:53.000684 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4dd703c6-ca34-4938-9b89-b9b429324ed1 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:53.007130 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4dd703c6-ca34-4938-9b89-b9b429324ed1 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:53.007568 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4dd703c6-ca34-4938-9b89-b9b429324ed1 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:53.008375 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4dd703c6-ca34-4938-9b89-b9b429324ed1 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:53.008801 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4dd703c6-ca34-4938-9b89-b9b429324ed1 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:53.110029 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4dd703c6-ca34-4938-9b89-b9b429324ed1 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:53.117948 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4dd703c6-ca34-4938-9b89-b9b429324ed1 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1317 microversion: 2.1 time: 0.121592 Feb 21 01:44:53.118524 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1125/2272] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:52 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1317 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:54.136929 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2a1676ce-5fdc-4bce-a439-e1b35ccb7ecf tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:54.137611 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2a1676ce-5fdc-4bce-a439-e1b35ccb7ecf tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:54.144065 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2a1676ce-5fdc-4bce-a439-e1b35ccb7ecf tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:54.144806 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2a1676ce-5fdc-4bce-a439-e1b35ccb7ecf tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:54.145776 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2a1676ce-5fdc-4bce-a439-e1b35ccb7ecf tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:54.146408 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2a1676ce-5fdc-4bce-a439-e1b35ccb7ecf tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:54.300970 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2a1676ce-5fdc-4bce-a439-e1b35ccb7ecf tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:54.310160 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2a1676ce-5fdc-4bce-a439-e1b35ccb7ecf tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1357 microversion: 2.1 time: 0.176894 Feb 21 01:44:54.310934 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1148/2273] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:54 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:55.327948 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8c6fc7bb-b3cc-4233-b855-566e3c8e7c01 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:55.328650 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8c6fc7bb-b3cc-4233-b855-566e3c8e7c01 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:55.338132 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8c6fc7bb-b3cc-4233-b855-566e3c8e7c01 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:55.338583 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8c6fc7bb-b3cc-4233-b855-566e3c8e7c01 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:55.339499 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8c6fc7bb-b3cc-4233-b855-566e3c8e7c01 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:55.340216 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8c6fc7bb-b3cc-4233-b855-566e3c8e7c01 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:55.487100 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8c6fc7bb-b3cc-4233-b855-566e3c8e7c01 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:55.495624 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8c6fc7bb-b3cc-4233-b855-566e3c8e7c01 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1357 microversion: 2.1 time: 0.172803 Feb 21 01:44:55.496225 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1126/2274] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:55 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:56.513030 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1dc2de79-3654-423f-a4ee-d37a9a2c804d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:56.513745 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1dc2de79-3654-423f-a4ee-d37a9a2c804d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:56.520353 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1dc2de79-3654-423f-a4ee-d37a9a2c804d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:56.520859 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1dc2de79-3654-423f-a4ee-d37a9a2c804d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:56.521650 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1dc2de79-3654-423f-a4ee-d37a9a2c804d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:56.522081 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1dc2de79-3654-423f-a4ee-d37a9a2c804d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:56.667373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1dc2de79-3654-423f-a4ee-d37a9a2c804d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:56.675526 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1dc2de79-3654-423f-a4ee-d37a9a2c804d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1357 microversion: 2.1 time: 0.166385 Feb 21 01:44:56.676176 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1149/2275] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:56 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:44:57.693189 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-db44225b-9663-44e2-85e3-2ae13b2eeb19 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:57.693871 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-db44225b-9663-44e2-85e3-2ae13b2eeb19 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:57.700676 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-db44225b-9663-44e2-85e3-2ae13b2eeb19 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:57.701118 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-db44225b-9663-44e2-85e3-2ae13b2eeb19 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:57.701902 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-db44225b-9663-44e2-85e3-2ae13b2eeb19 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:57.702331 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-db44225b-9663-44e2-85e3-2ae13b2eeb19 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:57.869007 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-db44225b-9663-44e2-85e3-2ae13b2eeb19 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:57.887882 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-db44225b-9663-44e2-85e3-2ae13b2eeb19 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1357 microversion: 2.1 time: 0.191101 Feb 21 01:44:57.887882 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1127/2276] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:57 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:58.899003 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f0e380cb-6bb6-4bd9-9f75-cd8d7ef0c347 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:58.899653 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f0e380cb-6bb6-4bd9-9f75-cd8d7ef0c347 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:58.906012 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f0e380cb-6bb6-4bd9-9f75-cd8d7ef0c347 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:58.906460 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f0e380cb-6bb6-4bd9-9f75-cd8d7ef0c347 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:58.907251 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f0e380cb-6bb6-4bd9-9f75-cd8d7ef0c347 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:58.910745 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f0e380cb-6bb6-4bd9-9f75-cd8d7ef0c347 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:59.075373 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f0e380cb-6bb6-4bd9-9f75-cd8d7ef0c347 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:59.083295 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f0e380cb-6bb6-4bd9-9f75-cd8d7ef0c347 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1357 microversion: 2.1 time: 0.188591 Feb 21 01:44:59.083886 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1150/2277] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:58 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:00.099580 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-349ded06-4e48-4e5f-90c7-98bdde6380cb tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:00.100256 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-349ded06-4e48-4e5f-90c7-98bdde6380cb tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:00.106673 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-349ded06-4e48-4e5f-90c7-98bdde6380cb tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:00.107117 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-349ded06-4e48-4e5f-90c7-98bdde6380cb tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:00.107912 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-349ded06-4e48-4e5f-90c7-98bdde6380cb tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:00.108340 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-349ded06-4e48-4e5f-90c7-98bdde6380cb tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:00.510363 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-349ded06-4e48-4e5f-90c7-98bdde6380cb tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:00.518095 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-349ded06-4e48-4e5f-90c7-98bdde6380cb tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1357 microversion: 2.1 time: 0.422121 Feb 21 01:45:00.521551 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1128/2278] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:00 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1357 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:01.535030 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-dd66b591-9dfe-4ee8-ae96-0aadaaa95b4c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:01.535666 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-dd66b591-9dfe-4ee8-ae96-0aadaaa95b4c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:01.542589 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dd66b591-9dfe-4ee8-ae96-0aadaaa95b4c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:01.542916 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dd66b591-9dfe-4ee8-ae96-0aadaaa95b4c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:01.543704 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dd66b591-9dfe-4ee8-ae96-0aadaaa95b4c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:01.544167 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-dd66b591-9dfe-4ee8-ae96-0aadaaa95b4c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:01.682033 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-dd66b591-9dfe-4ee8-ae96-0aadaaa95b4c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:01.689329 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-dd66b591-9dfe-4ee8-ae96-0aadaaa95b4c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1357 microversion: 2.1 time: 0.157989 Feb 21 01:45:01.689885 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1151/2279] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:01 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:02.705998 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-53dbba44-3608-45eb-a14e-3f7d6a908522 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:02.706599 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-53dbba44-3608-45eb-a14e-3f7d6a908522 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:02.712806 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-53dbba44-3608-45eb-a14e-3f7d6a908522 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:02.713248 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-53dbba44-3608-45eb-a14e-3f7d6a908522 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:02.714008 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-53dbba44-3608-45eb-a14e-3f7d6a908522 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:02.714430 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-53dbba44-3608-45eb-a14e-3f7d6a908522 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:02.881763 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-53dbba44-3608-45eb-a14e-3f7d6a908522 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:02.889353 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-53dbba44-3608-45eb-a14e-3f7d6a908522 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1357 microversion: 2.1 time: 0.187196 Feb 21 01:45:02.890005 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1129/2280] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:02 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:03.579714 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-3d75ef3d-fd87-45ee-96d1-dbad8ea966b7 req-1730f91c-3cce-45c0-8b2c-2a2d1bdd0d81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "167000a9-5d15-457c-91ac-8409b331fc84", "tag": "a1bec422-738e-42ae-a84f-eb6a1b1e1918"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:45:03.581863 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:45:03.581863 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:45:03.588900 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-3d75ef3d-fd87-45ee-96d1-dbad8ea966b7 req-1730f91c-3cce-45c0-8b2c-2a2d1bdd0d81 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:03.589343 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-3d75ef3d-fd87-45ee-96d1-dbad8ea966b7 req-1730f91c-3cce-45c0-8b2c-2a2d1bdd0d81 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:03.604463 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-3d75ef3d-fd87-45ee-96d1-dbad8ea966b7 req-1730f91c-3cce-45c0-8b2c-2a2d1bdd0d81 service nova] Creating event network-changed:a1bec422-738e-42ae-a84f-eb6a1b1e1918 for instance 167000a9-5d15-457c-91ac-8409b331fc84 on hv-cinder-81322 Feb 21 01:45:03.608678 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-3d75ef3d-fd87-45ee-96d1-dbad8ea966b7 req-1730f91c-3cce-45c0-8b2c-2a2d1bdd0d81 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032471 Feb 21 01:45:03.609367 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1152/2281] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:45:03.906022 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a8e44a49-cc4c-4ee9-8cb7-81efc540cd91 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:03.907157 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a8e44a49-cc4c-4ee9-8cb7-81efc540cd91 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:03.913032 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a8e44a49-cc4c-4ee9-8cb7-81efc540cd91 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:03.913504 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a8e44a49-cc4c-4ee9-8cb7-81efc540cd91 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:03.914970 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a8e44a49-cc4c-4ee9-8cb7-81efc540cd91 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:03.915399 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a8e44a49-cc4c-4ee9-8cb7-81efc540cd91 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:04.120178 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-a8e44a49-cc4c-4ee9-8cb7-81efc540cd91 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:04.127212 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a8e44a49-cc4c-4ee9-8cb7-81efc540cd91 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1357 microversion: 2.1 time: 0.224872 Feb 21 01:45:04.127778 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1130/2282] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:03 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:05.145450 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4347da55-8ed9-42ec-9a10-d7823d233a9b tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:05.146143 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4347da55-8ed9-42ec-9a10-d7823d233a9b tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:05.152277 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4347da55-8ed9-42ec-9a10-d7823d233a9b tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:05.152719 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4347da55-8ed9-42ec-9a10-d7823d233a9b tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:05.153480 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4347da55-8ed9-42ec-9a10-d7823d233a9b tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:05.153908 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4347da55-8ed9-42ec-9a10-d7823d233a9b tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:05.290520 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-4347da55-8ed9-42ec-9a10-d7823d233a9b tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:05.297746 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4347da55-8ed9-42ec-9a10-d7823d233a9b tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1357 microversion: 2.1 time: 0.156804 Feb 21 01:45:05.298306 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1153/2283] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:05 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:06.314782 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4ac590ba-f2ff-41a3-916a-80d645565480 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:06.315371 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4ac590ba-f2ff-41a3-916a-80d645565480 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:06.322112 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ac590ba-f2ff-41a3-916a-80d645565480 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:06.322559 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ac590ba-f2ff-41a3-916a-80d645565480 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:06.323336 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ac590ba-f2ff-41a3-916a-80d645565480 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:06.323774 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4ac590ba-f2ff-41a3-916a-80d645565480 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:06.457953 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4ac590ba-f2ff-41a3-916a-80d645565480 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:06.465812 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4ac590ba-f2ff-41a3-916a-80d645565480 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1357 microversion: 2.1 time: 0.154835 Feb 21 01:45:06.466385 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1131/2284] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:06 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:07.483958 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-afdc50e4-1051-4c1d-b319-212a6f440bd8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:07.484611 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-afdc50e4-1051-4c1d-b319-212a6f440bd8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:07.490878 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-afdc50e4-1051-4c1d-b319-212a6f440bd8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:07.491333 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-afdc50e4-1051-4c1d-b319-212a6f440bd8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:07.492173 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-afdc50e4-1051-4c1d-b319-212a6f440bd8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:07.492723 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-afdc50e4-1051-4c1d-b319-212a6f440bd8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:07.623005 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-afdc50e4-1051-4c1d-b319-212a6f440bd8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:07.630258 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-afdc50e4-1051-4c1d-b319-212a6f440bd8 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1357 microversion: 2.1 time: 0.149963 Feb 21 01:45:07.631024 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1154/2285] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:07 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:08.647247 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-56cd9bc6-6023-45b2-aa79-479de7ccecab tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:08.647811 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-56cd9bc6-6023-45b2-aa79-479de7ccecab tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:08.655075 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-56cd9bc6-6023-45b2-aa79-479de7ccecab tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:08.655524 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-56cd9bc6-6023-45b2-aa79-479de7ccecab tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:08.656327 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-56cd9bc6-6023-45b2-aa79-479de7ccecab tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:08.656857 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-56cd9bc6-6023-45b2-aa79-479de7ccecab tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:08.937004 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-56cd9bc6-6023-45b2-aa79-479de7ccecab tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:08.944108 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-56cd9bc6-6023-45b2-aa79-479de7ccecab tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1357 microversion: 2.1 time: 0.300562 Feb 21 01:45:08.944671 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1132/2286] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:08 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1357 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:09.202577 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-6bc94c2d-77a7-4c50-8d78-487b30a472f5 req-72347235-b2d5-489b-8963-90073c4f9881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "167000a9-5d15-457c-91ac-8409b331fc84", "name": "network-vif-plugged", "status": "completed", "tag": "a1bec422-738e-42ae-a84f-eb6a1b1e1918"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:45:09.204161 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:45:09.204161 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:45:09.211328 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-6bc94c2d-77a7-4c50-8d78-487b30a472f5 req-72347235-b2d5-489b-8963-90073c4f9881 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:09.211813 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-6bc94c2d-77a7-4c50-8d78-487b30a472f5 req-72347235-b2d5-489b-8963-90073c4f9881 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:09.222515 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-6bc94c2d-77a7-4c50-8d78-487b30a472f5 req-72347235-b2d5-489b-8963-90073c4f9881 service nova] Creating event network-vif-plugged:a1bec422-738e-42ae-a84f-eb6a1b1e1918 for instance 167000a9-5d15-457c-91ac-8409b331fc84 on hv-cinder-81322 Feb 21 01:45:09.227807 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-6bc94c2d-77a7-4c50-8d78-487b30a472f5 req-72347235-b2d5-489b-8963-90073c4f9881 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028757 Feb 21 01:45:09.228412 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1155/2287] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:45:09.960967 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-7e30d4d4-127b-47e8-b8dc-49b79cb87516 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:09.961590 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-7e30d4d4-127b-47e8-b8dc-49b79cb87516 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:09.968961 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7e30d4d4-127b-47e8-b8dc-49b79cb87516 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:09.969413 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7e30d4d4-127b-47e8-b8dc-49b79cb87516 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:09.970181 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7e30d4d4-127b-47e8-b8dc-49b79cb87516 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:09.970612 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-7e30d4d4-127b-47e8-b8dc-49b79cb87516 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:10.103126 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-7e30d4d4-127b-47e8-b8dc-49b79cb87516 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:10.111173 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-7e30d4d4-127b-47e8-b8dc-49b79cb87516 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1357 microversion: 2.1 time: 0.153876 Feb 21 01:45:10.111741 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1133/2288] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:09 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:11.129083 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-69c3cd53-25a6-40d5-a8bc-911d2a86671b tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:11.129700 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-69c3cd53-25a6-40d5-a8bc-911d2a86671b tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:11.135781 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-69c3cd53-25a6-40d5-a8bc-911d2a86671b tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:11.136311 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-69c3cd53-25a6-40d5-a8bc-911d2a86671b tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:11.137087 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-69c3cd53-25a6-40d5-a8bc-911d2a86671b tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:11.137520 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-69c3cd53-25a6-40d5-a8bc-911d2a86671b tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:11.324093 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-69c3cd53-25a6-40d5-a8bc-911d2a86671b tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:11.331619 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-69c3cd53-25a6-40d5-a8bc-911d2a86671b tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1548 microversion: 2.1 time: 0.207064 Feb 21 01:45:11.332207 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1156/2289] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:11 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1548 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:11.348042 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-94e6fa80-c3da-443f-8bab-66835b3f605c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:11.348672 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-94e6fa80-c3da-443f-8bab-66835b3f605c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:11.355553 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-94e6fa80-c3da-443f-8bab-66835b3f605c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:11.356040 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-94e6fa80-c3da-443f-8bab-66835b3f605c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:11.356821 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-94e6fa80-c3da-443f-8bab-66835b3f605c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:11.357251 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-94e6fa80-c3da-443f-8bab-66835b3f605c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:11.487111 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-94e6fa80-c3da-443f-8bab-66835b3f605c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:11.494891 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-94e6fa80-c3da-443f-8bab-66835b3f605c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1548 microversion: 2.1 time: 0.150390 Feb 21 01:45:11.495475 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1134/2290] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:11 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:11.511277 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-174db03e-5d7e-4774-bb3e-b4e1fcfc187a tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:11.514637 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:45:11.514637 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:45:11.515635 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-174db03e-5d7e-4774-bb3e-b4e1fcfc187a tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:11.516410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-174db03e-5d7e-4774-bb3e-b4e1fcfc187a tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Searching by: {'deleted': False, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d'} {{(pid=117139) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 21 01:45:11.522834 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-174db03e-5d7e-4774-bb3e-b4e1fcfc187a tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:11.523283 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-174db03e-5d7e-4774-bb3e-b4e1fcfc187a tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:11.524119 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-174db03e-5d7e-4774-bb3e-b4e1fcfc187a tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:11.524557 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-174db03e-5d7e-4774-bb3e-b4e1fcfc187a tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:11.613429 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.multi_cell_list [None req-174db03e-5d7e-4774-bb3e-b4e1fcfc187a tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117139) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 21 01:45:11.708428 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-174db03e-5d7e-4774-bb3e-b4e1fcfc187a tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.201760 Feb 21 01:45:11.708923 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1157/2291] 10.222.0.91 () {58 vars in 1124 bytes} [Mon Feb 21 01:45:11 2022] GET /compute/v2.1/servers => generated 342 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:45:11.719785 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b4a361e1-dee0-4626-b1d7-a40426a3fe7a tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:11.720423 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b4a361e1-dee0-4626-b1d7-a40426a3fe7a tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:11.726117 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b4a361e1-dee0-4626-b1d7-a40426a3fe7a tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:11.726558 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b4a361e1-dee0-4626-b1d7-a40426a3fe7a tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:11.727322 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b4a361e1-dee0-4626-b1d7-a40426a3fe7a tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:11.727753 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b4a361e1-dee0-4626-b1d7-a40426a3fe7a tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:11.860136 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b4a361e1-dee0-4626-b1d7-a40426a3fe7a tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:11.870333 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b4a361e1-dee0-4626-b1d7-a40426a3fe7a tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1548 microversion: 2.1 time: 0.151256 Feb 21 01:45:11.870333 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1135/2292] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:11 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:13.659203 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d9a4b0e4-f3a8-491b-82ae-3a2f8804f1a0 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eaf3b634-f1f8-4461-bb1c-7025213934a4"}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:45:13.660287 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d9a4b0e4-f3a8-491b-82ae-3a2f8804f1a0 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:13.667224 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d9a4b0e4-f3a8-491b-82ae-3a2f8804f1a0 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:13.667670 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d9a4b0e4-f3a8-491b-82ae-3a2f8804f1a0 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:13.668482 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d9a4b0e4-f3a8-491b-82ae-3a2f8804f1a0 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:13.669069 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d9a4b0e4-f3a8-491b-82ae-3a2f8804f1a0 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:14.298246 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d9a4b0e4-f3a8-491b-82ae-3a2f8804f1a0 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "POST /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.642580 Feb 21 01:45:14.298902 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1158/2293] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Feb 21 01:45:13 2022] POST /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84/os-volume_attachments => generated 194 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:45:16.664610 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-269077bd-3f91-4cd5-8904-9ca1abcbab38 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:16.665164 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-269077bd-3f91-4cd5-8904-9ca1abcbab38 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:16.672233 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-269077bd-3f91-4cd5-8904-9ca1abcbab38 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:16.672686 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-269077bd-3f91-4cd5-8904-9ca1abcbab38 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:16.673460 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-269077bd-3f91-4cd5-8904-9ca1abcbab38 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:16.673897 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-269077bd-3f91-4cd5-8904-9ca1abcbab38 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:16.749993 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.objects.instance [None req-269077bd-3f91-4cd5-8904-9ca1abcbab38 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lazy-loading 'services' on Instance uuid 5a3ff359-a1b9-40d7-abfc-e029467821c0 {{(pid=117138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:45:16.972129 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-269077bd-3f91-4cd5-8904-9ca1abcbab38 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "DELETE /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0/os-volume_attachments/204f0690-9c11-4e4d-95ad-2eeab6034144" status: 202 len: 0 microversion: 2.1 time: 0.311121 Feb 21 01:45:16.972752 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1136/2294] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Feb 21 01:45:16 2022] DELETE /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0/os-volume_attachments/204f0690-9c11-4e4d-95ad-2eeab6034144 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:45:21.802990 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ff23f507-879a-41f2-938b-958c6525a24d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:21.804430 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ff23f507-879a-41f2-938b-958c6525a24d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:21.810929 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ff23f507-879a-41f2-938b-958c6525a24d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:21.811372 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ff23f507-879a-41f2-938b-958c6525a24d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:21.812169 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ff23f507-879a-41f2-938b-958c6525a24d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:21.812601 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ff23f507-879a-41f2-938b-958c6525a24d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:21.946677 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ff23f507-879a-41f2-938b-958c6525a24d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:21.955235 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ff23f507-879a-41f2-938b-958c6525a24d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1594 microversion: 2.1 time: 0.156660 Feb 21 01:45:21.955792 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1159/2295] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:21 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:22.288756 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5e20541b-1efe-4ace-97b6-7aa0456e9a2c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:45:22.295293 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5e20541b-1efe-4ace-97b6-7aa0456e9a2c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:22.296090 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5e20541b-1efe-4ace-97b6-7aa0456e9a2c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:22.319407 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5e20541b-1efe-4ace-97b6-7aa0456e9a2c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Going to try to stop instance {{(pid=117138) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 21 01:45:22.542484 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5e20541b-1efe-4ace-97b6-7aa0456e9a2c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "POST /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0/action" status: 202 len: 0 microversion: 2.1 time: 0.258093 Feb 21 01:45:22.543087 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1137/2296] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Feb 21 01:45:22 2022] POST /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:45:22.551171 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b1467a1b-5202-4b74-9e4b-ab6e39f9e629 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:22.551808 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-b1467a1b-5202-4b74-9e4b-ab6e39f9e629 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:22.559346 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b1467a1b-5202-4b74-9e4b-ab6e39f9e629 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:22.560119 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b1467a1b-5202-4b74-9e4b-ab6e39f9e629 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:22.560913 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b1467a1b-5202-4b74-9e4b-ab6e39f9e629 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:22.561406 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-b1467a1b-5202-4b74-9e4b-ab6e39f9e629 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:22.701052 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-b1467a1b-5202-4b74-9e4b-ab6e39f9e629 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:22.708928 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b1467a1b-5202-4b74-9e4b-ab6e39f9e629 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1675 microversion: 2.1 time: 0.161365 Feb 21 01:45:22.709923 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1160/2297] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:22 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:23.212382 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:45:23.213588 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:45:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:45:23.727481 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-37b59e79-c77c-4c21-827b-9c04ae6534cf tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:23.728208 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-37b59e79-c77c-4c21-827b-9c04ae6534cf tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:23.736100 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-37b59e79-c77c-4c21-827b-9c04ae6534cf tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:23.736538 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-37b59e79-c77c-4c21-827b-9c04ae6534cf tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:23.737351 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-37b59e79-c77c-4c21-827b-9c04ae6534cf tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:23.737776 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-37b59e79-c77c-4c21-827b-9c04ae6534cf tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:23.926449 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-37b59e79-c77c-4c21-827b-9c04ae6534cf tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:23.935156 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-37b59e79-c77c-4c21-827b-9c04ae6534cf tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1675 microversion: 2.1 time: 0.212347 Feb 21 01:45:23.935727 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1138/2298] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:23 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1675 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:24.026005 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-392db082-e24e-4578-b28f-beb4ca50b01a req-441830bd-2a20-45e5-a30c-e74e8a65d304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "167000a9-5d15-457c-91ac-8409b331fc84", "tag": "a1bec422-738e-42ae-a84f-eb6a1b1e1918"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:45:24.027728 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:45:24.027728 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:45:24.036631 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-392db082-e24e-4578-b28f-beb4ca50b01a req-441830bd-2a20-45e5-a30c-e74e8a65d304 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:24.037100 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-392db082-e24e-4578-b28f-beb4ca50b01a req-441830bd-2a20-45e5-a30c-e74e8a65d304 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:24.049286 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-392db082-e24e-4578-b28f-beb4ca50b01a req-441830bd-2a20-45e5-a30c-e74e8a65d304 service nova] Creating event network-changed:a1bec422-738e-42ae-a84f-eb6a1b1e1918 for instance 167000a9-5d15-457c-91ac-8409b331fc84 on hv-cinder-81322 Feb 21 01:45:24.054487 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-392db082-e24e-4578-b28f-beb4ca50b01a req-441830bd-2a20-45e5-a30c-e74e8a65d304 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032099 Feb 21 01:45:24.055260 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1161/2299] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:45:24.954497 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3fd37e56-3e81-4c2d-bbf6-fb2789285e25 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:24.955784 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3fd37e56-3e81-4c2d-bbf6-fb2789285e25 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:24.963439 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3fd37e56-3e81-4c2d-bbf6-fb2789285e25 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:24.964286 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3fd37e56-3e81-4c2d-bbf6-fb2789285e25 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:24.965539 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3fd37e56-3e81-4c2d-bbf6-fb2789285e25 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:24.965987 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3fd37e56-3e81-4c2d-bbf6-fb2789285e25 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:25.109086 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3fd37e56-3e81-4c2d-bbf6-fb2789285e25 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:25.116490 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3fd37e56-3e81-4c2d-bbf6-fb2789285e25 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1675 microversion: 2.1 time: 0.167008 Feb 21 01:45:25.117059 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1139/2300] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:24 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:45:26.134814 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ae9812be-8887-4feb-b3ec-1f06a2a0dae8 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:26.135650 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ae9812be-8887-4feb-b3ec-1f06a2a0dae8 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:26.141913 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ae9812be-8887-4feb-b3ec-1f06a2a0dae8 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:26.142443 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ae9812be-8887-4feb-b3ec-1f06a2a0dae8 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:26.143229 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ae9812be-8887-4feb-b3ec-1f06a2a0dae8 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:26.143655 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ae9812be-8887-4feb-b3ec-1f06a2a0dae8 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:26.297749 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ae9812be-8887-4feb-b3ec-1f06a2a0dae8 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:26.305483 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ae9812be-8887-4feb-b3ec-1f06a2a0dae8 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1675 microversion: 2.1 time: 0.175113 Feb 21 01:45:26.306023 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1162/2301] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:26 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:26.307407 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fe6586d6-9e00-4221-9916-45f6a493f6a5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1723562003"}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:45:26.308174 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fe6586d6-9e00-4221-9916-45f6a493f6a5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:26.314752 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe6586d6-9e00-4221-9916-45f6a493f6a5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:26.315268 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe6586d6-9e00-4221-9916-45f6a493f6a5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:26.316080 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe6586d6-9e00-4221-9916-45f6a493f6a5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:26.316511 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe6586d6-9e00-4221-9916-45f6a493f6a5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:26.449503 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.network.security_group_api [None req-fe6586d6-9e00-4221-9916-45f6a493f6a5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Adding security group 2d4525ec-d1d3-499b-8f2d-f45f7a5bddf3 to port a1bec422-738e-42ae-a84f-eb6a1b1e1918 Feb 21 01:45:26.847485 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fe6586d6-9e00-4221-9916-45f6a493f6a5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "POST /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84/action" status: 202 len: 0 microversion: 2.1 time: 0.543529 Feb 21 01:45:26.857244 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1140/2302] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Feb 21 01:45:26 2022] POST /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84/action => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 01:45:26.859961 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-865f70e5-3f94-46af-9589-fa3f07d01ccd req-17597624-ec23-4385-8eff-61d0f964fe8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "167000a9-5d15-457c-91ac-8409b331fc84", "tag": "a1bec422-738e-42ae-a84f-eb6a1b1e1918"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:45:26.863752 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:45:26.863752 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:45:26.866893 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8cd79618-2484-4af9-81cd-1a8b3fdb291d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:26.868451 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8cd79618-2484-4af9-81cd-1a8b3fdb291d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:26.882360 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8cd79618-2484-4af9-81cd-1a8b3fdb291d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:26.888146 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8cd79618-2484-4af9-81cd-1a8b3fdb291d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:26.889684 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-865f70e5-3f94-46af-9589-fa3f07d01ccd req-17597624-ec23-4385-8eff-61d0f964fe8a service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:26.889684 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-865f70e5-3f94-46af-9589-fa3f07d01ccd req-17597624-ec23-4385-8eff-61d0f964fe8a service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:26.891943 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8cd79618-2484-4af9-81cd-1a8b3fdb291d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:26.891943 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8cd79618-2484-4af9-81cd-1a8b3fdb291d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:26.914899 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-865f70e5-3f94-46af-9589-fa3f07d01ccd req-17597624-ec23-4385-8eff-61d0f964fe8a service nova] Creating event network-changed:a1bec422-738e-42ae-a84f-eb6a1b1e1918 for instance 167000a9-5d15-457c-91ac-8409b331fc84 on hv-cinder-81322 Feb 21 01:45:26.924528 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-865f70e5-3f94-46af-9589-fa3f07d01ccd req-17597624-ec23-4385-8eff-61d0f964fe8a service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074465 Feb 21 01:45:26.925511 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1163/2303] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:45:27.199751 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8cd79618-2484-4af9-81cd-1a8b3fdb291d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:27.208601 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8cd79618-2484-4af9-81cd-1a8b3fdb291d tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1759 microversion: 2.1 time: 0.349512 Feb 21 01:45:27.221045 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1141/2304] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:26 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1759 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:27.323267 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2fd6d155-6159-4d4b-b5ca-cab1871b0242 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:27.325590 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2fd6d155-6159-4d4b-b5ca-cab1871b0242 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:27.332307 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2fd6d155-6159-4d4b-b5ca-cab1871b0242 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:27.333052 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2fd6d155-6159-4d4b-b5ca-cab1871b0242 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:27.333913 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2fd6d155-6159-4d4b-b5ca-cab1871b0242 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:27.334657 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2fd6d155-6159-4d4b-b5ca-cab1871b0242 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:27.500962 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2fd6d155-6159-4d4b-b5ca-cab1871b0242 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:27.508184 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2fd6d155-6159-4d4b-b5ca-cab1871b0242 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1675 microversion: 2.1 time: 0.189270 Feb 21 01:45:27.508751 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1164/2305] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:27 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1675 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:28.525636 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d3958521-5577-4f80-bb7f-7d674505093f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:28.526163 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d3958521-5577-4f80-bb7f-7d674505093f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:28.532748 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d3958521-5577-4f80-bb7f-7d674505093f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:28.533196 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d3958521-5577-4f80-bb7f-7d674505093f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:28.533973 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d3958521-5577-4f80-bb7f-7d674505093f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:28.534409 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d3958521-5577-4f80-bb7f-7d674505093f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:28.666955 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d3958521-5577-4f80-bb7f-7d674505093f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:28.675017 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d3958521-5577-4f80-bb7f-7d674505093f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1675 microversion: 2.1 time: 0.153101 Feb 21 01:45:28.675593 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1142/2306] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:28 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:29.693512 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-8a43469c-79c2-4c71-bcae-174f4df477dd tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:29.694161 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-8a43469c-79c2-4c71-bcae-174f4df477dd tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:29.700954 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8a43469c-79c2-4c71-bcae-174f4df477dd tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:29.701401 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8a43469c-79c2-4c71-bcae-174f4df477dd tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:29.702176 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8a43469c-79c2-4c71-bcae-174f4df477dd tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:29.702612 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-8a43469c-79c2-4c71-bcae-174f4df477dd tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:29.848023 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-8a43469c-79c2-4c71-bcae-174f4df477dd tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:29.856325 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-8a43469c-79c2-4c71-bcae-174f4df477dd tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1675 microversion: 2.1 time: 0.166626 Feb 21 01:45:29.856952 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1165/2307] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:29 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:30.875802 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-64779f9d-5d10-42d9-95b6-97f6b8f10729 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:30.876423 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-64779f9d-5d10-42d9-95b6-97f6b8f10729 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:30.882723 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-64779f9d-5d10-42d9-95b6-97f6b8f10729 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:30.883215 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-64779f9d-5d10-42d9-95b6-97f6b8f10729 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:30.884028 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-64779f9d-5d10-42d9-95b6-97f6b8f10729 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:30.884465 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-64779f9d-5d10-42d9-95b6-97f6b8f10729 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:31.017742 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-64779f9d-5d10-42d9-95b6-97f6b8f10729 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:31.024958 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-64779f9d-5d10-42d9-95b6-97f6b8f10729 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1675 microversion: 2.1 time: 0.153751 Feb 21 01:45:31.025607 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1143/2308] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:30 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:32.041816 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1aaf07f3-911b-4d7a-a5a7-5fb32078bf46 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:32.042378 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1aaf07f3-911b-4d7a-a5a7-5fb32078bf46 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:32.049522 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1aaf07f3-911b-4d7a-a5a7-5fb32078bf46 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:32.049971 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1aaf07f3-911b-4d7a-a5a7-5fb32078bf46 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:32.050748 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1aaf07f3-911b-4d7a-a5a7-5fb32078bf46 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:32.051185 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1aaf07f3-911b-4d7a-a5a7-5fb32078bf46 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:32.186793 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1aaf07f3-911b-4d7a-a5a7-5fb32078bf46 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:32.194008 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1aaf07f3-911b-4d7a-a5a7-5fb32078bf46 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1675 microversion: 2.1 time: 0.155934 Feb 21 01:45:32.194561 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1166/2309] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:32 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:33.211494 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b92120b5-8b49-4b56-88a0-938adee0b9b4 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:33.212145 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b92120b5-8b49-4b56-88a0-938adee0b9b4 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:33.219267 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b92120b5-8b49-4b56-88a0-938adee0b9b4 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:33.219719 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b92120b5-8b49-4b56-88a0-938adee0b9b4 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:33.220528 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b92120b5-8b49-4b56-88a0-938adee0b9b4 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:33.220963 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b92120b5-8b49-4b56-88a0-938adee0b9b4 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:33.351184 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b92120b5-8b49-4b56-88a0-938adee0b9b4 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:33.358689 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b92120b5-8b49-4b56-88a0-938adee0b9b4 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1652 microversion: 2.1 time: 0.150933 Feb 21 01:45:33.359260 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1144/2310] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:33 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1652 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:33.374914 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-498b24d3-7b5e-459f-95e2-09dbf55d7797 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:45:33.381252 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-498b24d3-7b5e-459f-95e2-09dbf55d7797 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:33.381703 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-498b24d3-7b5e-459f-95e2-09dbf55d7797 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:33.403652 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-498b24d3-7b5e-459f-95e2-09dbf55d7797 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Going to try to start instance {{(pid=117139) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 21 01:45:33.610459 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-498b24d3-7b5e-459f-95e2-09dbf55d7797 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "POST /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0/action" status: 202 len: 0 microversion: 2.1 time: 0.239471 Feb 21 01:45:33.611090 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1167/2311] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Feb 21 01:45:33 2022] POST /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:45:33.618832 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-25175b81-5b07-40e5-8a02-b2d319401409 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:33.620805 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-25175b81-5b07-40e5-8a02-b2d319401409 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:33.626417 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-25175b81-5b07-40e5-8a02-b2d319401409 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:33.626868 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-25175b81-5b07-40e5-8a02-b2d319401409 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:33.627642 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-25175b81-5b07-40e5-8a02-b2d319401409 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:33.628098 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-25175b81-5b07-40e5-8a02-b2d319401409 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:33.802064 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-25175b81-5b07-40e5-8a02-b2d319401409 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:33.809869 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-25175b81-5b07-40e5-8a02-b2d319401409 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1661 microversion: 2.1 time: 0.194654 Feb 21 01:45:33.810431 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1145/2312] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:33 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1661 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:34.828701 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-bf64bd1b-2313-4835-9529-26b6cdec2393 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:34.829424 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-bf64bd1b-2313-4835-9529-26b6cdec2393 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:34.835421 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bf64bd1b-2313-4835-9529-26b6cdec2393 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:34.835864 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bf64bd1b-2313-4835-9529-26b6cdec2393 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:34.836655 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bf64bd1b-2313-4835-9529-26b6cdec2393 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:34.837110 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-bf64bd1b-2313-4835-9529-26b6cdec2393 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:34.978036 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-bf64bd1b-2313-4835-9529-26b6cdec2393 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:34.985492 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-bf64bd1b-2313-4835-9529-26b6cdec2393 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1661 microversion: 2.1 time: 0.162182 Feb 21 01:45:34.986087 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1168/2313] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:34 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1661 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:36.003042 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e3728163-26b2-4c04-8545-7358e758f738 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:36.003653 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e3728163-26b2-4c04-8545-7358e758f738 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:36.009542 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e3728163-26b2-4c04-8545-7358e758f738 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:36.009985 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e3728163-26b2-4c04-8545-7358e758f738 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:36.010801 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e3728163-26b2-4c04-8545-7358e758f738 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:36.011258 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e3728163-26b2-4c04-8545-7358e758f738 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:36.155030 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e3728163-26b2-4c04-8545-7358e758f738 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:36.162200 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e3728163-26b2-4c04-8545-7358e758f738 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1665 microversion: 2.1 time: 0.163009 Feb 21 01:45:36.162753 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1146/2314] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:35 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1665 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:44.131085 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7d683c04-36f8-4a1d-b9a3-0731a5259448 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:45:44.131981 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7d683c04-36f8-4a1d-b9a3-0731a5259448 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:44.138223 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7d683c04-36f8-4a1d-b9a3-0731a5259448 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:44.138673 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7d683c04-36f8-4a1d-b9a3-0731a5259448 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:44.139459 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7d683c04-36f8-4a1d-b9a3-0731a5259448 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:44.139912 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7d683c04-36f8-4a1d-b9a3-0731a5259448 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:44.360692 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7d683c04-36f8-4a1d-b9a3-0731a5259448 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "POST /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84/action" status: 202 len: 0 microversion: 2.1 time: 0.233294 Feb 21 01:45:44.361366 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1169/2315] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Feb 21 01:45:44 2022] POST /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:45:44.369460 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1bf28dd0-7f85-4c30-8905-c2d0f98a099f tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:44.373033 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1bf28dd0-7f85-4c30-8905-c2d0f98a099f tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:44.376724 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1bf28dd0-7f85-4c30-8905-c2d0f98a099f tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:44.377174 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1bf28dd0-7f85-4c30-8905-c2d0f98a099f tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:44.378008 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1bf28dd0-7f85-4c30-8905-c2d0f98a099f tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:44.378442 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1bf28dd0-7f85-4c30-8905-c2d0f98a099f tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:44.554410 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1bf28dd0-7f85-4c30-8905-c2d0f98a099f tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:44.562890 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1bf28dd0-7f85-4c30-8905-c2d0f98a099f tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1751 microversion: 2.1 time: 0.197185 Feb 21 01:45:44.563457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1147/2316] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:44 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1751 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:45.581410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-ad1b058c-6ff2-481d-b21d-415f9b2c24e2 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:45.582103 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-ad1b058c-6ff2-481d-b21d-415f9b2c24e2 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:45.588162 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad1b058c-6ff2-481d-b21d-415f9b2c24e2 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:45.588613 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad1b058c-6ff2-481d-b21d-415f9b2c24e2 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:45.589383 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad1b058c-6ff2-481d-b21d-415f9b2c24e2 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:45.589815 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-ad1b058c-6ff2-481d-b21d-415f9b2c24e2 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:45.734430 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-ad1b058c-6ff2-481d-b21d-415f9b2c24e2 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:45.742144 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-ad1b058c-6ff2-481d-b21d-415f9b2c24e2 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1756 microversion: 2.1 time: 0.165198 Feb 21 01:45:45.742710 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1170/2317] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:45 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:45:46.759533 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-456af933-4479-459a-87a8-2f6205e54ab6 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:46.760169 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-456af933-4479-459a-87a8-2f6205e54ab6 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:46.766963 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-456af933-4479-459a-87a8-2f6205e54ab6 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:46.767402 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-456af933-4479-459a-87a8-2f6205e54ab6 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:46.768193 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-456af933-4479-459a-87a8-2f6205e54ab6 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:46.768620 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-456af933-4479-459a-87a8-2f6205e54ab6 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:46.909906 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-456af933-4479-459a-87a8-2f6205e54ab6 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:46.917693 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-456af933-4479-459a-87a8-2f6205e54ab6 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1756 microversion: 2.1 time: 0.161819 Feb 21 01:45:46.918267 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1148/2318] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:46 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:47.934287 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-af5d07ad-c029-44a8-9850-e77ee92ebaf7 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:47.934972 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-af5d07ad-c029-44a8-9850-e77ee92ebaf7 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:47.941201 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-af5d07ad-c029-44a8-9850-e77ee92ebaf7 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:47.941637 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-af5d07ad-c029-44a8-9850-e77ee92ebaf7 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:47.942405 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-af5d07ad-c029-44a8-9850-e77ee92ebaf7 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:47.942827 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-af5d07ad-c029-44a8-9850-e77ee92ebaf7 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:48.085593 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-af5d07ad-c029-44a8-9850-e77ee92ebaf7 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:48.094453 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-af5d07ad-c029-44a8-9850-e77ee92ebaf7 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1756 microversion: 2.1 time: 0.163829 Feb 21 01:45:48.095018 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1171/2319] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:47 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:49.111191 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-13ab0a51-8c33-4911-b74e-1f6069c98539 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:49.111811 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-13ab0a51-8c33-4911-b74e-1f6069c98539 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:49.118010 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-13ab0a51-8c33-4911-b74e-1f6069c98539 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:49.118451 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-13ab0a51-8c33-4911-b74e-1f6069c98539 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:49.119214 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-13ab0a51-8c33-4911-b74e-1f6069c98539 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:49.119639 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-13ab0a51-8c33-4911-b74e-1f6069c98539 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:49.265931 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-13ab0a51-8c33-4911-b74e-1f6069c98539 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:49.273779 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-13ab0a51-8c33-4911-b74e-1f6069c98539 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1756 microversion: 2.1 time: 0.166267 Feb 21 01:45:49.274347 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1149/2320] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:49 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:50.070129 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:45:50.070379 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:45:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:45:50.290213 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-260d7256-2583-4061-847a-abe391579cb5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:50.290825 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-260d7256-2583-4061-847a-abe391579cb5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:50.297193 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-260d7256-2583-4061-847a-abe391579cb5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:50.297643 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-260d7256-2583-4061-847a-abe391579cb5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:50.298418 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-260d7256-2583-4061-847a-abe391579cb5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:50.298852 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-260d7256-2583-4061-847a-abe391579cb5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:50.442977 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-260d7256-2583-4061-847a-abe391579cb5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:50.450590 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-260d7256-2583-4061-847a-abe391579cb5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1756 microversion: 2.1 time: 0.164021 Feb 21 01:45:50.451139 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1172/2321] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:50 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:51.467434 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-6077ed57-0998-4938-aaa8-d257f5aae8eb tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:51.468084 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-6077ed57-0998-4938-aaa8-d257f5aae8eb tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:51.474450 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6077ed57-0998-4938-aaa8-d257f5aae8eb tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:51.474888 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6077ed57-0998-4938-aaa8-d257f5aae8eb tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:51.475644 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6077ed57-0998-4938-aaa8-d257f5aae8eb tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:51.476129 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-6077ed57-0998-4938-aaa8-d257f5aae8eb tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:51.628090 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-6077ed57-0998-4938-aaa8-d257f5aae8eb tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:51.635989 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-6077ed57-0998-4938-aaa8-d257f5aae8eb tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1756 microversion: 2.1 time: 0.172373 Feb 21 01:45:51.647193 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1150/2322] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:51 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:52.654365 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d81af93a-5288-4e46-9981-8360f7dbb7fd tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:52.654911 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d81af93a-5288-4e46-9981-8360f7dbb7fd tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:52.661453 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d81af93a-5288-4e46-9981-8360f7dbb7fd tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:52.661891 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d81af93a-5288-4e46-9981-8360f7dbb7fd tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:52.662650 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d81af93a-5288-4e46-9981-8360f7dbb7fd tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:52.663075 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d81af93a-5288-4e46-9981-8360f7dbb7fd tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:52.807998 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d81af93a-5288-4e46-9981-8360f7dbb7fd tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:52.815676 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d81af93a-5288-4e46-9981-8360f7dbb7fd tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1756 microversion: 2.1 time: 0.164966 Feb 21 01:45:52.816265 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1173/2323] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:52 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:53.831441 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b5a5832b-1cd7-40e8-aee9-f7b818945880 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:53.832067 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-b5a5832b-1cd7-40e8-aee9-f7b818945880 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:53.838174 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b5a5832b-1cd7-40e8-aee9-f7b818945880 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:53.838614 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b5a5832b-1cd7-40e8-aee9-f7b818945880 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:53.839377 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b5a5832b-1cd7-40e8-aee9-f7b818945880 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:53.839800 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-b5a5832b-1cd7-40e8-aee9-f7b818945880 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:53.989832 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-b5a5832b-1cd7-40e8-aee9-f7b818945880 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:53.997527 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b5a5832b-1cd7-40e8-aee9-f7b818945880 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1756 microversion: 2.1 time: 0.169845 Feb 21 01:45:53.998095 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1151/2324] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:53 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:55.014735 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-61f2f4c8-3b3c-400a-9b17-6de5c9d82339 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:55.016108 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-61f2f4c8-3b3c-400a-9b17-6de5c9d82339 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:55.022246 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-61f2f4c8-3b3c-400a-9b17-6de5c9d82339 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:55.022630 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-61f2f4c8-3b3c-400a-9b17-6de5c9d82339 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:55.023394 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-61f2f4c8-3b3c-400a-9b17-6de5c9d82339 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:55.023821 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-61f2f4c8-3b3c-400a-9b17-6de5c9d82339 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:55.170976 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-61f2f4c8-3b3c-400a-9b17-6de5c9d82339 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:55.178781 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-61f2f4c8-3b3c-400a-9b17-6de5c9d82339 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1756 microversion: 2.1 time: 0.167731 Feb 21 01:45:55.179350 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1174/2325] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:55 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:56.195895 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0fb50626-065b-4872-ae7f-3f216a9c4c20 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:56.196551 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0fb50626-065b-4872-ae7f-3f216a9c4c20 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:56.202586 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0fb50626-065b-4872-ae7f-3f216a9c4c20 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:56.203032 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0fb50626-065b-4872-ae7f-3f216a9c4c20 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:56.203798 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0fb50626-065b-4872-ae7f-3f216a9c4c20 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:56.204256 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0fb50626-065b-4872-ae7f-3f216a9c4c20 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:56.351815 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0fb50626-065b-4872-ae7f-3f216a9c4c20 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:56.359534 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0fb50626-065b-4872-ae7f-3f216a9c4c20 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1759 microversion: 2.1 time: 0.167389 Feb 21 01:45:56.360361 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1152/2326] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:56 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:08.621733 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c7bf8dbe-370d-44b4-b2c9-76c0f4cc2569 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:08.622765 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c7bf8dbe-370d-44b4-b2c9-76c0f4cc2569 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:08.629284 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c7bf8dbe-370d-44b4-b2c9-76c0f4cc2569 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:08.629742 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c7bf8dbe-370d-44b4-b2c9-76c0f4cc2569 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:08.630518 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c7bf8dbe-370d-44b4-b2c9-76c0f4cc2569 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:08.630961 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c7bf8dbe-370d-44b4-b2c9-76c0f4cc2569 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:08.659821 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c7bf8dbe-370d-44b4-b2c9-76c0f4cc2569 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041875 Feb 21 01:46:08.660389 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1175/2327] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:46:08 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 01:46:08.713724 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1775b67b-b934-4d31-bb03-bfcde82fa35d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:08.714244 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1775b67b-b934-4d31-bb03-bfcde82fa35d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:08.720789 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1775b67b-b934-4d31-bb03-bfcde82fa35d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:08.721227 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1775b67b-b934-4d31-bb03-bfcde82fa35d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:08.721988 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1775b67b-b934-4d31-bb03-bfcde82fa35d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:08.722414 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1775b67b-b934-4d31-bb03-bfcde82fa35d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:08.746451 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1775b67b-b934-4d31-bb03-bfcde82fa35d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Going to try to terminate instance {{(pid=117138) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:46:09.088611 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1775b67b-b934-4d31-bb03-bfcde82fa35d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "DELETE /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 204 len: 0 microversion: 2.1 time: 0.378116 Feb 21 01:46:09.089192 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1153/2328] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Feb 21 01:46:08 2022] DELETE /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:46:09.098221 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-33679bb6-00d5-4dcc-8fbf-5bc0e870377c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:09.098826 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-33679bb6-00d5-4dcc-8fbf-5bc0e870377c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:09.105388 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-33679bb6-00d5-4dcc-8fbf-5bc0e870377c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:09.105825 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-33679bb6-00d5-4dcc-8fbf-5bc0e870377c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:09.106591 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-33679bb6-00d5-4dcc-8fbf-5bc0e870377c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:09.107016 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-33679bb6-00d5-4dcc-8fbf-5bc0e870377c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:09.237577 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-33679bb6-00d5-4dcc-8fbf-5bc0e870377c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:09.245974 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-33679bb6-00d5-4dcc-8fbf-5bc0e870377c tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1671 microversion: 2.1 time: 0.152207 Feb 21 01:46:09.246566 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1176/2329] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:09 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:46:10.265191 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-3b5eb98b-0cf1-4603-9551-5a878d65282d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:10.265891 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-3b5eb98b-0cf1-4603-9551-5a878d65282d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:10.272178 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3b5eb98b-0cf1-4603-9551-5a878d65282d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:10.272627 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3b5eb98b-0cf1-4603-9551-5a878d65282d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:10.273400 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3b5eb98b-0cf1-4603-9551-5a878d65282d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:10.273834 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-3b5eb98b-0cf1-4603-9551-5a878d65282d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:10.411188 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-3b5eb98b-0cf1-4603-9551-5a878d65282d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:10.418609 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-3b5eb98b-0cf1-4603-9551-5a878d65282d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1671 microversion: 2.1 time: 0.157505 Feb 21 01:46:10.419169 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1154/2330] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:10 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:11.436319 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5b00a297-118d-49d8-8dc8-7d75b1b82393 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:11.437574 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5b00a297-118d-49d8-8dc8-7d75b1b82393 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:11.443889 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5b00a297-118d-49d8-8dc8-7d75b1b82393 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:11.444461 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5b00a297-118d-49d8-8dc8-7d75b1b82393 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:11.445247 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5b00a297-118d-49d8-8dc8-7d75b1b82393 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:11.445674 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5b00a297-118d-49d8-8dc8-7d75b1b82393 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:11.586887 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5b00a297-118d-49d8-8dc8-7d75b1b82393 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:11.594677 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5b00a297-118d-49d8-8dc8-7d75b1b82393 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1671 microversion: 2.1 time: 0.161958 Feb 21 01:46:11.595378 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1177/2331] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:11 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:12.271826 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-16cbbeab-3cea-4928-9f4c-68cc4c9a1071 req-d1205a3f-6d0a-47b5-aa96-11734fad4d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a3ff359-a1b9-40d7-abfc-e029467821c0", "name": "network-vif-deleted", "tag": "c923cc2b-497f-4943-9395-abe6369e159f"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:46:12.273470 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:46:12.273470 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:46:12.280614 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-16cbbeab-3cea-4928-9f4c-68cc4c9a1071 req-d1205a3f-6d0a-47b5-aa96-11734fad4d40 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:12.281055 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-16cbbeab-3cea-4928-9f4c-68cc4c9a1071 req-d1205a3f-6d0a-47b5-aa96-11734fad4d40 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:12.306626 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-16cbbeab-3cea-4928-9f4c-68cc4c9a1071 req-d1205a3f-6d0a-47b5-aa96-11734fad4d40 service nova] Creating event network-vif-deleted:c923cc2b-497f-4943-9395-abe6369e159f for instance 5a3ff359-a1b9-40d7-abfc-e029467821c0 on hv-cinder-81322 Feb 21 01:46:12.306626 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-16cbbeab-3cea-4928-9f4c-68cc4c9a1071 req-d1205a3f-6d0a-47b5-aa96-11734fad4d40 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030409 Feb 21 01:46:12.306626 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1155/2332] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:46:12.612662 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-83e6df81-24f5-4a93-8d2e-36dc2ea780f3 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:12.613222 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-83e6df81-24f5-4a93-8d2e-36dc2ea780f3 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:12.619633 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83e6df81-24f5-4a93-8d2e-36dc2ea780f3 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:12.620114 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83e6df81-24f5-4a93-8d2e-36dc2ea780f3 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:12.620904 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83e6df81-24f5-4a93-8d2e-36dc2ea780f3 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:12.621339 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83e6df81-24f5-4a93-8d2e-36dc2ea780f3 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:12.654579 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83e6df81-24f5-4a93-8d2e-36dc2ea780f3 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:12.655056 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-83e6df81-24f5-4a93-8d2e-36dc2ea780f3 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:12.655502 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.objects.instance [None req-83e6df81-24f5-4a93-8d2e-36dc2ea780f3 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lazy-loading 'fault' on Instance uuid 5a3ff359-a1b9-40d7-abfc-e029467821c0 {{(pid=117139) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:46:12.694872 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-83e6df81-24f5-4a93-8d2e-36dc2ea780f3 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:12.702055 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-83e6df81-24f5-4a93-8d2e-36dc2ea780f3 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 200 len: 1327 microversion: 2.1 time: 0.093986 Feb 21 01:46:12.702617 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1178/2333] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:12 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:13.721524 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9c1cfa93-e45e-4016-8019-b1c350101007 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:13.722249 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9c1cfa93-e45e-4016-8019-b1c350101007 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:13.728463 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9c1cfa93-e45e-4016-8019-b1c350101007 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:13.728915 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9c1cfa93-e45e-4016-8019-b1c350101007 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:13.729688 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9c1cfa93-e45e-4016-8019-b1c350101007 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:13.730121 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9c1cfa93-e45e-4016-8019-b1c350101007 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:13.744153 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.wsgi [None req-9c1cfa93-e45e-4016-8019-b1c350101007 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] HTTP exception thrown: Instance 5a3ff359-a1b9-40d7-abfc-e029467821c0 could not be found. Feb 21 01:46:13.744732 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9c1cfa93-e45e-4016-8019-b1c350101007 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Returning 404 to user: Instance 5a3ff359-a1b9-40d7-abfc-e029467821c0 could not be found. {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:46:13.745540 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9c1cfa93-e45e-4016-8019-b1c350101007 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 404 len: 111 microversion: 2.1 time: 0.029496 Feb 21 01:46:13.746068 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1156/2334] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:13 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:46:13.754289 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e78cedec-eff6-475c-820b-4905ac2622bb tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '.version_select at 0x7f4ace76a5e0>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:13.839038 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e78cedec-eff6-475c-820b-4905ac2622bb tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-594803392" status: 202 len: 0 microversion: 2.1 time: 0.088425 Feb 21 01:46:13.839601 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1179/2335] 10.222.0.91 () {58 vars in 1217 bytes} [Mon Feb 21 01:46:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-594803392 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:46:14.595254 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4d4d8632-52a2-4ac5-a84e-233535e38db4 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Action: 'create', calling method: .version_select at 0x7f4ace775dc0>, body: {"keypair": {"name": "tempest-keypair-501323334"}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:46:14.609108 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-4d4d8632-52a2-4ac5-a84e-233535e38db4 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Getting quotas for project 40d1276aa84a48ab830165304f9d6f74. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:46:14.614111 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-4d4d8632-52a2-4ac5-a84e-233535e38db4 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Getting quotas for user 7ae637d5f7f941d8b3b3264c786faddc and project 40d1276aa84a48ab830165304f9d6f74. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:46:14.893897 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-4d4d8632-52a2-4ac5-a84e-233535e38db4 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Getting quotas for project 40d1276aa84a48ab830165304f9d6f74. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:46:14.897530 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-4d4d8632-52a2-4ac5-a84e-233535e38db4 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Getting quotas for user 7ae637d5f7f941d8b3b3264c786faddc and project 40d1276aa84a48ab830165304f9d6f74. Resources: {'key_pairs'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:46:14.910540 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4d4d8632-52a2-4ac5-a84e-233535e38db4 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.319820 Feb 21 01:46:14.911120 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1157/2336] 10.222.0.91 () {60 vars in 1157 bytes} [Mon Feb 21 01:46:14 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:16.979166 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3b26cc60-7614-4913-ba39-2701655e95a9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-340233734", "imageRef": "9b96cc67-20b9-414f-8afb-039ff7953adc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "502ec082-3367-4d95-ab18-937c106fa174"}], "security_groups": [{"name": "tempest-securitygroup--383741376"}], "key_name": "tempest-keypair-501323334", "user_data": "}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:46:17.077578 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.network.neutron [None req-3b26cc60-7614-4913-ba39-2701655e95a9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] validate_networks() for [('502ec082-3367-4d95-ab18-937c106fa174', None, None, None, None, None)] {{(pid=117139) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:46:17.441245 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-3b26cc60-7614-4913-ba39-2701655e95a9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Flavor limits 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:46:17.441671 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-3b26cc60-7614-4913-ba39-2701655e95a9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Image limits 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:46:17.442819 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-3b26cc60-7614-4913-ba39-2701655e95a9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Flavor pref 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:46:17.443273 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-3b26cc60-7614-4913-ba39-2701655e95a9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Image pref 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:46:17.443686 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-3b26cc60-7614-4913-ba39-2701655e95a9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:46:17.452386 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b26cc60-7614-4913-ba39-2701655e95a9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:17.452830 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b26cc60-7614-4913-ba39-2701655e95a9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:17.453641 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b26cc60-7614-4913-ba39-2701655e95a9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:17.454074 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3b26cc60-7614-4913-ba39-2701655e95a9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:17.470825 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.quota [None req-3b26cc60-7614-4913-ba39-2701655e95a9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Getting quotas for project 40d1276aa84a48ab830165304f9d6f74. Resources: {'ram', 'cores', 'instances'} {{(pid=117139) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:46:17.475039 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.quota [None req-3b26cc60-7614-4913-ba39-2701655e95a9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Getting quotas for user 7ae637d5f7f941d8b3b3264c786faddc and project 40d1276aa84a48ab830165304f9d6f74. Resources: {'ram', 'cores', 'instances'} {{(pid=117139) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:46:17.485494 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3b26cc60-7614-4913-ba39-2701655e95a9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Going to run 1 instances... {{(pid=117139) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:46:17.487792 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3b26cc60-7614-4913-ba39-2701655e95a9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b96cc67-20b9-414f-8afb-039ff7953adc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117139) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:46:17.610437 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3b26cc60-7614-4913-ba39-2701655e95a9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.635781 Feb 21 01:46:17.610925 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1180/2337] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Feb 21 01:46:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:46:17.621337 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-ef2bebd5-1f01-4b7f-9a16-66ea9433f64b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:17.621946 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-ef2bebd5-1f01-4b7f-9a16-66ea9433f64b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:17.677047 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-ef2bebd5-1f01-4b7f-9a16-66ea9433f64b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:17.683456 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-ef2bebd5-1f01-4b7f-9a16-66ea9433f64b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e" status: 200 len: 1236 microversion: 2.1 time: 0.066319 Feb 21 01:46:17.684065 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1158/2338] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:17 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e => generated 1236 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:18.700920 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-24a909f0-5c4c-46dc-92d3-e5bebe27005a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:18.701512 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-24a909f0-5c4c-46dc-92d3-e5bebe27005a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:18.708067 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-24a909f0-5c4c-46dc-92d3-e5bebe27005a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:18.708516 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-24a909f0-5c4c-46dc-92d3-e5bebe27005a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:18.709296 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-24a909f0-5c4c-46dc-92d3-e5bebe27005a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:18.709730 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-24a909f0-5c4c-46dc-92d3-e5bebe27005a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:18.768557 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-24a909f0-5c4c-46dc-92d3-e5bebe27005a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:18.776439 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-24a909f0-5c4c-46dc-92d3-e5bebe27005a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e" status: 200 len: 1240 microversion: 2.1 time: 0.079628 Feb 21 01:46:18.776998 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1181/2339] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:18 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e => generated 1240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:19.793319 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4b9eb299-4e77-4495-b8a4-f22dceb4dc16 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:19.793994 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4b9eb299-4e77-4495-b8a4-f22dceb4dc16 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:19.800947 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4b9eb299-4e77-4495-b8a4-f22dceb4dc16 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:19.802610 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4b9eb299-4e77-4495-b8a4-f22dceb4dc16 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:19.803680 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4b9eb299-4e77-4495-b8a4-f22dceb4dc16 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:19.804220 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4b9eb299-4e77-4495-b8a4-f22dceb4dc16 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:19.881916 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4b9eb299-4e77-4495-b8a4-f22dceb4dc16 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:19.889506 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4b9eb299-4e77-4495-b8a4-f22dceb4dc16 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e" status: 200 len: 1294 microversion: 2.1 time: 0.099867 Feb 21 01:46:19.890065 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1159/2340] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:19 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e => generated 1294 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:20.908964 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-cc7fc08f-773f-439c-b842-ee7ee671e751 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:20.912013 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-cc7fc08f-773f-439c-b842-ee7ee671e751 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:20.917028 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cc7fc08f-773f-439c-b842-ee7ee671e751 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:20.917547 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cc7fc08f-773f-439c-b842-ee7ee671e751 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:20.919069 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cc7fc08f-773f-439c-b842-ee7ee671e751 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:20.919504 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cc7fc08f-773f-439c-b842-ee7ee671e751 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:21.076118 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-cc7fc08f-773f-439c-b842-ee7ee671e751 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:21.083363 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-cc7fc08f-773f-439c-b842-ee7ee671e751 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e" status: 200 len: 1361 microversion: 2.1 time: 0.178230 Feb 21 01:46:21.083945 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1182/2341] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:20 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:46:21.164584 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-074c4d26-49e0-4c07-8191-c75734023c7b req-5f7cd020-9439-4983-8063-11a136c060cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e", "tag": "70728816-dfac-4a61-a4d8-7acc78a53bf5"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:46:21.166139 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:46:21.166139 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:46:21.173410 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-074c4d26-49e0-4c07-8191-c75734023c7b req-5f7cd020-9439-4983-8063-11a136c060cc service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:21.173963 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-074c4d26-49e0-4c07-8191-c75734023c7b req-5f7cd020-9439-4983-8063-11a136c060cc service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:21.187068 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-074c4d26-49e0-4c07-8191-c75734023c7b req-5f7cd020-9439-4983-8063-11a136c060cc service nova] Creating event network-changed:70728816-dfac-4a61-a4d8-7acc78a53bf5 for instance 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e on hv-cinder-81322 Feb 21 01:46:21.189826 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-074c4d26-49e0-4c07-8191-c75734023c7b req-5f7cd020-9439-4983-8063-11a136c060cc service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030298 Feb 21 01:46:21.190631 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1160/2342] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:46:22.100093 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-7bf22dd3-6340-46e5-bbd0-7bc079ffc0be tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:22.100694 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-7bf22dd3-6340-46e5-bbd0-7bc079ffc0be tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:22.106898 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7bf22dd3-6340-46e5-bbd0-7bc079ffc0be tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:22.107367 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7bf22dd3-6340-46e5-bbd0-7bc079ffc0be tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:22.108172 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7bf22dd3-6340-46e5-bbd0-7bc079ffc0be tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:22.108590 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-7bf22dd3-6340-46e5-bbd0-7bc079ffc0be tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:22.241211 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-7bf22dd3-6340-46e5-bbd0-7bc079ffc0be tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:22.248254 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-7bf22dd3-6340-46e5-bbd0-7bc079ffc0be tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e" status: 200 len: 1361 microversion: 2.1 time: 0.151763 Feb 21 01:46:22.248834 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1183/2343] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:22 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:23.266122 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f5d5b289-d60f-4ebd-ae3a-fbe4c6e815eb tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:23.266829 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f5d5b289-d60f-4ebd-ae3a-fbe4c6e815eb tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:23.273848 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f5d5b289-d60f-4ebd-ae3a-fbe4c6e815eb tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:23.274301 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f5d5b289-d60f-4ebd-ae3a-fbe4c6e815eb tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:23.275077 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f5d5b289-d60f-4ebd-ae3a-fbe4c6e815eb tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:23.275515 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f5d5b289-d60f-4ebd-ae3a-fbe4c6e815eb tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:23.414275 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f5d5b289-d60f-4ebd-ae3a-fbe4c6e815eb tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:23.421585 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f5d5b289-d60f-4ebd-ae3a-fbe4c6e815eb tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e" status: 200 len: 1361 microversion: 2.1 time: 0.159862 Feb 21 01:46:23.422150 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1161/2344] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:23 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:24.437629 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-13802017-5a48-4f7d-8235-140c0024e956 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:24.438238 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-13802017-5a48-4f7d-8235-140c0024e956 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:24.445143 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-13802017-5a48-4f7d-8235-140c0024e956 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:24.445592 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-13802017-5a48-4f7d-8235-140c0024e956 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:24.446360 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-13802017-5a48-4f7d-8235-140c0024e956 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:24.446811 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-13802017-5a48-4f7d-8235-140c0024e956 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:24.575566 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-13802017-5a48-4f7d-8235-140c0024e956 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:24.582795 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-13802017-5a48-4f7d-8235-140c0024e956 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e" status: 200 len: 1361 microversion: 2.1 time: 0.148763 Feb 21 01:46:24.583357 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1184/2345] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:24 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:25.545465 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-c70c9f9e-cbd0-4cb0-9f97-4ee9b4a6658c req-c99f1134-e5ee-466c-aebc-27b60fc197b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e", "name": "network-vif-plugged", "status": "completed", "tag": "70728816-dfac-4a61-a4d8-7acc78a53bf5"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:46:25.547072 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:46:25.547072 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:46:25.554646 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-c70c9f9e-cbd0-4cb0-9f97-4ee9b4a6658c req-c99f1134-e5ee-466c-aebc-27b60fc197b5 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:25.555014 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-c70c9f9e-cbd0-4cb0-9f97-4ee9b4a6658c req-c99f1134-e5ee-466c-aebc-27b60fc197b5 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:25.565507 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-c70c9f9e-cbd0-4cb0-9f97-4ee9b4a6658c req-c99f1134-e5ee-466c-aebc-27b60fc197b5 service nova] Creating event network-vif-plugged:70728816-dfac-4a61-a4d8-7acc78a53bf5 for instance 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e on hv-cinder-81322 Feb 21 01:46:25.570518 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-c70c9f9e-cbd0-4cb0-9f97-4ee9b4a6658c req-c99f1134-e5ee-466c-aebc-27b60fc197b5 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028741 Feb 21 01:46:25.571094 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1162/2346] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:46:25.600844 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a193f83d-495e-4fda-bf7a-bf465696e576 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:25.601602 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a193f83d-495e-4fda-bf7a-bf465696e576 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:25.608687 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a193f83d-495e-4fda-bf7a-bf465696e576 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:25.609138 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a193f83d-495e-4fda-bf7a-bf465696e576 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:25.610551 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a193f83d-495e-4fda-bf7a-bf465696e576 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:25.610992 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a193f83d-495e-4fda-bf7a-bf465696e576 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:25.753390 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-a193f83d-495e-4fda-bf7a-bf465696e576 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:25.761652 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a193f83d-495e-4fda-bf7a-bf465696e576 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e" status: 200 len: 1361 microversion: 2.1 time: 0.165727 Feb 21 01:46:25.762227 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1185/2347] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:25 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:26.780124 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1a68d5d7-dd7b-4227-9e86-6d42118d615a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:26.780814 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1a68d5d7-dd7b-4227-9e86-6d42118d615a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:26.786805 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1a68d5d7-dd7b-4227-9e86-6d42118d615a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:26.787241 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1a68d5d7-dd7b-4227-9e86-6d42118d615a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:26.788029 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1a68d5d7-dd7b-4227-9e86-6d42118d615a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:26.788724 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1a68d5d7-dd7b-4227-9e86-6d42118d615a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:26.920702 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1a68d5d7-dd7b-4227-9e86-6d42118d615a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:26.927854 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1a68d5d7-dd7b-4227-9e86-6d42118d615a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e" status: 200 len: 1361 microversion: 2.1 time: 0.152189 Feb 21 01:46:26.928414 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1163/2348] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:26 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:27.945168 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-cf7e0706-7fb0-4636-9720-2e1c67192616 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:27.945787 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-cf7e0706-7fb0-4636-9720-2e1c67192616 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:27.952910 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cf7e0706-7fb0-4636-9720-2e1c67192616 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:27.953408 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cf7e0706-7fb0-4636-9720-2e1c67192616 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:27.954204 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cf7e0706-7fb0-4636-9720-2e1c67192616 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:27.954639 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cf7e0706-7fb0-4636-9720-2e1c67192616 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:28.088300 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-cf7e0706-7fb0-4636-9720-2e1c67192616 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:28.095685 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-cf7e0706-7fb0-4636-9720-2e1c67192616 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e" status: 200 len: 1545 microversion: 2.1 time: 0.154214 Feb 21 01:46:28.096268 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1186/2349] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:27 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e => generated 1545 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:28.112168 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-46033950-dbbb-4aa4-b69a-543a015b46f0 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:28.117368 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-46033950-dbbb-4aa4-b69a-543a015b46f0 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:28.120167 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-46033950-dbbb-4aa4-b69a-543a015b46f0 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:28.120622 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-46033950-dbbb-4aa4-b69a-543a015b46f0 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:28.121456 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-46033950-dbbb-4aa4-b69a-543a015b46f0 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:28.121897 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-46033950-dbbb-4aa4-b69a-543a015b46f0 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:28.204895 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-46033950-dbbb-4aa4-b69a-543a015b46f0 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096422 Feb 21 01:46:28.205490 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1164/2350] 10.222.0.91 () {58 vars in 1274 bytes} [Mon Feb 21 01:46:28 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:46:28.567213 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-cf694e10-38c7-4723-bbb4-e76c41a82e99 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1723562003"}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:46:28.568442 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-cf694e10-38c7-4723-bbb4-e76c41a82e99 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:28.573609 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cf694e10-38c7-4723-bbb4-e76c41a82e99 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:28.574055 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cf694e10-38c7-4723-bbb4-e76c41a82e99 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:28.574833 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cf694e10-38c7-4723-bbb4-e76c41a82e99 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:28.575261 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cf694e10-38c7-4723-bbb4-e76c41a82e99 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:28.711795 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.network.security_group_api [None req-cf694e10-38c7-4723-bbb4-e76c41a82e99 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Removing security group 2d4525ec-d1d3-499b-8f2d-f45f7a5bddf3 from port a1bec422-738e-42ae-a84f-eb6a1b1e1918 Feb 21 01:46:29.099306 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-cf694e10-38c7-4723-bbb4-e76c41a82e99 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "POST /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84/action" status: 202 len: 0 microversion: 2.1 time: 0.535768 Feb 21 01:46:29.100622 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1187/2351] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Feb 21 01:46:28 2022] POST /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:46:29.237794 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-35ebbeb6-970d-42b8-a6e0-d5d9810ae610 req-14819baf-eb4d-4831-b592-ddcc1cccdf66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "167000a9-5d15-457c-91ac-8409b331fc84", "tag": "a1bec422-738e-42ae-a84f-eb6a1b1e1918"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:46:29.239362 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:46:29.239362 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:46:29.248917 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-35ebbeb6-970d-42b8-a6e0-d5d9810ae610 req-14819baf-eb4d-4831-b592-ddcc1cccdf66 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:29.249543 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-35ebbeb6-970d-42b8-a6e0-d5d9810ae610 req-14819baf-eb4d-4831-b592-ddcc1cccdf66 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:29.262323 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-35ebbeb6-970d-42b8-a6e0-d5d9810ae610 req-14819baf-eb4d-4831-b592-ddcc1cccdf66 service nova] Creating event network-changed:a1bec422-738e-42ae-a84f-eb6a1b1e1918 for instance 167000a9-5d15-457c-91ac-8409b331fc84 on hv-cinder-81322 Feb 21 01:46:29.267760 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-35ebbeb6-970d-42b8-a6e0-d5d9810ae610 req-14819baf-eb4d-4831-b592-ddcc1cccdf66 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156142 Feb 21 01:46:29.272093 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1165/2352] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:46:29.695661 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-46d647b1-9f2a-4407-82dc-b867f0579383 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:29.697333 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-46d647b1-9f2a-4407-82dc-b867f0579383 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:29.703457 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-46d647b1-9f2a-4407-82dc-b867f0579383 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:29.704175 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-46d647b1-9f2a-4407-82dc-b867f0579383 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:29.705145 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-46d647b1-9f2a-4407-82dc-b867f0579383 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:29.705437 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-2129365a-71ba-45a6-bd8a-6ea296c7c181 req-8c8d0592-da08-4ca1-b57d-823b4efe740a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e", "tag": "70728816-dfac-4a61-a4d8-7acc78a53bf5"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:46:29.705978 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-46d647b1-9f2a-4407-82dc-b867f0579383 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:29.708313 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:46:29.708313 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:46:29.721370 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-2129365a-71ba-45a6-bd8a-6ea296c7c181 req-8c8d0592-da08-4ca1-b57d-823b4efe740a service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:29.722375 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-2129365a-71ba-45a6-bd8a-6ea296c7c181 req-8c8d0592-da08-4ca1-b57d-823b4efe740a service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:29.735023 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-46d647b1-9f2a-4407-82dc-b867f0579383 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/ips" status: 200 len: 104 microversion: 2.1 time: 0.042874 Feb 21 01:46:29.735946 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1188/2353] 10.222.0.91 () {58 vars in 1247 bytes} [Mon Feb 21 01:46:29 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/ips => generated 104 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:46:29.743513 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-2129365a-71ba-45a6-bd8a-6ea296c7c181 req-8c8d0592-da08-4ca1-b57d-823b4efe740a service nova] Creating event network-changed:70728816-dfac-4a61-a4d8-7acc78a53bf5 for instance 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e on hv-cinder-81322 Feb 21 01:46:29.746478 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-2129365a-71ba-45a6-bd8a-6ea296c7c181 req-8c8d0592-da08-4ca1-b57d-823b4efe740a service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046194 Feb 21 01:46:29.748361 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1166/2354] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:46:31.392532 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2121664b-2701-44e9-af50-fe7eb63d20b6 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f039cc3-54c4-4356-ba10-494134f9e543"}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:46:31.393660 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2121664b-2701-44e9-af50-fe7eb63d20b6 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:31.400447 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2121664b-2701-44e9-af50-fe7eb63d20b6 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:31.401154 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2121664b-2701-44e9-af50-fe7eb63d20b6 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:31.402018 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2121664b-2701-44e9-af50-fe7eb63d20b6 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:31.402459 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2121664b-2701-44e9-af50-fe7eb63d20b6 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:31.455804 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-aa707cdf-3c1e-4d5a-a2d6-1061d572c6df tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:31.456465 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-aa707cdf-3c1e-4d5a-a2d6-1061d572c6df tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:31.464178 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-aa707cdf-3c1e-4d5a-a2d6-1061d572c6df tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:31.464843 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-aa707cdf-3c1e-4d5a-a2d6-1061d572c6df tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:31.466300 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-aa707cdf-3c1e-4d5a-a2d6-1061d572c6df tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:31.466857 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-aa707cdf-3c1e-4d5a-a2d6-1061d572c6df tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:31.563334 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.objects.instance [None req-aa707cdf-3c1e-4d5a-a2d6-1061d572c6df tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lazy-loading 'services' on Instance uuid 167000a9-5d15-457c-91ac-8409b331fc84 {{(pid=117138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:46:31.769011 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-aa707cdf-3c1e-4d5a-a2d6-1061d572c6df tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "DELETE /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84/os-volume_attachments/eaf3b634-f1f8-4461-bb1c-7025213934a4" status: 202 len: 0 microversion: 2.1 time: 0.319108 Feb 21 01:46:31.769606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1167/2355] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Feb 21 01:46:31 2022] DELETE /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84/os-volume_attachments/eaf3b634-f1f8-4461-bb1c-7025213934a4 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:46:31.775392 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-43ec954e-0ee4-4758-a319-04ed3096c717 req-042df366-56e6-461b-9530-7a2cfd701a2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "167000a9-5d15-457c-91ac-8409b331fc84", "tag": "a1bec422-738e-42ae-a84f-eb6a1b1e1918"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:46:31.776984 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:46:31.776984 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:46:31.784556 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-43ec954e-0ee4-4758-a319-04ed3096c717 req-042df366-56e6-461b-9530-7a2cfd701a2e service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:31.784991 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-43ec954e-0ee4-4758-a319-04ed3096c717 req-042df366-56e6-461b-9530-7a2cfd701a2e service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:31.797061 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-43ec954e-0ee4-4758-a319-04ed3096c717 req-042df366-56e6-461b-9530-7a2cfd701a2e service nova] Creating event network-changed:a1bec422-738e-42ae-a84f-eb6a1b1e1918 for instance 167000a9-5d15-457c-91ac-8409b331fc84 on hv-cinder-81322 Feb 21 01:46:31.802413 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-43ec954e-0ee4-4758-a319-04ed3096c717 req-042df366-56e6-461b-9530-7a2cfd701a2e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031511 Feb 21 01:46:31.803001 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1168/2356] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:46:31.809053 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a94d0e19-c4de-43a7-9078-e42b339877a5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:31.810057 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a94d0e19-c4de-43a7-9078-e42b339877a5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:31.816170 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a94d0e19-c4de-43a7-9078-e42b339877a5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:31.818710 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a94d0e19-c4de-43a7-9078-e42b339877a5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:31.818710 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a94d0e19-c4de-43a7-9078-e42b339877a5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:31.818710 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a94d0e19-c4de-43a7-9078-e42b339877a5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:31.848669 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a94d0e19-c4de-43a7-9078-e42b339877a5 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044281 Feb 21 01:46:31.849556 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1169/2357] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:46:31 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:46:32.094679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2121664b-2701-44e9-af50-fe7eb63d20b6 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "POST /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.705362 Feb 21 01:46:32.100405 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1189/2358] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Feb 21 01:46:31 2022] POST /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments => generated 194 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:46:32.861737 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-73a4f591-0c04-4d7e-be30-63144d3bda00 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:32.862639 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-73a4f591-0c04-4d7e-be30-63144d3bda00 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:32.869533 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-73a4f591-0c04-4d7e-be30-63144d3bda00 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:32.869976 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-73a4f591-0c04-4d7e-be30-63144d3bda00 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:32.870741 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-73a4f591-0c04-4d7e-be30-63144d3bda00 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:32.871167 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-73a4f591-0c04-4d7e-be30-63144d3bda00 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:32.898177 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-73a4f591-0c04-4d7e-be30-63144d3bda00 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040221 Feb 21 01:46:32.898728 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1170/2359] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:46:32 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 01:46:32.908982 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d23b4d0e-ef66-4d77-b1ff-e71ad7daf158 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:32.909515 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d23b4d0e-ef66-4d77-b1ff-e71ad7daf158 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:32.916564 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d23b4d0e-ef66-4d77-b1ff-e71ad7daf158 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:32.917002 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d23b4d0e-ef66-4d77-b1ff-e71ad7daf158 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:32.917779 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d23b4d0e-ef66-4d77-b1ff-e71ad7daf158 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:32.918213 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d23b4d0e-ef66-4d77-b1ff-e71ad7daf158 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:32.988986 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-d23b4d0e-ef66-4d77-b1ff-e71ad7daf158 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] HTTP exception thrown: Instance 167000a9-5d15-457c-91ac-8409b331fc84 is not attached to volume eaf3b634-f1f8-4461-bb1c-7025213934a4 Feb 21 01:46:32.989582 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d23b4d0e-ef66-4d77-b1ff-e71ad7daf158 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Returning 404 to user: Instance 167000a9-5d15-457c-91ac-8409b331fc84 is not attached to volume eaf3b634-f1f8-4461-bb1c-7025213934a4 {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:46:32.990417 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d23b4d0e-ef66-4d77-b1ff-e71ad7daf158 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "DELETE /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84/os-volume_attachments/eaf3b634-f1f8-4461-bb1c-7025213934a4" status: 404 len: 154 microversion: 2.1 time: 0.085770 Feb 21 01:46:32.990960 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1190/2360] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Feb 21 01:46:32 2022] DELETE /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84/os-volume_attachments/eaf3b634-f1f8-4461-bb1c-7025213934a4 => generated 154 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:46:34.225416 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-bf38c6fc-3e7f-4bb4-ad54-8c9508e44caf tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:34.225916 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-bf38c6fc-3e7f-4bb4-ad54-8c9508e44caf tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:34.232467 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bf38c6fc-3e7f-4bb4-ad54-8c9508e44caf tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:34.232916 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bf38c6fc-3e7f-4bb4-ad54-8c9508e44caf tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:34.233693 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bf38c6fc-3e7f-4bb4-ad54-8c9508e44caf tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:34.234131 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-bf38c6fc-3e7f-4bb4-ad54-8c9508e44caf tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:34.258023 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-bf38c6fc-3e7f-4bb4-ad54-8c9508e44caf tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Going to try to terminate instance {{(pid=117138) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:46:34.523577 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-bf38c6fc-3e7f-4bb4-ad54-8c9508e44caf tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "DELETE /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 204 len: 0 microversion: 2.1 time: 0.301435 Feb 21 01:46:34.524943 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1171/2361] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Feb 21 01:46:34 2022] DELETE /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:46:34.532600 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-707d9109-42be-4c17-a79b-21de0841827f tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:34.533246 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-707d9109-42be-4c17-a79b-21de0841827f tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:34.539506 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-707d9109-42be-4c17-a79b-21de0841827f tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:34.546350 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-707d9109-42be-4c17-a79b-21de0841827f tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:34.546350 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-707d9109-42be-4c17-a79b-21de0841827f tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:34.546350 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-707d9109-42be-4c17-a79b-21de0841827f tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:34.675028 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-707d9109-42be-4c17-a79b-21de0841827f tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:34.682789 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-707d9109-42be-4c17-a79b-21de0841827f tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1554 microversion: 2.1 time: 0.153817 Feb 21 01:46:34.683347 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1191/2362] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:34 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:35.700882 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-41946a01-27e5-463b-8ee9-48d46a249c50 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:35.701496 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-41946a01-27e5-463b-8ee9-48d46a249c50 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:35.707678 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-41946a01-27e5-463b-8ee9-48d46a249c50 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:35.708153 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-41946a01-27e5-463b-8ee9-48d46a249c50 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:35.708928 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-41946a01-27e5-463b-8ee9-48d46a249c50 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:35.709358 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-41946a01-27e5-463b-8ee9-48d46a249c50 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:35.850869 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-41946a01-27e5-463b-8ee9-48d46a249c50 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:35.858251 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-41946a01-27e5-463b-8ee9-48d46a249c50 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1554 microversion: 2.1 time: 0.162119 Feb 21 01:46:35.859658 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1172/2363] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:35 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:36.768451 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-788967a0-d267-46b1-a434-2a89a7a31db7 req-9f50c1b4-a136-495e-8edd-f3207befce87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "167000a9-5d15-457c-91ac-8409b331fc84", "name": "network-vif-deleted", "tag": "a1bec422-738e-42ae-a84f-eb6a1b1e1918"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:46:36.770024 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:46:36.770024 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:46:36.777344 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-788967a0-d267-46b1-a434-2a89a7a31db7 req-9f50c1b4-a136-495e-8edd-f3207befce87 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:36.780214 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-788967a0-d267-46b1-a434-2a89a7a31db7 req-9f50c1b4-a136-495e-8edd-f3207befce87 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:36.788146 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-788967a0-d267-46b1-a434-2a89a7a31db7 req-9f50c1b4-a136-495e-8edd-f3207befce87 service nova] Creating event network-vif-deleted:a1bec422-738e-42ae-a84f-eb6a1b1e1918 for instance 167000a9-5d15-457c-91ac-8409b331fc84 on hv-cinder-81322 Feb 21 01:46:36.793501 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-788967a0-d267-46b1-a434-2a89a7a31db7 req-9f50c1b4-a136-495e-8edd-f3207befce87 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028615 Feb 21 01:46:36.794063 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1192/2364] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:46:36.875001 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e79bebd3-ee92-4b9e-967c-d7a4c230c871 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:36.875633 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e79bebd3-ee92-4b9e-967c-d7a4c230c871 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:36.881840 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e79bebd3-ee92-4b9e-967c-d7a4c230c871 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:36.887103 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e79bebd3-ee92-4b9e-967c-d7a4c230c871 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:36.887103 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e79bebd3-ee92-4b9e-967c-d7a4c230c871 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:36.887103 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e79bebd3-ee92-4b9e-967c-d7a4c230c871 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:36.943864 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-e79bebd3-ee92-4b9e-967c-d7a4c230c871 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0984cd81d2274ef1b480eec8584d780f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf92606a26e43e19b60a51e3eddad9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:36.952200 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e79bebd3-ee92-4b9e-967c-d7a4c230c871 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 200 len: 1512 microversion: 2.1 time: 0.080662 Feb 21 01:46:36.952826 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1173/2365] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:36 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 1512 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:46:37.971013 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f462c65a-118a-43e4-a999-f2e76024182c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:37.971746 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f462c65a-118a-43e4-a999-f2e76024182c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] [instance: 167000a9-5d15-457c-91ac-8409b331fc84] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:37.978205 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f462c65a-118a-43e4-a999-f2e76024182c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:37.978714 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f462c65a-118a-43e4-a999-f2e76024182c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:37.979452 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f462c65a-118a-43e4-a999-f2e76024182c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:37.979919 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f462c65a-118a-43e4-a999-f2e76024182c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:37.992880 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-f462c65a-118a-43e4-a999-f2e76024182c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] HTTP exception thrown: Instance 167000a9-5d15-457c-91ac-8409b331fc84 could not be found. Feb 21 01:46:37.994207 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f462c65a-118a-43e4-a999-f2e76024182c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Returning 404 to user: Instance 167000a9-5d15-457c-91ac-8409b331fc84 could not be found. {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:46:37.995035 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f462c65a-118a-43e4-a999-f2e76024182c tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84" status: 404 len: 111 microversion: 2.1 time: 0.028756 Feb 21 01:46:37.995583 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1193/2366] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:37 2022] GET /compute/v2.1/servers/167000a9-5d15-457c-91ac-8409b331fc84 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:46:38.003532 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-b57b2e53-7534-4819-ac2b-079caed36240 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] Calling method '.version_select at 0x7f4ace88b670>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:38.084645 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-b57b2e53-7534-4819-ac2b-079caed36240 tempest-TestMinimumBasicScenario-818259656 tempest-TestMinimumBasicScenario-818259656-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-650157832" status: 202 len: 0 microversion: 2.1 time: 0.084676 Feb 21 01:46:38.085215 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1174/2367] 10.222.0.91 () {58 vars in 1268 bytes} [Mon Feb 21 01:46:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-650157832 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:46:39.599895 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-a7feb145-b147-474b-8508-fd3609ed370b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:39.600891 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-a7feb145-b147-474b-8508-fd3609ed370b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:39.607625 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a7feb145-b147-474b-8508-fd3609ed370b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:39.608106 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a7feb145-b147-474b-8508-fd3609ed370b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:39.608890 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a7feb145-b147-474b-8508-fd3609ed370b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:39.609328 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-a7feb145-b147-474b-8508-fd3609ed370b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:39.639221 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-a7feb145-b147-474b-8508-fd3609ed370b tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043104 Feb 21 01:46:39.639773 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1194/2368] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:46:39 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:46:39.650013 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-505d86eb-740d-4e41-949f-303bc0350527 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:39.650724 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-505d86eb-740d-4e41-949f-303bc0350527 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:39.657780 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-505d86eb-740d-4e41-949f-303bc0350527 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:39.658154 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-505d86eb-740d-4e41-949f-303bc0350527 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:39.658924 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-505d86eb-740d-4e41-949f-303bc0350527 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:39.659355 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-505d86eb-740d-4e41-949f-303bc0350527 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:39.688299 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-505d86eb-740d-4e41-949f-303bc0350527 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments/1f039cc3-54c4-4356-ba10-494134f9e543" status: 200 len: 194 microversion: 2.1 time: 0.042631 Feb 21 01:46:39.688886 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1175/2369] 10.222.0.91 () {58 vars in 1412 bytes} [Mon Feb 21 01:46:39 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments/1f039cc3-54c4-4356-ba10-494134f9e543 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:46:41.254645 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-400055db-1578-4934-8eac-e1b329e4b688 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23107172-ece0-4ac0-873a-e6bb7f1a8ce9"}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:46:41.255543 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-400055db-1578-4934-8eac-e1b329e4b688 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:41.261754 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-400055db-1578-4934-8eac-e1b329e4b688 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:41.262202 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-400055db-1578-4934-8eac-e1b329e4b688 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:41.263172 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-400055db-1578-4934-8eac-e1b329e4b688 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:41.263613 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-400055db-1578-4934-8eac-e1b329e4b688 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:41.831022 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-400055db-1578-4934-8eac-e1b329e4b688 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "POST /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.580029 Feb 21 01:46:41.831948 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1195/2370] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Feb 21 01:46:41 2022] POST /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments => generated 194 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:46:49.299777 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-dabc5d33-1dd1-420f-a077-ef2bf53ecfb5 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:49.300725 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-dabc5d33-1dd1-420f-a077-ef2bf53ecfb5 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:49.307760 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dabc5d33-1dd1-420f-a077-ef2bf53ecfb5 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:49.308234 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dabc5d33-1dd1-420f-a077-ef2bf53ecfb5 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:49.309004 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dabc5d33-1dd1-420f-a077-ef2bf53ecfb5 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:49.309439 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-dabc5d33-1dd1-420f-a077-ef2bf53ecfb5 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:49.337688 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-dabc5d33-1dd1-420f-a077-ef2bf53ecfb5 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041628 Feb 21 01:46:49.338235 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1176/2371] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:46:49 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:47:03.345753 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-92b9cff4-78e5-4501-afec-460836555861 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:03.346342 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-92b9cff4-78e5-4501-afec-460836555861 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:03.352226 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-92b9cff4-78e5-4501-afec-460836555861 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:03.352672 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-92b9cff4-78e5-4501-afec-460836555861 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:03.353430 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-92b9cff4-78e5-4501-afec-460836555861 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:03.353855 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-92b9cff4-78e5-4501-afec-460836555861 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:03.380987 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-92b9cff4-78e5-4501-afec-460836555861 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments/1f039cc3-54c4-4356-ba10-494134f9e543" status: 200 len: 194 microversion: 2.1 time: 0.040099 Feb 21 01:47:03.381547 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1196/2372] 10.222.0.91 () {58 vars in 1412 bytes} [Mon Feb 21 01:47:03 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments/1f039cc3-54c4-4356-ba10-494134f9e543 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:47:03.391469 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-e4c39af5-e02c-4c7d-9269-02421e0f9c55 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:03.392032 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-e4c39af5-e02c-4c7d-9269-02421e0f9c55 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:03.398124 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e4c39af5-e02c-4c7d-9269-02421e0f9c55 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:03.398561 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e4c39af5-e02c-4c7d-9269-02421e0f9c55 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:03.399330 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e4c39af5-e02c-4c7d-9269-02421e0f9c55 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:03.399757 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-e4c39af5-e02c-4c7d-9269-02421e0f9c55 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:03.479945 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.objects.instance [None req-e4c39af5-e02c-4c7d-9269-02421e0f9c55 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lazy-loading 'services' on Instance uuid 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e {{(pid=117138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:47:03.673185 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-e4c39af5-e02c-4c7d-9269-02421e0f9c55 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "DELETE /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments/1f039cc3-54c4-4356-ba10-494134f9e543" status: 202 len: 0 microversion: 2.1 time: 0.285074 Feb 21 01:47:03.673694 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1177/2373] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Feb 21 01:47:03 2022] DELETE /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments/1f039cc3-54c4-4356-ba10-494134f9e543 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:47:05.828123 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f89523f7-6282-4f47-81b3-e061d99b7a3f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:05.828675 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f89523f7-6282-4f47-81b3-e061d99b7a3f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:05.834802 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f89523f7-6282-4f47-81b3-e061d99b7a3f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:05.838664 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f89523f7-6282-4f47-81b3-e061d99b7a3f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:05.838664 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f89523f7-6282-4f47-81b3-e061d99b7a3f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:05.838664 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f89523f7-6282-4f47-81b3-e061d99b7a3f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:05.864821 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f89523f7-6282-4f47-81b3-e061d99b7a3f tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments/23107172-ece0-4ac0-873a-e6bb7f1a8ce9" status: 200 len: 194 microversion: 2.1 time: 0.041377 Feb 21 01:47:05.865393 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1197/2374] 10.222.0.91 () {58 vars in 1412 bytes} [Mon Feb 21 01:47:05 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments/23107172-ece0-4ac0-873a-e6bb7f1a8ce9 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:47:05.876384 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fe67e75b-a0dc-43d5-9c44-ccfd6ef9eb6e tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:05.877488 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fe67e75b-a0dc-43d5-9c44-ccfd6ef9eb6e tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:05.883368 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe67e75b-a0dc-43d5-9c44-ccfd6ef9eb6e tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:05.883820 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe67e75b-a0dc-43d5-9c44-ccfd6ef9eb6e tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:05.884632 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe67e75b-a0dc-43d5-9c44-ccfd6ef9eb6e tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:05.885074 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fe67e75b-a0dc-43d5-9c44-ccfd6ef9eb6e tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:05.964892 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.objects.instance [None req-fe67e75b-a0dc-43d5-9c44-ccfd6ef9eb6e tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lazy-loading 'services' on Instance uuid 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e {{(pid=117138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:47:06.116895 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fe67e75b-a0dc-43d5-9c44-ccfd6ef9eb6e tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "DELETE /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments/23107172-ece0-4ac0-873a-e6bb7f1a8ce9" status: 202 len: 0 microversion: 2.1 time: 0.244982 Feb 21 01:47:06.117472 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1178/2375] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Feb 21 01:47:05 2022] DELETE /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments/23107172-ece0-4ac0-873a-e6bb7f1a8ce9 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:47:06.180545 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1e446ef3-afe7-436e-b589-a9c0cd91cdf7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:06.181036 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1e446ef3-afe7-436e-b589-a9c0cd91cdf7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:06.187626 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e446ef3-afe7-436e-b589-a9c0cd91cdf7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:06.188097 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e446ef3-afe7-436e-b589-a9c0cd91cdf7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:06.188871 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e446ef3-afe7-436e-b589-a9c0cd91cdf7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:06.189304 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1e446ef3-afe7-436e-b589-a9c0cd91cdf7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:06.203582 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-1e446ef3-afe7-436e-b589-a9c0cd91cdf7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] HTTP exception thrown: Instance d8a1c406-f790-40a9-80d8-975e707b8899 could not be found. Feb 21 01:47:06.204329 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1e446ef3-afe7-436e-b589-a9c0cd91cdf7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Returning 404 to user: Instance d8a1c406-f790-40a9-80d8-975e707b8899 could not be found. {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:47:06.205150 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1e446ef3-afe7-436e-b589-a9c0cd91cdf7 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "DELETE /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899" status: 404 len: 111 microversion: 2.20 time: 0.028347 Feb 21 01:47:06.205794 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1198/2376] 10.222.0.91 () {60 vars in 1279 bytes} [Mon Feb 21 01:47:06 2022] DELETE /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:47:06.214057 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fa459045-0b5b-4cc6-9aa1-4d03e6536fc9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:06.215043 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fa459045-0b5b-4cc6-9aa1-4d03e6536fc9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: d8a1c406-f790-40a9-80d8-975e707b8899] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:06.221282 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fa459045-0b5b-4cc6-9aa1-4d03e6536fc9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:06.222862 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fa459045-0b5b-4cc6-9aa1-4d03e6536fc9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:06.222862 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fa459045-0b5b-4cc6-9aa1-4d03e6536fc9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:06.223084 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fa459045-0b5b-4cc6-9aa1-4d03e6536fc9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:06.236730 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.wsgi [None req-fa459045-0b5b-4cc6-9aa1-4d03e6536fc9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] HTTP exception thrown: Instance d8a1c406-f790-40a9-80d8-975e707b8899 could not be found. Feb 21 01:47:06.237502 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fa459045-0b5b-4cc6-9aa1-4d03e6536fc9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Returning 404 to user: Instance d8a1c406-f790-40a9-80d8-975e707b8899 could not be found. {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:47:06.238337 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fa459045-0b5b-4cc6-9aa1-4d03e6536fc9 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899" status: 404 len: 111 microversion: 2.20 time: 0.028477 Feb 21 01:47:06.238905 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1179/2377] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:47:06 2022] GET /compute/v2.1/servers/d8a1c406-f790-40a9-80d8-975e707b8899 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:47:07.269389 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-aaa7b62c-0afb-4a0b-831b-bbb887fe4565 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:07.270322 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-aaa7b62c-0afb-4a0b-831b-bbb887fe4565 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:07.276554 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aaa7b62c-0afb-4a0b-831b-bbb887fe4565 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:07.276995 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aaa7b62c-0afb-4a0b-831b-bbb887fe4565 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:07.277761 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aaa7b62c-0afb-4a0b-831b-bbb887fe4565 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:07.278191 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-aaa7b62c-0afb-4a0b-831b-bbb887fe4565 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:07.305981 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-aaa7b62c-0afb-4a0b-831b-bbb887fe4565 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040456 Feb 21 01:47:07.306524 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1199/2378] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:47:07 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 01:47:07.413551 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-cc1c9d8a-346d-469b-8b30-22564318ed59 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:07.414523 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-cc1c9d8a-346d-469b-8b30-22564318ed59 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:07.420948 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc1c9d8a-346d-469b-8b30-22564318ed59 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:07.421399 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc1c9d8a-346d-469b-8b30-22564318ed59 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:07.422167 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc1c9d8a-346d-469b-8b30-22564318ed59 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:07.422602 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-cc1c9d8a-346d-469b-8b30-22564318ed59 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:07.451416 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-cc1c9d8a-346d-469b-8b30-22564318ed59 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041543 Feb 21 01:47:07.451905 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1180/2379] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Feb 21 01:47:07 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 01:47:07.482568 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3c026cb0-e8c5-47bc-a16a-87ec27ffd3db tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:07.483065 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3c026cb0-e8c5-47bc-a16a-87ec27ffd3db tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:07.488764 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3c026cb0-e8c5-47bc-a16a-87ec27ffd3db tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:07.489212 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3c026cb0-e8c5-47bc-a16a-87ec27ffd3db tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:07.490012 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3c026cb0-e8c5-47bc-a16a-87ec27ffd3db tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:07.490445 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3c026cb0-e8c5-47bc-a16a-87ec27ffd3db tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:07.506844 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-3c026cb0-e8c5-47bc-a16a-87ec27ffd3db tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] HTTP exception thrown: Instance e2aa103a-4f89-45a6-8c62-09282555e3b3 could not be found. Feb 21 01:47:07.507220 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-60d1df2c-e6cb-45ee-badc-0b65f0b15739 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:07.507431 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3c026cb0-e8c5-47bc-a16a-87ec27ffd3db tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Returning 404 to user: Instance e2aa103a-4f89-45a6-8c62-09282555e3b3 could not be found. {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:47:07.507711 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-60d1df2c-e6cb-45ee-badc-0b65f0b15739 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:07.508283 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3c026cb0-e8c5-47bc-a16a-87ec27ffd3db tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "DELETE /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 404 len: 111 microversion: 2.20 time: 0.030189 Feb 21 01:47:07.508845 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1200/2380] 10.222.0.91 () {60 vars in 1279 bytes} [Mon Feb 21 01:47:07 2022] DELETE /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:47:07.515310 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-60d1df2c-e6cb-45ee-badc-0b65f0b15739 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:07.515752 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-60d1df2c-e6cb-45ee-badc-0b65f0b15739 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:07.516299 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-85c9b792-f5ac-46cb-859f-df0afee1a266 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:07.516550 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-60d1df2c-e6cb-45ee-badc-0b65f0b15739 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:07.516905 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-85c9b792-f5ac-46cb-859f-df0afee1a266 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] [instance: e2aa103a-4f89-45a6-8c62-09282555e3b3] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:07.517040 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-60d1df2c-e6cb-45ee-badc-0b65f0b15739 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:07.522872 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-85c9b792-f5ac-46cb-859f-df0afee1a266 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:07.523325 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-85c9b792-f5ac-46cb-859f-df0afee1a266 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:07.524130 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-85c9b792-f5ac-46cb-859f-df0afee1a266 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:07.524566 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-85c9b792-f5ac-46cb-859f-df0afee1a266 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:07.538118 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-85c9b792-f5ac-46cb-859f-df0afee1a266 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] HTTP exception thrown: Instance e2aa103a-4f89-45a6-8c62-09282555e3b3 could not be found. Feb 21 01:47:07.538700 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-85c9b792-f5ac-46cb-859f-df0afee1a266 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] Returning 404 to user: Instance e2aa103a-4f89-45a6-8c62-09282555e3b3 could not be found. {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:47:07.539544 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-85c9b792-f5ac-46cb-859f-df0afee1a266 tempest-AttachVolumeShelveTestJSON-472729226 tempest-AttachVolumeShelveTestJSON-472729226-project] 10.222.0.91 "GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3" status: 404 len: 111 microversion: 2.20 time: 0.026716 Feb 21 01:47:07.540134 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1201/2381] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Feb 21 01:47:07 2022] GET /compute/v2.1/servers/e2aa103a-4f89-45a6-8c62-09282555e3b3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 21 01:47:07.543947 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-60d1df2c-e6cb-45ee-badc-0b65f0b15739 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Going to try to terminate instance {{(pid=117138) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:47:07.815820 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-60d1df2c-e6cb-45ee-badc-0b65f0b15739 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "DELETE /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e" status: 204 len: 0 microversion: 2.1 time: 0.311805 Feb 21 01:47:07.816408 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1181/2382] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Feb 21 01:47:07 2022] DELETE /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 21 01:47:07.824644 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2d7124b8-462a-4132-adf2-d98c4d49e032 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:07.825329 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2d7124b8-462a-4132-adf2-d98c4d49e032 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:07.831213 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2d7124b8-462a-4132-adf2-d98c4d49e032 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:07.831652 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2d7124b8-462a-4132-adf2-d98c4d49e032 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:07.832542 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2d7124b8-462a-4132-adf2-d98c4d49e032 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:07.833041 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2d7124b8-462a-4132-adf2-d98c4d49e032 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:07.974511 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2d7124b8-462a-4132-adf2-d98c4d49e032 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:47:07.983094 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2d7124b8-462a-4132-adf2-d98c4d49e032 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e" status: 200 len: 1670 microversion: 2.1 time: 0.162524 Feb 21 01:47:07.983708 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1202/2383] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:47:07 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:47:09.001249 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-d3f671b7-96db-4937-a569-e0440e77f66d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:09.001863 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-d3f671b7-96db-4937-a569-e0440e77f66d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:09.008095 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d3f671b7-96db-4937-a569-e0440e77f66d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:09.008543 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d3f671b7-96db-4937-a569-e0440e77f66d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:09.009322 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d3f671b7-96db-4937-a569-e0440e77f66d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:09.009747 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-d3f671b7-96db-4937-a569-e0440e77f66d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:09.500065 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-d3f671b7-96db-4937-a569-e0440e77f66d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:47:09.507958 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-d3f671b7-96db-4937-a569-e0440e77f66d tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e" status: 200 len: 1670 microversion: 2.1 time: 0.510751 Feb 21 01:47:09.511500 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1182/2384] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:47:08 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e => generated 1670 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:47:10.525371 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f207482f-35ce-4894-8553-43bd00e35337 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:10.527575 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f207482f-35ce-4894-8553-43bd00e35337 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:10.557336 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f207482f-35ce-4894-8553-43bd00e35337 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:10.562508 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f207482f-35ce-4894-8553-43bd00e35337 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:10.563518 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f207482f-35ce-4894-8553-43bd00e35337 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:10.564091 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f207482f-35ce-4894-8553-43bd00e35337 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:10.732840 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f207482f-35ce-4894-8553-43bd00e35337 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:47:10.758903 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f207482f-35ce-4894-8553-43bd00e35337 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e" status: 200 len: 1603 microversion: 2.1 time: 0.235975 Feb 21 01:47:10.765822 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1203/2385] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:47:10 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e => generated 1603 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:47:10.909532 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-bf0facbc-3be0-4d06-873a-6215381b45af req-02192079-0f12-4b57-9c2b-ffd0eaad48bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e", "name": "network-vif-deleted", "tag": "70728816-dfac-4a61-a4d8-7acc78a53bf5"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:47:10.910043 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:47:10.910043 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:47:10.918063 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-bf0facbc-3be0-4d06-873a-6215381b45af req-02192079-0f12-4b57-9c2b-ffd0eaad48bd service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:10.918773 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-bf0facbc-3be0-4d06-873a-6215381b45af req-02192079-0f12-4b57-9c2b-ffd0eaad48bd service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:10.930936 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-bf0facbc-3be0-4d06-873a-6215381b45af req-02192079-0f12-4b57-9c2b-ffd0eaad48bd service nova] Creating event network-vif-deleted:70728816-dfac-4a61-a4d8-7acc78a53bf5 for instance 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e on hv-cinder-81322 Feb 21 01:47:10.941514 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-bf0facbc-3be0-4d06-873a-6215381b45af req-02192079-0f12-4b57-9c2b-ffd0eaad48bd service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035080 Feb 21 01:47:10.941514 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1183/2386] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:47:11.775730 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f7fda496-0265-448b-8898-444a1f8314ac tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:11.777072 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f7fda496-0265-448b-8898-444a1f8314ac tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:11.783335 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f7fda496-0265-448b-8898-444a1f8314ac tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:11.784206 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f7fda496-0265-448b-8898-444a1f8314ac tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:11.784986 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f7fda496-0265-448b-8898-444a1f8314ac tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:11.785417 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f7fda496-0265-448b-8898-444a1f8314ac tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:11.819326 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f7fda496-0265-448b-8898-444a1f8314ac tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:11.819770 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f7fda496-0265-448b-8898-444a1f8314ac tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:11.820252 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.objects.instance [None req-f7fda496-0265-448b-8898-444a1f8314ac tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lazy-loading 'fault' on Instance uuid 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e {{(pid=117139) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:47:11.877195 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f7fda496-0265-448b-8898-444a1f8314ac tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae637d5f7f941d8b3b3264c786faddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d1276aa84a48ab830165304f9d6f74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:47:11.878848 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f7fda496-0265-448b-8898-444a1f8314ac tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e" status: 200 len: 1326 microversion: 2.1 time: 0.107045 Feb 21 01:47:11.879436 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1204/2387] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:47:11 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e => generated 1326 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:47:12.897520 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-59654285-677b-47c5-ac4e-c47177bd6cde tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:12.898228 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-59654285-677b-47c5-ac4e-c47177bd6cde tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:12.905261 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-59654285-677b-47c5-ac4e-c47177bd6cde tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:12.905716 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-59654285-677b-47c5-ac4e-c47177bd6cde tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:12.906501 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-59654285-677b-47c5-ac4e-c47177bd6cde tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:12.906938 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-59654285-677b-47c5-ac4e-c47177bd6cde tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:12.920845 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.wsgi [None req-59654285-677b-47c5-ac4e-c47177bd6cde tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] HTTP exception thrown: Instance 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e could not be found. Feb 21 01:47:12.921430 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-59654285-677b-47c5-ac4e-c47177bd6cde tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Returning 404 to user: Instance 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e could not be found. {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:47:12.926506 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-59654285-677b-47c5-ac4e-c47177bd6cde tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e" status: 404 len: 111 microversion: 2.1 time: 0.029185 Feb 21 01:47:12.926506 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1184/2388] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:47:12 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:47:12.934240 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e7169cf3-397f-497e-8da4-c358c8cf2ad1 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '.version_select at 0x7f4ace7ea430>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:13.005227 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e7169cf3-397f-497e-8da4-c358c8cf2ad1 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-501323334" status: 202 len: 0 microversion: 2.1 time: 0.075490 Feb 21 01:47:13.005812 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1205/2389] 10.222.0.91 () {58 vars in 1217 bytes} [Mon Feb 21 01:47:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-501323334 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:47:16.298306 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-23c69448-24ee-41c7-850e-129757cf0727 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:16.298876 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-23c69448-24ee-41c7-850e-129757cf0727 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:16.305046 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-23c69448-24ee-41c7-850e-129757cf0727 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:16.305492 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-23c69448-24ee-41c7-850e-129757cf0727 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:16.306263 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-23c69448-24ee-41c7-850e-129757cf0727 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:16.306740 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-23c69448-24ee-41c7-850e-129757cf0727 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:16.319874 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.wsgi [None req-23c69448-24ee-41c7-850e-129757cf0727 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] HTTP exception thrown: Instance 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e could not be found. Feb 21 01:47:16.320474 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-23c69448-24ee-41c7-850e-129757cf0727 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Returning 404 to user: Instance 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e could not be found. {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:47:16.321274 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-23c69448-24ee-41c7-850e-129757cf0727 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "DELETE /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e" status: 404 len: 111 microversion: 2.1 time: 0.026759 Feb 21 01:47:16.324567 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1185/2390] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Feb 21 01:47:16 2022] DELETE /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:47:16.330208 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4708ab09-4bbc-48df-af72-9cc6c2552a17 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:16.330912 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-4708ab09-4bbc-48df-af72-9cc6c2552a17 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:16.337956 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4708ab09-4bbc-48df-af72-9cc6c2552a17 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:16.338469 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4708ab09-4bbc-48df-af72-9cc6c2552a17 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:16.339325 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4708ab09-4bbc-48df-af72-9cc6c2552a17 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:16.339822 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-4708ab09-4bbc-48df-af72-9cc6c2552a17 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:16.353229 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-4708ab09-4bbc-48df-af72-9cc6c2552a17 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] HTTP exception thrown: Instance 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e could not be found. Feb 21 01:47:16.357592 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-4708ab09-4bbc-48df-af72-9cc6c2552a17 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Returning 404 to user: Instance 7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e could not be found. {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:47:16.357592 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-4708ab09-4bbc-48df-af72-9cc6c2552a17 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e" status: 404 len: 111 microversion: 2.1 time: 0.028823 Feb 21 01:47:16.357592 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1206/2391] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:47:16 2022] GET /compute/v2.1/servers/7bf8db1f-6b3a-46ce-a08f-f5c86cddb26e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:47:17.617466 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f5763cab-4352-455b-b607-aca3dbb07ee9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:17.617971 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f5763cab-4352-455b-b607-aca3dbb07ee9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:17.624806 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f5763cab-4352-455b-b607-aca3dbb07ee9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:17.625254 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f5763cab-4352-455b-b607-aca3dbb07ee9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:17.626028 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f5763cab-4352-455b-b607-aca3dbb07ee9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:17.626509 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f5763cab-4352-455b-b607-aca3dbb07ee9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:17.639858 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.wsgi [None req-f5763cab-4352-455b-b607-aca3dbb07ee9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] HTTP exception thrown: Instance 5a3ff359-a1b9-40d7-abfc-e029467821c0 could not be found. Feb 21 01:47:17.640432 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f5763cab-4352-455b-b607-aca3dbb07ee9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Returning 404 to user: Instance 5a3ff359-a1b9-40d7-abfc-e029467821c0 could not be found. {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:47:17.641249 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f5763cab-4352-455b-b607-aca3dbb07ee9 tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "DELETE /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 404 len: 111 microversion: 2.1 time: 0.027408 Feb 21 01:47:17.641771 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1186/2392] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Feb 21 01:47:17 2022] DELETE /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:47:17.649263 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-eec34860-1392-4d6d-bf28-c4853e6c262a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:17.649898 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-eec34860-1392-4d6d-bf28-c4853e6c262a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] [instance: 5a3ff359-a1b9-40d7-abfc-e029467821c0] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:17.656743 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eec34860-1392-4d6d-bf28-c4853e6c262a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:17.657181 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eec34860-1392-4d6d-bf28-c4853e6c262a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:17.657943 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eec34860-1392-4d6d-bf28-c4853e6c262a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:17.658369 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-eec34860-1392-4d6d-bf28-c4853e6c262a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:17.671596 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-eec34860-1392-4d6d-bf28-c4853e6c262a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] HTTP exception thrown: Instance 5a3ff359-a1b9-40d7-abfc-e029467821c0 could not be found. Feb 21 01:47:17.672194 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-eec34860-1392-4d6d-bf28-c4853e6c262a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] Returning 404 to user: Instance 5a3ff359-a1b9-40d7-abfc-e029467821c0 could not be found. {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:47:17.672983 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-eec34860-1392-4d6d-bf28-c4853e6c262a tempest-AttachVolumeTestJSON-1469390317 tempest-AttachVolumeTestJSON-1469390317-project] 10.222.0.91 "GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0" status: 404 len: 111 microversion: 2.1 time: 0.027328 Feb 21 01:47:17.673474 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1207/2393] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:47:17 2022] GET /compute/v2.1/servers/5a3ff359-a1b9-40d7-abfc-e029467821c0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 01:47:23.164705 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-821aef19-bb7a-4aba-b47e-e3dbf0a61855 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Action: 'create', calling method: .version_select at 0x7f4ace67a040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2019574922"}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:47:23.734232 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-821aef19-bb7a-4aba-b47e-e3dbf0a61855 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.678566 Feb 21 01:47:23.734868 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1187/2394] 10.222.0.91 () {60 vars in 1154 bytes} [Mon Feb 21 01:47:23 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 680 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 21 01:47:23.745694 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-67a68f64-2e2c-4603-8942-40e25f87360b tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Calling method '.version_select at 0x7f4ad33b9a60>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:23.795215 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-67a68f64-2e2c-4603-8942-40e25f87360b tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/fc74e6cc-3307-47b5-b7d2-16d76dc2053d" status: 200 len: 345 microversion: 2.1 time: 0.052805 Feb 21 01:47:23.795814 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1208/2395] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Feb 21 01:47:23 2022] GET /compute/v2.1/os-volumes/fc74e6cc-3307-47b5-b7d2-16d76dc2053d => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:47:24.808149 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1e665469-35da-478a-b022-7b99d5a5b373 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Calling method '.version_select at 0x7f4acf122e50>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:24.854427 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1e665469-35da-478a-b022-7b99d5a5b373 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/fc74e6cc-3307-47b5-b7d2-16d76dc2053d" status: 200 len: 346 microversion: 2.1 time: 0.050346 Feb 21 01:47:24.854989 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1188/2396] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Feb 21 01:47:24 2022] GET /compute/v2.1/os-volumes/fc74e6cc-3307-47b5-b7d2-16d76dc2053d => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:47:24.867238 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-34e39e29-ffb5-48e3-99bb-b5ffa25d9041 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Action: 'create', calling method: .version_select at 0x7f4ace70c940>, body: {"snapshot": {"volume_id": "fc74e6cc-3307-47b5-b7d2-16d76dc2053d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1810646892"}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:47:25.324854 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-34e39e29-ffb5-48e3-99bb-b5ffa25d9041 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] 10.222.0.91 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.461642 Feb 21 01:47:25.325428 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1209/2397] 10.222.0.91 () {60 vars in 1161 bytes} [Mon Feb 21 01:47:24 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:47:25.335380 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-683da443-6340-4d70-a3ae-df86285b4be4 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Calling method '.version_select at 0x7f4ace88bc10>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:25.366829 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-683da443-6340-4d70-a3ae-df86285b4be4 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/63d567c8-db4c-41c9-b7d1-b3c197ee38be" status: 200 len: 287 microversion: 2.1 time: 0.035061 Feb 21 01:47:25.367404 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1189/2398] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Feb 21 01:47:25 2022] GET /compute/v2.1/os-snapshots/63d567c8-db4c-41c9-b7d1-b3c197ee38be => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:47:25.376986 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f1236fdd-6abb-432a-b96f-7b65dfb05936 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Calling method '.version_select at 0x7f4ace88c550>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:25.405103 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f1236fdd-6abb-432a-b96f-7b65dfb05936 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.031783 Feb 21 01:47:25.405666 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1210/2399] 10.222.0.91 () {58 vars in 1139 bytes} [Mon Feb 21 01:47:25 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:47:25.415181 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c1bf63f4-d6dc-4461-865e-a9822e29962a tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Calling method '.version_select at 0x7f4ace8938b0>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:25.444440 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c1bf63f4-d6dc-4461-865e-a9822e29962a tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/63d567c8-db4c-41c9-b7d1-b3c197ee38be" status: 200 len: 287 microversion: 2.1 time: 0.032526 Feb 21 01:47:25.444891 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1190/2400] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Feb 21 01:47:25 2022] GET /compute/v2.1/os-snapshots/63d567c8-db4c-41c9-b7d1-b3c197ee38be => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:47:26.456032 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2a4b153e-1c70-4862-aab6-10f802399855 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Calling method '.version_select at 0x7f4ace85a1f0>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:26.485630 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2a4b153e-1c70-4862-aab6-10f802399855 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/63d567c8-db4c-41c9-b7d1-b3c197ee38be" status: 200 len: 287 microversion: 2.1 time: 0.033669 Feb 21 01:47:26.486184 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1211/2401] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Feb 21 01:47:26 2022] GET /compute/v2.1/os-snapshots/63d567c8-db4c-41c9-b7d1-b3c197ee38be => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:47:27.498153 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-84699d4b-d656-4c6f-9373-dc6761f2602e tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Calling method '.version_select at 0x7f4ace718550>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:27.531930 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-84699d4b-d656-4c6f-9373-dc6761f2602e tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/63d567c8-db4c-41c9-b7d1-b3c197ee38be" status: 200 len: 287 microversion: 2.1 time: 0.038418 Feb 21 01:47:27.532522 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1191/2402] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Feb 21 01:47:27 2022] GET /compute/v2.1/os-snapshots/63d567c8-db4c-41c9-b7d1-b3c197ee38be => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:47:28.543811 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1229d860-2402-4263-ada0-18574274ec0f tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Calling method '.version_select at 0x7f4acf1f0430>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:28.572183 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1229d860-2402-4263-ada0-18574274ec0f tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/63d567c8-db4c-41c9-b7d1-b3c197ee38be" status: 200 len: 287 microversion: 2.1 time: 0.032972 Feb 21 01:47:28.572754 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1212/2403] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Feb 21 01:47:28 2022] GET /compute/v2.1/os-snapshots/63d567c8-db4c-41c9-b7d1-b3c197ee38be => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:47:29.584183 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2af8b779-6090-4cb6-b9b7-c9c422ff9587 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Calling method '.version_select at 0x7f4ace820670>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:29.614325 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2af8b779-6090-4cb6-b9b7-c9c422ff9587 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/63d567c8-db4c-41c9-b7d1-b3c197ee38be" status: 200 len: 288 microversion: 2.1 time: 0.034297 Feb 21 01:47:29.614968 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1192/2404] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Feb 21 01:47:29 2022] GET /compute/v2.1/os-snapshots/63d567c8-db4c-41c9-b7d1-b3c197ee38be => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:47:29.624613 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-b78162cc-1d6c-4b1c-8e18-70e6736396c3 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Calling method '.version_select at 0x7f4acf170550>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:29.735909 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-b78162cc-1d6c-4b1c-8e18-70e6736396c3 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] 10.222.0.91 "DELETE /compute/v2.1/os-snapshots/63d567c8-db4c-41c9-b7d1-b3c197ee38be" status: 202 len: 0 microversion: 2.1 time: 0.114659 Feb 21 01:47:29.736545 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1213/2405] 10.222.0.91 () {58 vars in 1253 bytes} [Mon Feb 21 01:47:29 2022] DELETE /compute/v2.1/os-snapshots/63d567c8-db4c-41c9-b7d1-b3c197ee38be => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:47:29.744423 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f36aa270-ed0c-4073-850a-92f4c186bbd9 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Calling method '.version_select at 0x7f4ace88bca0>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:29.773864 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f36aa270-ed0c-4073-850a-92f4c186bbd9 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/63d567c8-db4c-41c9-b7d1-b3c197ee38be" status: 200 len: 287 microversion: 2.1 time: 0.033024 Feb 21 01:47:29.774434 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1193/2406] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Feb 21 01:47:29 2022] GET /compute/v2.1/os-snapshots/63d567c8-db4c-41c9-b7d1-b3c197ee38be => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:47:30.785723 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3cbf680b-a794-449d-8569-63a908099e36 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Calling method '.version_select at 0x7f4ace7d1820>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:30.808454 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-3cbf680b-a794-449d-8569-63a908099e36 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] HTTP exception thrown: Snapshot 63d567c8-db4c-41c9-b7d1-b3c197ee38be could not be found. Feb 21 01:47:30.809249 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3cbf680b-a794-449d-8569-63a908099e36 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Returning 404 to user: Snapshot 63d567c8-db4c-41c9-b7d1-b3c197ee38be could not be found. {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:47:30.810239 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3cbf680b-a794-449d-8569-63a908099e36 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/63d567c8-db4c-41c9-b7d1-b3c197ee38be" status: 404 len: 111 microversion: 2.1 time: 0.028691 Feb 21 01:47:30.810770 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1214/2407] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Feb 21 01:47:30 2022] GET /compute/v2.1/os-snapshots/63d567c8-db4c-41c9-b7d1-b3c197ee38be => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:47:30.818962 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0102c45d-2da5-46b1-acae-e0659a309374 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Calling method '.version_select at 0x7f4ace74df70>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:31.091491 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0102c45d-2da5-46b1-acae-e0659a309374 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/fc74e6cc-3307-47b5-b7d2-16d76dc2053d" status: 202 len: 0 microversion: 2.1 time: 0.275366 Feb 21 01:47:31.096742 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1194/2408] 10.222.0.91 () {58 vars in 1247 bytes} [Mon Feb 21 01:47:30 2022] DELETE /compute/v2.1/os-volumes/fc74e6cc-3307-47b5-b7d2-16d76dc2053d => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:47:31.103596 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-9f289f3a-4b9d-4a0b-88bd-b2dfea71e12e tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Calling method '.version_select at 0x7f4ace88c9d0>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:31.149896 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-9f289f3a-4b9d-4a0b-88bd-b2dfea71e12e tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/fc74e6cc-3307-47b5-b7d2-16d76dc2053d" status: 200 len: 345 microversion: 2.1 time: 0.049958 Feb 21 01:47:31.150452 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1215/2409] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Feb 21 01:47:31 2022] GET /compute/v2.1/os-volumes/fc74e6cc-3307-47b5-b7d2-16d76dc2053d => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:47:32.162511 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-36eb68b0-0b48-4cdd-aa1d-8fc2eed06cf9 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Calling method '.version_select at 0x7f4ace88b790>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:32.189382 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.wsgi [None req-36eb68b0-0b48-4cdd-aa1d-8fc2eed06cf9 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] HTTP exception thrown: Volume fc74e6cc-3307-47b5-b7d2-16d76dc2053d could not be found. Feb 21 01:47:32.189981 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-36eb68b0-0b48-4cdd-aa1d-8fc2eed06cf9 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Returning 404 to user: Volume fc74e6cc-3307-47b5-b7d2-16d76dc2053d could not be found. {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:47:32.190822 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-36eb68b0-0b48-4cdd-aa1d-8fc2eed06cf9 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/fc74e6cc-3307-47b5-b7d2-16d76dc2053d" status: 404 len: 109 microversion: 2.1 time: 0.032494 Feb 21 01:47:32.191353 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1195/2410] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Feb 21 01:47:32 2022] GET /compute/v2.1/os-volumes/fc74e6cc-3307-47b5-b7d2-16d76dc2053d => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:47:32.205038 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e54bac40-460e-4cfe-a369-df8aa27054f7 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Calling method '.version_select at 0x7f4ace8711f0>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:32.233128 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-e54bac40-460e-4cfe-a369-df8aa27054f7 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] HTTP exception thrown: Volume fc74e6cc-3307-47b5-b7d2-16d76dc2053d could not be found. Feb 21 01:47:32.233714 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e54bac40-460e-4cfe-a369-df8aa27054f7 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Returning 404 to user: Volume fc74e6cc-3307-47b5-b7d2-16d76dc2053d could not be found. {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:47:32.234521 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e54bac40-460e-4cfe-a369-df8aa27054f7 tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/fc74e6cc-3307-47b5-b7d2-16d76dc2053d" status: 404 len: 109 microversion: 2.1 time: 0.033669 Feb 21 01:47:32.235180 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1216/2411] 10.222.0.91 () {58 vars in 1247 bytes} [Mon Feb 21 01:47:32 2022] DELETE /compute/v2.1/os-volumes/fc74e6cc-3307-47b5-b7d2-16d76dc2053d => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:47:32.242896 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a3fe7d1c-ed8f-4b8c-b9f9-95382bb6c7ae tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Calling method '.version_select at 0x7f4ace7ff550>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:32.269613 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.wsgi [None req-a3fe7d1c-ed8f-4b8c-b9f9-95382bb6c7ae tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] HTTP exception thrown: Volume fc74e6cc-3307-47b5-b7d2-16d76dc2053d could not be found. Feb 21 01:47:32.270207 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a3fe7d1c-ed8f-4b8c-b9f9-95382bb6c7ae tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] Returning 404 to user: Volume fc74e6cc-3307-47b5-b7d2-16d76dc2053d could not be found. {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:47:32.271034 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a3fe7d1c-ed8f-4b8c-b9f9-95382bb6c7ae tempest-VolumesSnapshotsTestJSON-1766558792 tempest-VolumesSnapshotsTestJSON-1766558792-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/fc74e6cc-3307-47b5-b7d2-16d76dc2053d" status: 404 len: 109 microversion: 2.1 time: 0.031841 Feb 21 01:47:32.271765 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1196/2412] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Feb 21 01:47:32 2022] GET /compute/v2.1/os-volumes/fc74e6cc-3307-47b5-b7d2-16d76dc2053d => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:47:53.168998 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d87c504d-f526-43ba-8be8-40122553a8bb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-762768237", "imageRef": "9b96cc67-20b9-414f-8afb-039ff7953adc", "flavorRef": "452", "networks": [{"uuid": "f0d87b56-b49e-49d2-8c25-e8d4fdaadd85"}]}} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:47:53.222162 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.network.neutron [None req-d87c504d-f526-43ba-8be8-40122553a8bb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] validate_networks() for [('f0d87b56-b49e-49d2-8c25-e8d4fdaadd85', None, None, None, None, None)] {{(pid=117139) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:47:53.575166 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-d87c504d-f526-43ba-8be8-40122553a8bb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Flavor limits 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:47:53.575743 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-d87c504d-f526-43ba-8be8-40122553a8bb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Image limits 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:47:53.576255 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-d87c504d-f526-43ba-8be8-40122553a8bb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Flavor pref 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:47:53.576773 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-d87c504d-f526-43ba-8be8-40122553a8bb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Image pref 0:0:0 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:47:53.577198 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.virt.hardware [None req-d87c504d-f526-43ba-8be8-40122553a8bb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117139) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:47:53.586467 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d87c504d-f526-43ba-8be8-40122553a8bb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:53.586908 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d87c504d-f526-43ba-8be8-40122553a8bb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:53.587731 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d87c504d-f526-43ba-8be8-40122553a8bb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:53.588180 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d87c504d-f526-43ba-8be8-40122553a8bb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:53.605519 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.quota [None req-d87c504d-f526-43ba-8be8-40122553a8bb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Getting quotas for project bcf09a28d1c5451f9a3f11d7e2ad7b5f. Resources: {'ram', 'cores', 'instances'} {{(pid=117139) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:47:53.609359 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.quota [None req-d87c504d-f526-43ba-8be8-40122553a8bb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Getting quotas for user 4fb38c17dbbb422ba09f0e002219bf55 and project bcf09a28d1c5451f9a3f11d7e2ad7b5f. Resources: {'ram', 'cores', 'instances'} {{(pid=117139) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:47:53.620584 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d87c504d-f526-43ba-8be8-40122553a8bb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Going to run 1 instances... {{(pid=117139) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:47:53.622905 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d87c504d-f526-43ba-8be8-40122553a8bb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b96cc67-20b9-414f-8afb-039ff7953adc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117139) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:47:53.738123 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d87c504d-f526-43ba-8be8-40122553a8bb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574010 Feb 21 01:47:53.738760 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1217/2413] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Feb 21 01:47:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:47:53.748818 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-30d99dc3-17e7-40e8-b7e6-3b7e9784e9bb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:53.749429 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-30d99dc3-17e7-40e8-b7e6-3b7e9784e9bb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:53.805327 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-30d99dc3-17e7-40e8-b7e6-3b7e9784e9bb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:47:53.811654 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-30d99dc3-17e7-40e8-b7e6-3b7e9784e9bb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 200 len: 1213 microversion: 2.1 time: 0.066917 Feb 21 01:47:53.812263 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1197/2414] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:47:53 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:47:54.828391 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-d34471c1-11b3-42f4-9f0f-98764cb25a75 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:54.828924 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-d34471c1-11b3-42f4-9f0f-98764cb25a75 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:54.834851 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d34471c1-11b3-42f4-9f0f-98764cb25a75 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:54.836965 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d34471c1-11b3-42f4-9f0f-98764cb25a75 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:54.836965 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d34471c1-11b3-42f4-9f0f-98764cb25a75 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:54.836965 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-d34471c1-11b3-42f4-9f0f-98764cb25a75 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:54.898237 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-d34471c1-11b3-42f4-9f0f-98764cb25a75 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:47:54.905608 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-d34471c1-11b3-42f4-9f0f-98764cb25a75 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 200 len: 1217 microversion: 2.1 time: 0.081522 Feb 21 01:47:54.906170 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1218/2415] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:47:54 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:47:55.921787 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-fc7d8c42-54a1-4ab5-9d29-b3a30f7dd46f tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:55.922527 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-fc7d8c42-54a1-4ab5-9d29-b3a30f7dd46f tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:55.929306 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fc7d8c42-54a1-4ab5-9d29-b3a30f7dd46f tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:55.933900 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fc7d8c42-54a1-4ab5-9d29-b3a30f7dd46f tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:55.933900 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fc7d8c42-54a1-4ab5-9d29-b3a30f7dd46f tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:55.933900 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-fc7d8c42-54a1-4ab5-9d29-b3a30f7dd46f tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:55.989778 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-fc7d8c42-54a1-4ab5-9d29-b3a30f7dd46f tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:47:55.996959 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-fc7d8c42-54a1-4ab5-9d29-b3a30f7dd46f tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 200 len: 1217 microversion: 2.1 time: 0.078828 Feb 21 01:47:55.997754 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1198/2416] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:47:55 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:47:57.016889 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-98d45f4b-982e-4b1a-9fa6-3eb05df8c208 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:57.017657 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-98d45f4b-982e-4b1a-9fa6-3eb05df8c208 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:57.023922 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-98d45f4b-982e-4b1a-9fa6-3eb05df8c208 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:57.024370 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-98d45f4b-982e-4b1a-9fa6-3eb05df8c208 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:57.025249 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-98d45f4b-982e-4b1a-9fa6-3eb05df8c208 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:57.025702 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-98d45f4b-982e-4b1a-9fa6-3eb05df8c208 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:57.085367 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-98d45f4b-982e-4b1a-9fa6-3eb05df8c208 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:47:57.092878 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-98d45f4b-982e-4b1a-9fa6-3eb05df8c208 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 200 len: 1265 microversion: 2.1 time: 0.079702 Feb 21 01:47:57.093428 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1219/2417] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:47:57 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 1265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:47:58.112866 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9b3b3cf7-bcdf-4351-bbec-739583455d23 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:58.113963 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9b3b3cf7-bcdf-4351-bbec-739583455d23 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:58.120754 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9b3b3cf7-bcdf-4351-bbec-739583455d23 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:58.121196 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9b3b3cf7-bcdf-4351-bbec-739583455d23 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:58.122161 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9b3b3cf7-bcdf-4351-bbec-739583455d23 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:58.122639 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9b3b3cf7-bcdf-4351-bbec-739583455d23 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:58.262205 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9b3b3cf7-bcdf-4351-bbec-739583455d23 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:47:58.270340 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9b3b3cf7-bcdf-4351-bbec-739583455d23 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 200 len: 1313 microversion: 2.1 time: 0.161878 Feb 21 01:47:58.278985 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1199/2418] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:47:58 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:47:58.754640 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-cbb42ada-9fe8-4fd7-af22-3f43475d2d29 req-40acb48d-9f28-479f-b9cc-4f9664e40886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a3764b-c398-4601-8ffa-40fabc76e62e", "tag": "1d79c3bc-9139-446e-ac66-a5390c9809d3"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:47:58.756281 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:47:58.756281 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:47:58.763405 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-cbb42ada-9fe8-4fd7-af22-3f43475d2d29 req-40acb48d-9f28-479f-b9cc-4f9664e40886 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:58.763861 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-cbb42ada-9fe8-4fd7-af22-3f43475d2d29 req-40acb48d-9f28-479f-b9cc-4f9664e40886 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:58.776391 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-cbb42ada-9fe8-4fd7-af22-3f43475d2d29 req-40acb48d-9f28-479f-b9cc-4f9664e40886 service nova] Creating event network-changed:1d79c3bc-9139-446e-ac66-a5390c9809d3 for instance 73a3764b-c398-4601-8ffa-40fabc76e62e on hv-cinder-81322 Feb 21 01:47:58.780835 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-cbb42ada-9fe8-4fd7-af22-3f43475d2d29 req-40acb48d-9f28-479f-b9cc-4f9664e40886 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030064 Feb 21 01:47:58.781413 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1220/2419] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:47:59.287979 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-150691c6-a1b8-4046-93c3-df3725541360 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:47:59.288586 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-150691c6-a1b8-4046-93c3-df3725541360 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:47:59.294757 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-150691c6-a1b8-4046-93c3-df3725541360 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:59.295228 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-150691c6-a1b8-4046-93c3-df3725541360 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:59.296029 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-150691c6-a1b8-4046-93c3-df3725541360 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:47:59.296459 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-150691c6-a1b8-4046-93c3-df3725541360 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:47:59.429162 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-150691c6-a1b8-4046-93c3-df3725541360 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:47:59.436441 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-150691c6-a1b8-4046-93c3-df3725541360 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 200 len: 1313 microversion: 2.1 time: 0.152205 Feb 21 01:47:59.437040 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1200/2420] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:47:59 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:00.454051 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-1c7494cb-be5d-42ff-ae65-16b3d488257e tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:00.454906 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-1c7494cb-be5d-42ff-ae65-16b3d488257e tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:00.460869 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c7494cb-be5d-42ff-ae65-16b3d488257e tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:00.461311 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c7494cb-be5d-42ff-ae65-16b3d488257e tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:00.462067 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c7494cb-be5d-42ff-ae65-16b3d488257e tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:00.462491 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-1c7494cb-be5d-42ff-ae65-16b3d488257e tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:00.599270 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-1c7494cb-be5d-42ff-ae65-16b3d488257e tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:00.606417 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-1c7494cb-be5d-42ff-ae65-16b3d488257e tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 200 len: 1313 microversion: 2.1 time: 0.156830 Feb 21 01:48:00.606976 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1221/2421] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:00 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:01.623584 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-4cc18fb1-0937-4e7b-ac1e-7c6b20c333c9 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:01.624274 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-4cc18fb1-0937-4e7b-ac1e-7c6b20c333c9 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:01.631688 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4cc18fb1-0937-4e7b-ac1e-7c6b20c333c9 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:01.632182 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4cc18fb1-0937-4e7b-ac1e-7c6b20c333c9 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:01.633000 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4cc18fb1-0937-4e7b-ac1e-7c6b20c333c9 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:01.633417 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-4cc18fb1-0937-4e7b-ac1e-7c6b20c333c9 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:01.773464 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-4cc18fb1-0937-4e7b-ac1e-7c6b20c333c9 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:01.781154 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-4cc18fb1-0937-4e7b-ac1e-7c6b20c333c9 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 200 len: 1313 microversion: 2.1 time: 0.161474 Feb 21 01:48:01.781726 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1201/2422] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:01 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:02.798269 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-5e9519e3-3593-4177-820a-79ab61890bea tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:02.798879 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-5e9519e3-3593-4177-820a-79ab61890bea tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:02.805130 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5e9519e3-3593-4177-820a-79ab61890bea tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:02.805581 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5e9519e3-3593-4177-820a-79ab61890bea tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:02.806366 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5e9519e3-3593-4177-820a-79ab61890bea tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:02.806801 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-5e9519e3-3593-4177-820a-79ab61890bea tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:02.945129 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-5e9519e3-3593-4177-820a-79ab61890bea tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:02.952308 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-5e9519e3-3593-4177-820a-79ab61890bea tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 200 len: 1313 microversion: 2.1 time: 0.157760 Feb 21 01:48:02.952871 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1222/2423] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:02 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:03.969196 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5283390d-d37e-466e-bce9-c5d0ba595b2d tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:03.969902 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5283390d-d37e-466e-bce9-c5d0ba595b2d tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:03.976495 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5283390d-d37e-466e-bce9-c5d0ba595b2d tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:03.976944 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5283390d-d37e-466e-bce9-c5d0ba595b2d tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:03.977731 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5283390d-d37e-466e-bce9-c5d0ba595b2d tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:03.978169 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5283390d-d37e-466e-bce9-c5d0ba595b2d tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:04.115885 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5283390d-d37e-466e-bce9-c5d0ba595b2d tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:04.123025 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5283390d-d37e-466e-bce9-c5d0ba595b2d tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 200 len: 1313 microversion: 2.1 time: 0.157793 Feb 21 01:48:04.126850 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1202/2424] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:03 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:05.159879 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-2e5177a2-82bf-4cd3-a30e-d6fca09e5cdf tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:05.160491 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-2e5177a2-82bf-4cd3-a30e-d6fca09e5cdf tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:05.166792 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e5177a2-82bf-4cd3-a30e-d6fca09e5cdf tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:05.167233 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e5177a2-82bf-4cd3-a30e-d6fca09e5cdf tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:05.168037 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e5177a2-82bf-4cd3-a30e-d6fca09e5cdf tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:05.168469 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-2e5177a2-82bf-4cd3-a30e-d6fca09e5cdf tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:05.306169 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-2e5177a2-82bf-4cd3-a30e-d6fca09e5cdf tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:05.314914 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-2e5177a2-82bf-4cd3-a30e-d6fca09e5cdf tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 200 len: 1313 microversion: 2.1 time: 0.158765 Feb 21 01:48:05.315485 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1223/2425] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:05 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:48:06.332389 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f3c743b7-a9f7-4bf2-9375-34064fd843a5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:06.332899 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f3c743b7-a9f7-4bf2-9375-34064fd843a5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:06.338827 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f3c743b7-a9f7-4bf2-9375-34064fd843a5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:06.339272 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f3c743b7-a9f7-4bf2-9375-34064fd843a5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:06.340111 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f3c743b7-a9f7-4bf2-9375-34064fd843a5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:06.340544 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f3c743b7-a9f7-4bf2-9375-34064fd843a5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:06.471940 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-f3c743b7-a9f7-4bf2-9375-34064fd843a5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:06.479051 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f3c743b7-a9f7-4bf2-9375-34064fd843a5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 200 len: 1313 microversion: 2.1 time: 0.151147 Feb 21 01:48:06.479609 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1203/2426] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:06 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:07.495793 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-6e45abd4-fbf7-43fc-bed6-45b51a7615b9 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:07.496430 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-6e45abd4-fbf7-43fc-bed6-45b51a7615b9 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:07.502934 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6e45abd4-fbf7-43fc-bed6-45b51a7615b9 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:07.503380 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6e45abd4-fbf7-43fc-bed6-45b51a7615b9 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:07.504185 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6e45abd4-fbf7-43fc-bed6-45b51a7615b9 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:07.504621 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-6e45abd4-fbf7-43fc-bed6-45b51a7615b9 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:07.638864 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-6e45abd4-fbf7-43fc-bed6-45b51a7615b9 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:07.646951 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-6e45abd4-fbf7-43fc-bed6-45b51a7615b9 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 200 len: 1313 microversion: 2.1 time: 0.154748 Feb 21 01:48:07.647510 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1224/2427] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:07 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:08.419013 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-9a1dce7f-eb72-4afb-b443-b108d41f25bf req-870d89e3-e1eb-4cc9-891e-3e59f67754ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a3764b-c398-4601-8ffa-40fabc76e62e", "name": "network-vif-plugged", "status": "completed", "tag": "1d79c3bc-9139-446e-ac66-a5390c9809d3"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:48:08.420838 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:48:08.420838 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:48:08.428302 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-9a1dce7f-eb72-4afb-b443-b108d41f25bf req-870d89e3-e1eb-4cc9-891e-3e59f67754ed service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:08.428747 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-9a1dce7f-eb72-4afb-b443-b108d41f25bf req-870d89e3-e1eb-4cc9-891e-3e59f67754ed service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:08.440863 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-9a1dce7f-eb72-4afb-b443-b108d41f25bf req-870d89e3-e1eb-4cc9-891e-3e59f67754ed service nova] Creating event network-vif-plugged:1d79c3bc-9139-446e-ac66-a5390c9809d3 for instance 73a3764b-c398-4601-8ffa-40fabc76e62e on hv-cinder-81322 Feb 21 01:48:08.445770 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-9a1dce7f-eb72-4afb-b443-b108d41f25bf req-870d89e3-e1eb-4cc9-891e-3e59f67754ed service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030406 Feb 21 01:48:08.446351 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1204/2428] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:48:08.663098 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-22a4cb04-b4be-4f71-8f33-8a7793eaabc5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:08.663687 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-22a4cb04-b4be-4f71-8f33-8a7793eaabc5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:08.670016 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-22a4cb04-b4be-4f71-8f33-8a7793eaabc5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:08.670462 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-22a4cb04-b4be-4f71-8f33-8a7793eaabc5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:08.671266 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-22a4cb04-b4be-4f71-8f33-8a7793eaabc5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:08.671800 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-22a4cb04-b4be-4f71-8f33-8a7793eaabc5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:08.859457 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-22a4cb04-b4be-4f71-8f33-8a7793eaabc5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:08.867251 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-22a4cb04-b4be-4f71-8f33-8a7793eaabc5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 200 len: 1313 microversion: 2.1 time: 0.207882 Feb 21 01:48:08.867815 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1225/2429] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:08 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:09.885531 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-0ea9b348-bc40-4c60-8f3b-3f680b9efae5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:09.886230 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-0ea9b348-bc40-4c60-8f3b-3f680b9efae5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:09.893611 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0ea9b348-bc40-4c60-8f3b-3f680b9efae5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:09.895125 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0ea9b348-bc40-4c60-8f3b-3f680b9efae5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:09.895125 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0ea9b348-bc40-4c60-8f3b-3f680b9efae5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:09.895369 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-0ea9b348-bc40-4c60-8f3b-3f680b9efae5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:10.036295 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-0ea9b348-bc40-4c60-8f3b-3f680b9efae5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:10.043426 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-0ea9b348-bc40-4c60-8f3b-3f680b9efae5 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 200 len: 1313 microversion: 2.1 time: 0.162345 Feb 21 01:48:10.044005 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1205/2430] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:09 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:11.060827 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-263357dd-85f0-4dbb-a2be-5ae6b1e31ea1 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:11.061351 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-263357dd-85f0-4dbb-a2be-5ae6b1e31ea1 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:11.069735 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-263357dd-85f0-4dbb-a2be-5ae6b1e31ea1 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:11.070180 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-263357dd-85f0-4dbb-a2be-5ae6b1e31ea1 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:11.070963 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-263357dd-85f0-4dbb-a2be-5ae6b1e31ea1 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:11.071396 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-263357dd-85f0-4dbb-a2be-5ae6b1e31ea1 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:11.206249 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-263357dd-85f0-4dbb-a2be-5ae6b1e31ea1 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:11.213414 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-263357dd-85f0-4dbb-a2be-5ae6b1e31ea1 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 200 len: 1496 microversion: 2.1 time: 0.156429 Feb 21 01:48:11.213981 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1226/2431] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:11 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 1496 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:13.324105 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2c36b469-ee7d-4922-a2d5-1aa2ad62c09b tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:13.324609 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2c36b469-ee7d-4922-a2d5-1aa2ad62c09b tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:13.331190 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2c36b469-ee7d-4922-a2d5-1aa2ad62c09b tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:13.331640 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2c36b469-ee7d-4922-a2d5-1aa2ad62c09b tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:13.332457 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2c36b469-ee7d-4922-a2d5-1aa2ad62c09b tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:13.332894 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2c36b469-ee7d-4922-a2d5-1aa2ad62c09b tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:13.358668 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2c36b469-ee7d-4922-a2d5-1aa2ad62c09b tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Going to try to terminate instance {{(pid=117138) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:48:13.626430 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2c36b469-ee7d-4922-a2d5-1aa2ad62c09b tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "DELETE /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 204 len: 0 microversion: 2.1 time: 0.305652 Feb 21 01:48:13.627051 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1206/2432] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Feb 21 01:48:13 2022] DELETE /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:48:13.634892 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-c0268c33-7079-4f3f-b9ac-571909298bb4 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:13.635539 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-c0268c33-7079-4f3f-b9ac-571909298bb4 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:13.642546 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c0268c33-7079-4f3f-b9ac-571909298bb4 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:13.643163 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c0268c33-7079-4f3f-b9ac-571909298bb4 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:13.643970 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c0268c33-7079-4f3f-b9ac-571909298bb4 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:13.644410 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-c0268c33-7079-4f3f-b9ac-571909298bb4 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:13.781104 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-c0268c33-7079-4f3f-b9ac-571909298bb4 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:13.788859 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-c0268c33-7079-4f3f-b9ac-571909298bb4 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 200 len: 1502 microversion: 2.1 time: 0.157593 Feb 21 01:48:13.789409 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1227/2433] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:13 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:14.806466 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2bcfabc2-4322-43b9-a886-f06d60116954 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:14.807160 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2bcfabc2-4322-43b9-a886-f06d60116954 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:14.813492 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2bcfabc2-4322-43b9-a886-f06d60116954 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:14.814062 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2bcfabc2-4322-43b9-a886-f06d60116954 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:14.814841 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2bcfabc2-4322-43b9-a886-f06d60116954 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:14.815273 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2bcfabc2-4322-43b9-a886-f06d60116954 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:14.960675 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2bcfabc2-4322-43b9-a886-f06d60116954 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:14.968063 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2bcfabc2-4322-43b9-a886-f06d60116954 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 200 len: 1502 microversion: 2.1 time: 0.165819 Feb 21 01:48:14.968621 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1207/2434] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:14 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:15.559523 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-f51315dc-fa4c-4795-b64f-3741202ba80a req-ec4900c8-82dd-46d1-917c-4cd0b80eb2bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a3764b-c398-4601-8ffa-40fabc76e62e", "name": "network-vif-deleted", "tag": "1d79c3bc-9139-446e-ac66-a5390c9809d3"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:48:15.561927 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:48:15.561927 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:48:15.570051 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-f51315dc-fa4c-4795-b64f-3741202ba80a req-ec4900c8-82dd-46d1-917c-4cd0b80eb2bd service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:15.570491 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-f51315dc-fa4c-4795-b64f-3741202ba80a req-ec4900c8-82dd-46d1-917c-4cd0b80eb2bd service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:15.581764 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-f51315dc-fa4c-4795-b64f-3741202ba80a req-ec4900c8-82dd-46d1-917c-4cd0b80eb2bd service nova] Creating event network-vif-deleted:1d79c3bc-9139-446e-ac66-a5390c9809d3 for instance 73a3764b-c398-4601-8ffa-40fabc76e62e on hv-cinder-81322 Feb 21 01:48:15.586535 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-f51315dc-fa4c-4795-b64f-3741202ba80a req-ec4900c8-82dd-46d1-917c-4cd0b80eb2bd service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030704 Feb 21 01:48:15.587103 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1228/2435] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:48:15.986154 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-8eea8ad7-7506-4e90-a6e4-06329003048f tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:15.986810 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-8eea8ad7-7506-4e90-a6e4-06329003048f tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:15.993050 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8eea8ad7-7506-4e90-a6e4-06329003048f tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:15.993496 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8eea8ad7-7506-4e90-a6e4-06329003048f tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:15.994270 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8eea8ad7-7506-4e90-a6e4-06329003048f tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:15.994706 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8eea8ad7-7506-4e90-a6e4-06329003048f tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:16.024343 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8eea8ad7-7506-4e90-a6e4-06329003048f tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:16.024795 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-8eea8ad7-7506-4e90-a6e4-06329003048f tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:16.025240 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.objects.instance [None req-8eea8ad7-7506-4e90-a6e4-06329003048f tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lazy-loading 'fault' on Instance uuid 73a3764b-c398-4601-8ffa-40fabc76e62e {{(pid=117138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:48:16.064226 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-8eea8ad7-7506-4e90-a6e4-06329003048f tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:16.071215 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-8eea8ad7-7506-4e90-a6e4-06329003048f tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 200 len: 1303 microversion: 2.1 time: 0.089335 Feb 21 01:48:16.071764 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1208/2436] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:15 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 1303 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:17.089062 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-30c67b03-56a4-4d96-893c-af6cede4f6e2 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:17.089762 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-30c67b03-56a4-4d96-893c-af6cede4f6e2 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:17.096117 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-30c67b03-56a4-4d96-893c-af6cede4f6e2 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:17.096565 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-30c67b03-56a4-4d96-893c-af6cede4f6e2 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:17.097344 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-30c67b03-56a4-4d96-893c-af6cede4f6e2 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:17.097778 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-30c67b03-56a4-4d96-893c-af6cede4f6e2 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:17.127108 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-30c67b03-56a4-4d96-893c-af6cede4f6e2 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:17.127548 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-30c67b03-56a4-4d96-893c-af6cede4f6e2 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:17.128024 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.objects.instance [None req-30c67b03-56a4-4d96-893c-af6cede4f6e2 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lazy-loading 'fault' on Instance uuid 73a3764b-c398-4601-8ffa-40fabc76e62e {{(pid=117139) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:48:17.444581 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-30c67b03-56a4-4d96-893c-af6cede4f6e2 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:17.451773 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-30c67b03-56a4-4d96-893c-af6cede4f6e2 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 200 len: 1303 microversion: 2.1 time: 0.367328 Feb 21 01:48:17.452372 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1229/2437] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:17 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 1303 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:18.468676 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-c3b3d887-e4e4-4e2b-b797-e6d357440010 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:18.469318 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-c3b3d887-e4e4-4e2b-b797-e6d357440010 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:18.476745 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c3b3d887-e4e4-4e2b-b797-e6d357440010 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:18.477199 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c3b3d887-e4e4-4e2b-b797-e6d357440010 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:18.477975 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c3b3d887-e4e4-4e2b-b797-e6d357440010 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:18.478408 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c3b3d887-e4e4-4e2b-b797-e6d357440010 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:18.508044 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c3b3d887-e4e4-4e2b-b797-e6d357440010 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:18.508496 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-c3b3d887-e4e4-4e2b-b797-e6d357440010 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:18.508941 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.objects.instance [None req-c3b3d887-e4e4-4e2b-b797-e6d357440010 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lazy-loading 'fault' on Instance uuid 73a3764b-c398-4601-8ffa-40fabc76e62e {{(pid=117138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:48:18.552204 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-c3b3d887-e4e4-4e2b-b797-e6d357440010 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:18.559500 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-c3b3d887-e4e4-4e2b-b797-e6d357440010 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 200 len: 1303 microversion: 2.1 time: 0.094803 Feb 21 01:48:18.560092 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1209/2438] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:18 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:48:19.576294 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e04cabf9-f755-4ccf-bdcc-167605f04398 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:19.577027 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e04cabf9-f755-4ccf-bdcc-167605f04398 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 73a3764b-c398-4601-8ffa-40fabc76e62e] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:19.584645 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e04cabf9-f755-4ccf-bdcc-167605f04398 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:19.585097 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e04cabf9-f755-4ccf-bdcc-167605f04398 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:19.585874 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e04cabf9-f755-4ccf-bdcc-167605f04398 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:19.586312 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e04cabf9-f755-4ccf-bdcc-167605f04398 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:19.601107 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.wsgi [None req-e04cabf9-f755-4ccf-bdcc-167605f04398 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] HTTP exception thrown: Instance 73a3764b-c398-4601-8ffa-40fabc76e62e could not be found. Feb 21 01:48:19.601730 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e04cabf9-f755-4ccf-bdcc-167605f04398 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Returning 404 to user: Instance 73a3764b-c398-4601-8ffa-40fabc76e62e could not be found. {{(pid=117139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:48:19.602540 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e04cabf9-f755-4ccf-bdcc-167605f04398 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e" status: 404 len: 111 microversion: 2.1 time: 0.029974 Feb 21 01:48:19.603057 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1230/2439] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:19 2022] GET /compute/v2.1/servers/73a3764b-c398-4601-8ffa-40fabc76e62e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:48:19.650788 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-a9a09687-d8d0-4ce9-87e4-2b5d8cc4e9ee tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-851275995", "imageRef": "9b96cc67-20b9-414f-8afb-039ff7953adc", "flavorRef": "452", "networks": [{"uuid": "f0d87b56-b49e-49d2-8c25-e8d4fdaadd85"}]}} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:48:19.703140 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.network.neutron [None req-a9a09687-d8d0-4ce9-87e4-2b5d8cc4e9ee tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] validate_networks() for [('f0d87b56-b49e-49d2-8c25-e8d4fdaadd85', None, None, None, None, None)] {{(pid=117138) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:48:20.127965 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-a9a09687-d8d0-4ce9-87e4-2b5d8cc4e9ee tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Flavor limits 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:48:20.128410 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-a9a09687-d8d0-4ce9-87e4-2b5d8cc4e9ee tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Image limits 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:48:20.128918 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-a9a09687-d8d0-4ce9-87e4-2b5d8cc4e9ee tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Flavor pref 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:48:20.129340 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-a9a09687-d8d0-4ce9-87e4-2b5d8cc4e9ee tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Image pref 0:0:0 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:48:20.129782 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.virt.hardware [None req-a9a09687-d8d0-4ce9-87e4-2b5d8cc4e9ee tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:48:20.138307 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a9a09687-d8d0-4ce9-87e4-2b5d8cc4e9ee tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:20.138757 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a9a09687-d8d0-4ce9-87e4-2b5d8cc4e9ee tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:20.139606 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a9a09687-d8d0-4ce9-87e4-2b5d8cc4e9ee tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:20.140084 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-a9a09687-d8d0-4ce9-87e4-2b5d8cc4e9ee tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:20.157896 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-a9a09687-d8d0-4ce9-87e4-2b5d8cc4e9ee tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Getting quotas for project bcf09a28d1c5451f9a3f11d7e2ad7b5f. Resources: {'ram', 'cores', 'instances'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:48:20.162100 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.quota [None req-a9a09687-d8d0-4ce9-87e4-2b5d8cc4e9ee tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Getting quotas for user 4fb38c17dbbb422ba09f0e002219bf55 and project bcf09a28d1c5451f9a3f11d7e2ad7b5f. Resources: {'ram', 'cores', 'instances'} {{(pid=117138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:48:20.179631 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a9a09687-d8d0-4ce9-87e4-2b5d8cc4e9ee tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Going to run 1 instances... {{(pid=117138) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:48:20.181981 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-a9a09687-d8d0-4ce9-87e4-2b5d8cc4e9ee tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 6542a440-4d60-423e-ae7d-74e2ae63eed8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b96cc67-20b9-414f-8afb-039ff7953adc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117138) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:48:20.298485 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-a9a09687-d8d0-4ce9-87e4-2b5d8cc4e9ee tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651302 Feb 21 01:48:20.299133 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1210/2440] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Feb 21 01:48:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:48:20.308839 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e166efda-0271-4c00-8c2a-4cb2204c9c9a tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:20.309578 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e166efda-0271-4c00-8c2a-4cb2204c9c9a tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 6542a440-4d60-423e-ae7d-74e2ae63eed8] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:20.366491 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e166efda-0271-4c00-8c2a-4cb2204c9c9a tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:20.372865 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e166efda-0271-4c00-8c2a-4cb2204c9c9a tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8" status: 200 len: 1213 microversion: 2.1 time: 0.067782 Feb 21 01:48:20.373420 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1231/2441] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:20 2022] GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:21.390053 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-9ba06d57-c346-42cc-a1dd-d2b5ce7cd4f1 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:21.390712 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-9ba06d57-c346-42cc-a1dd-d2b5ce7cd4f1 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 6542a440-4d60-423e-ae7d-74e2ae63eed8] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:21.397430 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9ba06d57-c346-42cc-a1dd-d2b5ce7cd4f1 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:21.397879 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9ba06d57-c346-42cc-a1dd-d2b5ce7cd4f1 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:21.398655 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9ba06d57-c346-42cc-a1dd-d2b5ce7cd4f1 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:21.399092 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-9ba06d57-c346-42cc-a1dd-d2b5ce7cd4f1 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:21.466435 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-9ba06d57-c346-42cc-a1dd-d2b5ce7cd4f1 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:21.474085 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-9ba06d57-c346-42cc-a1dd-d2b5ce7cd4f1 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8" status: 200 len: 1217 microversion: 2.1 time: 0.088032 Feb 21 01:48:21.474898 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1211/2442] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:21 2022] GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:22.491218 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-267bdbba-cc3b-4be6-8bd8-d59732b01b53 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:22.491862 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-267bdbba-cc3b-4be6-8bd8-d59732b01b53 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 6542a440-4d60-423e-ae7d-74e2ae63eed8] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:22.498848 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-267bdbba-cc3b-4be6-8bd8-d59732b01b53 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:22.499279 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-267bdbba-cc3b-4be6-8bd8-d59732b01b53 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:22.500078 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-267bdbba-cc3b-4be6-8bd8-d59732b01b53 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:22.500505 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-267bdbba-cc3b-4be6-8bd8-d59732b01b53 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:22.594340 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-267bdbba-cc3b-4be6-8bd8-d59732b01b53 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:22.602444 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-267bdbba-cc3b-4be6-8bd8-d59732b01b53 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8" status: 200 len: 1283 microversion: 2.1 time: 0.115163 Feb 21 01:48:22.602995 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1232/2443] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:22 2022] GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8 => generated 1283 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:23.619391 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-2281c2ea-b3a5-46d8-9046-41287f33ddcf tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:23.619945 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-2281c2ea-b3a5-46d8-9046-41287f33ddcf tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 6542a440-4d60-423e-ae7d-74e2ae63eed8] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:23.626202 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2281c2ea-b3a5-46d8-9046-41287f33ddcf tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:23.626642 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2281c2ea-b3a5-46d8-9046-41287f33ddcf tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:23.627500 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2281c2ea-b3a5-46d8-9046-41287f33ddcf tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:23.628051 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-2281c2ea-b3a5-46d8-9046-41287f33ddcf tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:23.761421 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-2281c2ea-b3a5-46d8-9046-41287f33ddcf tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:23.769039 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-2281c2ea-b3a5-46d8-9046-41287f33ddcf tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8" status: 200 len: 1313 microversion: 2.1 time: 0.153438 Feb 21 01:48:23.769654 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1212/2444] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:23 2022] GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:23.985165 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [req-85bb4051-a674-4442-8d2f-8404ae8d0ae8 req-376db83c-a2a0-4adc-ae39-2da58f1e2262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6542a440-4d60-423e-ae7d-74e2ae63eed8", "tag": "23949d21-d04d-40c4-953c-5c240acae731"}]} {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:48:23.994759 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:48:23.994759 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: warnings.warn(msg) Feb 21 01:48:23.994759 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-85bb4051-a674-4442-8d2f-8404ae8d0ae8 req-376db83c-a2a0-4adc-ae39-2da58f1e2262 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:23.994759 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [req-85bb4051-a674-4442-8d2f-8404ae8d0ae8 req-376db83c-a2a0-4adc-ae39-2da58f1e2262 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:24.004757 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.compute.server_external_events [req-85bb4051-a674-4442-8d2f-8404ae8d0ae8 req-376db83c-a2a0-4adc-ae39-2da58f1e2262 service nova] Creating event network-changed:23949d21-d04d-40c4-953c-5c240acae731 for instance 6542a440-4d60-423e-ae7d-74e2ae63eed8 on hv-cinder-81322 Feb 21 01:48:24.009399 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [req-85bb4051-a674-4442-8d2f-8404ae8d0ae8 req-376db83c-a2a0-4adc-ae39-2da58f1e2262 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027992 Feb 21 01:48:24.009976 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1233/2445] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:48:24.786524 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-1adcad77-16a3-48b0-b41b-a9a761029b47 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:24.787126 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-1adcad77-16a3-48b0-b41b-a9a761029b47 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 6542a440-4d60-423e-ae7d-74e2ae63eed8] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:24.793595 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1adcad77-16a3-48b0-b41b-a9a761029b47 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:24.794043 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1adcad77-16a3-48b0-b41b-a9a761029b47 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:24.794821 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1adcad77-16a3-48b0-b41b-a9a761029b47 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:24.795251 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-1adcad77-16a3-48b0-b41b-a9a761029b47 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:24.953926 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-1adcad77-16a3-48b0-b41b-a9a761029b47 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:24.961513 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-1adcad77-16a3-48b0-b41b-a9a761029b47 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8" status: 200 len: 1313 microversion: 2.1 time: 0.178821 Feb 21 01:48:24.962083 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1213/2446] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:24 2022] GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:25.979912 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-f881d3db-4c58-43a0-8a4e-e7cde791bfe6 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:25.980619 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-f881d3db-4c58-43a0-8a4e-e7cde791bfe6 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 6542a440-4d60-423e-ae7d-74e2ae63eed8] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:25.986738 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f881d3db-4c58-43a0-8a4e-e7cde791bfe6 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:25.987186 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f881d3db-4c58-43a0-8a4e-e7cde791bfe6 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:25.988740 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f881d3db-4c58-43a0-8a4e-e7cde791bfe6 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:25.989275 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-f881d3db-4c58-43a0-8a4e-e7cde791bfe6 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:26.134649 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-f881d3db-4c58-43a0-8a4e-e7cde791bfe6 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:26.142184 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-f881d3db-4c58-43a0-8a4e-e7cde791bfe6 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8" status: 200 len: 1313 microversion: 2.1 time: 0.166709 Feb 21 01:48:26.144447 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1234/2447] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:25 2022] GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:27.159406 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-5120e9ca-4f3b-47fd-bc10-a3d54473bacb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:27.160425 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-5120e9ca-4f3b-47fd-bc10-a3d54473bacb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 6542a440-4d60-423e-ae7d-74e2ae63eed8] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:27.168057 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5120e9ca-4f3b-47fd-bc10-a3d54473bacb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:27.168534 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5120e9ca-4f3b-47fd-bc10-a3d54473bacb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:27.175150 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5120e9ca-4f3b-47fd-bc10-a3d54473bacb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:27.175150 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-5120e9ca-4f3b-47fd-bc10-a3d54473bacb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:27.304496 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-5120e9ca-4f3b-47fd-bc10-a3d54473bacb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:27.311602 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-5120e9ca-4f3b-47fd-bc10-a3d54473bacb tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8" status: 200 len: 1313 microversion: 2.1 time: 0.155728 Feb 21 01:48:27.312198 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1214/2448] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:27 2022] GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:28.328254 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-3aff79d6-77fd-4b0f-aaf9-3086b027296b tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:28.328866 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-3aff79d6-77fd-4b0f-aaf9-3086b027296b tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 6542a440-4d60-423e-ae7d-74e2ae63eed8] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:28.335732 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3aff79d6-77fd-4b0f-aaf9-3086b027296b tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:28.336212 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3aff79d6-77fd-4b0f-aaf9-3086b027296b tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:28.336993 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3aff79d6-77fd-4b0f-aaf9-3086b027296b tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:28.337431 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-3aff79d6-77fd-4b0f-aaf9-3086b027296b tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:28.484825 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-3aff79d6-77fd-4b0f-aaf9-3086b027296b tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:28.492298 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-3aff79d6-77fd-4b0f-aaf9-3086b027296b tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8" status: 200 len: 1313 microversion: 2.1 time: 0.167597 Feb 21 01:48:28.492851 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1235/2449] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:28 2022] GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:28.956543 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-347657c0-850c-421b-bf8f-7b70890e0fe9 req-73c98df8-702f-4f45-88c9-eb47b6ee33c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6542a440-4d60-423e-ae7d-74e2ae63eed8", "name": "network-vif-plugged", "status": "completed", "tag": "23949d21-d04d-40c4-953c-5c240acae731"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:48:28.958764 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:48:28.958764 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:48:28.965448 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-347657c0-850c-421b-bf8f-7b70890e0fe9 req-73c98df8-702f-4f45-88c9-eb47b6ee33c6 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:28.965894 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-347657c0-850c-421b-bf8f-7b70890e0fe9 req-73c98df8-702f-4f45-88c9-eb47b6ee33c6 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:28.977179 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-347657c0-850c-421b-bf8f-7b70890e0fe9 req-73c98df8-702f-4f45-88c9-eb47b6ee33c6 service nova] Creating event network-vif-plugged:23949d21-d04d-40c4-953c-5c240acae731 for instance 6542a440-4d60-423e-ae7d-74e2ae63eed8 on hv-cinder-81322 Feb 21 01:48:28.981964 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-347657c0-850c-421b-bf8f-7b70890e0fe9 req-73c98df8-702f-4f45-88c9-eb47b6ee33c6 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150855 Feb 21 01:48:28.982542 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1215/2450] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:48:29.508540 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-e071ab60-b9f8-42a5-8b7b-52090a84420a tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:29.509144 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-e071ab60-b9f8-42a5-8b7b-52090a84420a tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 6542a440-4d60-423e-ae7d-74e2ae63eed8] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:29.515251 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e071ab60-b9f8-42a5-8b7b-52090a84420a tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:29.515691 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e071ab60-b9f8-42a5-8b7b-52090a84420a tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:29.516492 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e071ab60-b9f8-42a5-8b7b-52090a84420a tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:29.516915 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-e071ab60-b9f8-42a5-8b7b-52090a84420a tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:29.649044 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-e071ab60-b9f8-42a5-8b7b-52090a84420a tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:29.656326 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-e071ab60-b9f8-42a5-8b7b-52090a84420a tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8" status: 200 len: 1313 microversion: 2.1 time: 0.151349 Feb 21 01:48:29.656907 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1236/2451] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:29 2022] GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:48:30.674239 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-84ad0078-3988-43bb-bbdc-722c2a675378 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:30.674875 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-84ad0078-3988-43bb-bbdc-722c2a675378 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 6542a440-4d60-423e-ae7d-74e2ae63eed8] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:30.680981 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-84ad0078-3988-43bb-bbdc-722c2a675378 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:30.681425 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-84ad0078-3988-43bb-bbdc-722c2a675378 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:30.682199 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-84ad0078-3988-43bb-bbdc-722c2a675378 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:30.682633 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-84ad0078-3988-43bb-bbdc-722c2a675378 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:30.817753 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-84ad0078-3988-43bb-bbdc-722c2a675378 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:30.825837 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-84ad0078-3988-43bb-bbdc-722c2a675378 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8" status: 200 len: 1497 microversion: 2.1 time: 0.156247 Feb 21 01:48:30.826407 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1216/2452] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:30 2022] GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8 => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:31.589158 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-770dd779-0cc7-4460-8986-3abedf085c7a tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:31.589652 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-770dd779-0cc7-4460-8986-3abedf085c7a tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 6542a440-4d60-423e-ae7d-74e2ae63eed8] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:31.596288 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-770dd779-0cc7-4460-8986-3abedf085c7a tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:31.596832 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-770dd779-0cc7-4460-8986-3abedf085c7a tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:31.598359 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-770dd779-0cc7-4460-8986-3abedf085c7a tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:31.599004 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-770dd779-0cc7-4460-8986-3abedf085c7a tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:31.624671 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-770dd779-0cc7-4460-8986-3abedf085c7a tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 6542a440-4d60-423e-ae7d-74e2ae63eed8] Going to try to terminate instance {{(pid=117139) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:48:31.903102 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-770dd779-0cc7-4460-8986-3abedf085c7a tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "DELETE /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8" status: 204 len: 0 microversion: 2.1 time: 0.317127 Feb 21 01:48:31.903644 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1237/2453] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Feb 21 01:48:31 2022] DELETE /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:48:31.911672 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-de64e9c8-d38f-492d-8d87-840bfe155291 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:31.912297 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-de64e9c8-d38f-492d-8d87-840bfe155291 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 6542a440-4d60-423e-ae7d-74e2ae63eed8] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:31.918794 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-de64e9c8-d38f-492d-8d87-840bfe155291 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:31.919242 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-de64e9c8-d38f-492d-8d87-840bfe155291 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:31.920092 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-de64e9c8-d38f-492d-8d87-840bfe155291 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:31.920524 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-de64e9c8-d38f-492d-8d87-840bfe155291 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:32.065527 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.policy [None req-de64e9c8-d38f-492d-8d87-840bfe155291 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117138) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:32.074331 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-de64e9c8-d38f-492d-8d87-840bfe155291 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8" status: 200 len: 1503 microversion: 2.1 time: 0.166501 Feb 21 01:48:32.074893 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1217/2454] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:31 2022] GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:33.093374 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-cd56a605-2e66-455e-ac5c-9c4b276d7722 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:33.094102 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-cd56a605-2e66-455e-ac5c-9c4b276d7722 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 6542a440-4d60-423e-ae7d-74e2ae63eed8] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:33.101559 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cd56a605-2e66-455e-ac5c-9c4b276d7722 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:33.102020 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cd56a605-2e66-455e-ac5c-9c4b276d7722 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:33.102813 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cd56a605-2e66-455e-ac5c-9c4b276d7722 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:33.103252 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-cd56a605-2e66-455e-ac5c-9c4b276d7722 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:33.252010 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-cd56a605-2e66-455e-ac5c-9c4b276d7722 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:33.259865 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-cd56a605-2e66-455e-ac5c-9c4b276d7722 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8" status: 200 len: 1503 microversion: 2.1 time: 0.171050 Feb 21 01:48:33.260424 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1238/2455] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:33 2022] GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:33.933828 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [req-c964ecda-a707-4557-a407-18e79ad3ae8d req-9d81f6a0-b980-46ae-9384-327af1f4d4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6542a440-4d60-423e-ae7d-74e2ae63eed8", "name": "network-vif-deleted", "tag": "23949d21-d04d-40c4-953c-5c240acae731"}]} {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:48:33.935407 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:48:33.935407 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: warnings.warn(msg) Feb 21 01:48:33.943000 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-c964ecda-a707-4557-a407-18e79ad3ae8d req-9d81f6a0-b980-46ae-9384-327af1f4d4b3 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:33.943435 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [req-c964ecda-a707-4557-a407-18e79ad3ae8d req-9d81f6a0-b980-46ae-9384-327af1f4d4b3 service nova] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:33.954884 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.compute.server_external_events [req-c964ecda-a707-4557-a407-18e79ad3ae8d req-9d81f6a0-b980-46ae-9384-327af1f4d4b3 service nova] Creating event network-vif-deleted:23949d21-d04d-40c4-953c-5c240acae731 for instance 6542a440-4d60-423e-ae7d-74e2ae63eed8 on hv-cinder-81322 Feb 21 01:48:33.960642 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [req-c964ecda-a707-4557-a407-18e79ad3ae8d req-9d81f6a0-b980-46ae-9384-327af1f4d4b3 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030807 Feb 21 01:48:33.961787 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1218/2456] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Feb 21 01:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:48:34.278050 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.api.openstack.wsgi [None req-833b4f40-097c-40ec-9de7-01852e10f7d8 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:34.278652 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.compute.api [None req-833b4f40-097c-40ec-9de7-01852e10f7d8 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 6542a440-4d60-423e-ae7d-74e2ae63eed8] Fetching instance by UUID {{(pid=117139) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:34.285029 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-833b4f40-097c-40ec-9de7-01852e10f7d8 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:34.285498 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-833b4f40-097c-40ec-9de7-01852e10f7d8 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:34.286257 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-833b4f40-097c-40ec-9de7-01852e10f7d8 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:34.286683 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-833b4f40-097c-40ec-9de7-01852e10f7d8 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:34.317689 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-833b4f40-097c-40ec-9de7-01852e10f7d8 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:34.318127 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG oslo_concurrency.lockutils [None req-833b4f40-097c-40ec-9de7-01852e10f7d8 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:34.319103 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.objects.instance [None req-833b4f40-097c-40ec-9de7-01852e10f7d8 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lazy-loading 'fault' on Instance uuid 6542a440-4d60-423e-ae7d-74e2ae63eed8 {{(pid=117139) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:48:34.364986 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: DEBUG nova.policy [None req-833b4f40-097c-40ec-9de7-01852e10f7d8 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb38c17dbbb422ba09f0e002219bf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117139) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:34.372315 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO nova.api.openstack.requestlog [None req-833b4f40-097c-40ec-9de7-01852e10f7d8 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8" status: 200 len: 1303 microversion: 2.1 time: 0.098001 Feb 21 01:48:34.372872 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: [pid: 117139|app: 0|req: 1239/2457] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:34 2022] GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:35.393858 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f5a8b544-372e-4261-806c-918a3d42dc58 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Calling method '>' {{(pid=117138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:35.394561 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.compute.api [None req-f5a8b544-372e-4261-806c-918a3d42dc58 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] [instance: 6542a440-4d60-423e-ae7d-74e2ae63eed8] Fetching instance by UUID {{(pid=117138) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:35.401483 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f5a8b544-372e-4261-806c-918a3d42dc58 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:35.401933 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f5a8b544-372e-4261-806c-918a3d42dc58 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:35.402710 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f5a8b544-372e-4261-806c-918a3d42dc58 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:35.403139 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG oslo_concurrency.lockutils [None req-f5a8b544-372e-4261-806c-918a3d42dc58 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Lock "43422379-6863-4985-aea0-21540c83a2e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:35.415955 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.wsgi [None req-f5a8b544-372e-4261-806c-918a3d42dc58 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] HTTP exception thrown: Instance 6542a440-4d60-423e-ae7d-74e2ae63eed8 could not be found. Feb 21 01:48:35.416543 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: DEBUG nova.api.openstack.wsgi [None req-f5a8b544-372e-4261-806c-918a3d42dc58 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] Returning 404 to user: Instance 6542a440-4d60-423e-ae7d-74e2ae63eed8 could not be found. {{(pid=117138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:48:35.417359 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO nova.api.openstack.requestlog [None req-f5a8b544-372e-4261-806c-918a3d42dc58 tempest-VolumesActionsTest-604054844 tempest-VolumesActionsTest-604054844-project] 10.222.0.91 "GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8" status: 404 len: 111 microversion: 2.1 time: 0.027820 Feb 21 01:48:35.417892 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: [pid: 117138|app: 0|req: 1219/2458] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:35 2022] GET /compute/v2.1/servers/6542a440-4d60-423e-ae7d-74e2ae63eed8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:49:05.739965 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:49:05.740581 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:49:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:50:23.224543 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:50:23.225185 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:50:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:50:50.080063 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Feb 21 01:50:50.080628 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:50:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:50:50.856195 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:50:50.857142 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:50:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:51:04.130377 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:51:04.131167 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:51:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:52:25.749907 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:52:25.750522 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:52:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:53:43.234315 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:53:43.234917 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:53:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:54:10.087812 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:54:10.088667 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:54:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:54:10.864298 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:54:10.864847 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:54:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:54:23.188185 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:54:23.188660 dv-cinder-813227-6-iscsi devstack@n-api.service[117138]: Mon Feb 21 01:54:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:54:24.138679 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:54:24.139355 dv-cinder-813227-6-iscsi devstack@n-api.service[117139]: Mon Feb 21 01:54:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!